Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-05-05T20:13:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-05-05T20:13:17Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260505 20:13:17.630373 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.254:38755
--webserver_interface=127.7.33.254
--webserver_port=0
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260505 20:13:17.963976 7311 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:17.964334 7311 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:17.964402 7311 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260505 20:13:17.973001 7311 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260505 20:13:17.973111 7311 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:17.973168 7311 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260505 20:13:17.973217 7311 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260505 20:13:17.983508 7311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.254:38755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.33.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:17.985203 7311 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:17.987039 7311 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260505 20:13:17.995204 7317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:17.995236 7316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:17.995898 7319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:17.996564 7311 server_base.cc:1061] running on GCE node
I20260505 20:13:17.997400 7311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:17.998929 7311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260505 20:13:18.000155 7311 hybrid_clock.cc:648] HybridClock initialized: now 1778011998000085 us; error 58 us; skew 500 ppm
I20260505 20:13:18.000622 7311 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260505 20:13:18.003021 7311 webserver.cc:492] Webserver started at http://127.7.33.254:35921/ using document root <none> and password file <none>
I20260505 20:13:18.003819 7311 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:18.003961 7311 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:18.004335 7311 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260505 20:13:18.006799 7311 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/instance:
uuid: "73028cd481e446daa9432a35522a7967"
format_stamp: "Formatted at 2026-05-05 20:13:17 on dist-test-slave-1fq8"
I20260505 20:13:18.007608 7311 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal/instance:
uuid: "73028cd481e446daa9432a35522a7967"
format_stamp: "Formatted at 2026-05-05 20:13:17 on dist-test-slave-1fq8"
I20260505 20:13:18.013099 7311 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260505 20:13:18.016700 7325 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:18.018131 7311 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260505 20:13:18.018321 7311 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
uuid: "73028cd481e446daa9432a35522a7967"
format_stamp: "Formatted at 2026-05-05 20:13:17 on dist-test-slave-1fq8"
I20260505 20:13:18.018533 7311 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:18.032470 7311 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:18.033452 7311 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:18.033843 7311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:18.055670 7311 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.254:38755
I20260505 20:13:18.055691 7376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.254:38755 every 8 connection(s)
I20260505 20:13:18.057341 7311 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/info.pb
I20260505 20:13:18.059011 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 7311
I20260505 20:13:18.059295 7303 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal/instance
I20260505 20:13:18.063155 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.253:39345
--webserver_interface=127.7.33.253
--webserver_port=0
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260505 20:13:18.063953 7377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:18.072132 7377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } has no permanent_uuid. Determining permanent_uuid...
I20260505 20:13:18.094151 7377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } has no permanent_uuid. Determining permanent_uuid...
W20260505 20:13:18.095445 7327 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.33.253:39345: connect: Connection refused (error 111)
W20260505 20:13:18.097186 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.253:39345: Network error: Client connection negotiation failed: client connection to 127.7.33.253:39345: connect: Connection refused (error 111)
I20260505 20:13:18.146592 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } attempt: 1
W20260505 20:13:18.148692 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.253:39345: Network error: Client connection negotiation failed: client connection to 127.7.33.253:39345: connect: Connection refused (error 111)
I20260505 20:13:18.217044 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } attempt: 2
W20260505 20:13:18.219004 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.253:39345: Network error: Client connection negotiation failed: client connection to 127.7.33.253:39345: connect: Connection refused (error 111)
I20260505 20:13:18.310298 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } attempt: 3
W20260505 20:13:18.312682 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.253:39345: Network error: Client connection negotiation failed: client connection to 127.7.33.253:39345: connect: Connection refused (error 111)
W20260505 20:13:18.418213 7379 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:18.418603 7379 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:18.418740 7379 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260505 20:13:18.427843 7379 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260505 20:13:18.427987 7379 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:18.428110 7379 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260505 20:13:18.428202 7379 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260505 20:13:18.438702 7379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.253:39345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.33.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:18.440395 7379 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:18.442281 7379 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260505 20:13:18.450870 7388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:18.450835 7387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:18.451938 7390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:18.452234 7379 server_base.cc:1061] running on GCE node
I20260505 20:13:18.452988 7379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:18.454595 7379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260505 20:13:18.455849 7379 hybrid_clock.cc:648] HybridClock initialized: now 1778011998455816 us; error 48 us; skew 500 ppm
I20260505 20:13:18.455924 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } attempt: 4
I20260505 20:13:18.456394 7379 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260505 20:13:18.457896 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.253:39345: Network error: Client connection negotiation failed: client connection to 127.7.33.253:39345: connect: Connection refused (error 111)
I20260505 20:13:18.458940 7379 webserver.cc:492] Webserver started at http://127.7.33.253:46747/ using document root <none> and password file <none>
I20260505 20:13:18.459702 7379 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:18.459839 7379 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:18.460198 7379 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260505 20:13:18.462702 7379 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data/instance:
uuid: "f4615fa5639440fc820498f897adf17d"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:18.463480 7379 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal/instance:
uuid: "f4615fa5639440fc820498f897adf17d"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:18.468924 7379 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260505 20:13:18.472477 7396 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:18.473912 7379 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260505 20:13:18.474098 7379 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal
uuid: "f4615fa5639440fc820498f897adf17d"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:18.474318 7379 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:18.488870 7379 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:18.489873 7379 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:18.490172 7379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:18.511166 7379 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.253:39345
I20260505 20:13:18.511188 7447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.253:39345 every 8 connection(s)
I20260505 20:13:18.512799 7379 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/data/info.pb
I20260505 20:13:18.517222 7448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:18.523010 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 7379
I20260505 20:13:18.523250 7303 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-1/wal/instance
I20260505 20:13:18.523267 7448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } has no permanent_uuid. Determining permanent_uuid...
I20260505 20:13:18.524912 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.252:42521
--webserver_interface=127.7.33.252
--webserver_port=0
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260505 20:13:18.538491 7448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } has no permanent_uuid. Determining permanent_uuid...
I20260505 20:13:18.547881 7448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } has no permanent_uuid. Determining permanent_uuid...
W20260505 20:13:18.549104 7400 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
W20260505 20:13:18.550801 7448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
I20260505 20:13:18.600171 7448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 1
W20260505 20:13:18.602210 7448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
I20260505 20:13:18.670516 7448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 2
W20260505 20:13:18.672555 7448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
I20260505 20:13:18.757184 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } attempt: 5
I20260505 20:13:18.763823 7448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 3
I20260505 20:13:18.764379 7377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } has no permanent_uuid. Determining permanent_uuid...
W20260505 20:13:18.765707 7448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
W20260505 20:13:18.766412 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
I20260505 20:13:18.817651 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 1
W20260505 20:13:18.819983 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
W20260505 20:13:18.862134 7451 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:18.862527 7451 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:18.862663 7451 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260505 20:13:18.871305 7451 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260505 20:13:18.871452 7451 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:18.871572 7451 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260505 20:13:18.871665 7451 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260505 20:13:18.881968 7451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.252:42521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.33.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:18.883738 7451 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:18.885640 7451 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260505 20:13:18.888226 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 2
W20260505 20:13:18.890332 7377 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
W20260505 20:13:18.894713 7459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:18.894747 7458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:18.895455 7461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:18.896322 7451 server_base.cc:1061] running on GCE node
I20260505 20:13:18.897010 7451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:18.898447 7451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260505 20:13:18.899708 7451 hybrid_clock.cc:648] HybridClock initialized: now 1778011998899671 us; error 49 us; skew 500 ppm
I20260505 20:13:18.900166 7451 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260505 20:13:18.902487 7451 webserver.cc:492] Webserver started at http://127.7.33.252:39007/ using document root <none> and password file <none>
I20260505 20:13:18.903259 7451 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:18.903396 7451 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:18.903740 7451 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260505 20:13:18.906104 7451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/instance:
uuid: "29603775b6d74153b21e0bbcc535ff98"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:18.906875 7451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal/instance:
uuid: "29603775b6d74153b21e0bbcc535ff98"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:18.908958 7448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 4
W20260505 20:13:18.910858 7448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
I20260505 20:13:18.912774 7451 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260505 20:13:18.916083 7467 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:18.917443 7451 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:18.917629 7451 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
uuid: "29603775b6d74153b21e0bbcc535ff98"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:18.917919 7451 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:18.930356 7451 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:18.931317 7451 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:18.931617 7451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:18.953136 7451 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.252:42521
I20260505 20:13:18.953152 7518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.252:42521 every 8 connection(s)
I20260505 20:13:18.954747 7451 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/info.pb
I20260505 20:13:18.959153 7519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:18.964250 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 7451
I20260505 20:13:18.964452 7303 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal/instance
I20260505 20:13:18.965262 7519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } has no permanent_uuid. Determining permanent_uuid...
I20260505 20:13:18.979760 7519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } has no permanent_uuid. Determining permanent_uuid...
I20260505 20:13:18.987033 7519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } has no permanent_uuid. Determining permanent_uuid...
I20260505 20:13:18.996583 7377 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 3
I20260505 20:13:19.002707 7519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Bootstrap starting.
I20260505 20:13:19.006297 7519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:19.006601 7377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Bootstrap starting.
I20260505 20:13:19.007510 7519 log.cc:826] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:19.010321 7377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:19.011705 7377 log.cc:826] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:19.011935 7519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: No bootstrap required, opened a new log
I20260505 20:13:19.014433 7377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: No bootstrap required, opened a new log
I20260505 20:13:19.019379 7519 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.019767 7519 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:19.019887 7519 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29603775b6d74153b21e0bbcc535ff98, State: Initialized, Role: FOLLOWER
I20260505 20:13:19.020613 7519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.021639 7377 raft_consensus.cc:359] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.022056 7377 raft_consensus.cc:385] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:19.022228 7377 raft_consensus.cc:740] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73028cd481e446daa9432a35522a7967, State: Initialized, Role: FOLLOWER
I20260505 20:13:19.022217 7529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.022656 7529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.023114 7377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.023463 7519 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: configured and running, proceeding with master startup.
I20260505 20:13:19.024310 7530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.024564 7530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.025640 7377 sys_catalog.cc:565] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: configured and running, proceeding with master startup.
W20260505 20:13:19.036724 7331 tablet.cc:2404] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260505 20:13:19.036849 7543 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260505 20:13:19.037169 7543 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260505 20:13:19.033535 7451 master_runner.cc:186] Error getting master registration for 127.7.33.254:38755: OK, instance_id { permanent_uuid: "73028cd481e446daa9432a35522a7967" instance_seqno: 1778011998049986 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260505 20:13:19.041172 7451 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260505 20:13:19.048310 7553 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260505 20:13:19.048751 7553 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260505 20:13:19.047401 7311 master_runner.cc:186] Error getting master registration for 127.7.33.253:39345: OK, instance_id { permanent_uuid: "f4615fa5639440fc820498f897adf17d" instance_seqno: 1778011998505471 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260505 20:13:19.054478 7311 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260505 20:13:19.183852 7473 tablet.cc:2404] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:19.210073 7448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } attempt: 5
I20260505 20:13:19.219161 7530 raft_consensus.cc:493] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:19.219440 7530 raft_consensus.cc:515] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.221249 7530 leader_election.cc:290] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4615fa5639440fc820498f897adf17d (127.7.33.253:39345), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:19.224146 7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73028cd481e446daa9432a35522a7967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29603775b6d74153b21e0bbcc535ff98" is_pre_election: true
I20260505 20:13:19.225090 7494 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73028cd481e446daa9432a35522a7967 in term 0.
I20260505 20:13:19.225766 7448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Bootstrap starting.
I20260505 20:13:19.226003 7329 leader_election.cc:304] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98, 73028cd481e446daa9432a35522a7967; no voters:
I20260505 20:13:19.226583 7530 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:19.226743 7530 raft_consensus.cc:493] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:19.226869 7530 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:19.230541 7448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:19.230566 7530 raft_consensus.cc:515] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.232045 7448 log.cc:826] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:19.233362 7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73028cd481e446daa9432a35522a7967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29603775b6d74153b21e0bbcc535ff98"
I20260505 20:13:19.233587 7494 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:19.236917 7494 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73028cd481e446daa9432a35522a7967 in term 1.
I20260505 20:13:19.237587 7329 leader_election.cc:304] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98, 73028cd481e446daa9432a35522a7967; no voters:
I20260505 20:13:19.241321 7448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: No bootstrap required, opened a new log
I20260505 20:13:19.241817 7530 leader_election.cc:290] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [CANDIDATE]: Term 1 election: Requested vote from peers f4615fa5639440fc820498f897adf17d (127.7.33.253:39345), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:19.243162 7530 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:19.244091 7530 raft_consensus.cc:697] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 LEADER]: Becoming Leader. State: Replica: 73028cd481e446daa9432a35522a7967, State: Running, Role: LEADER
I20260505 20:13:19.247028 7530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.253069 7448 raft_consensus.cc:359] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.253446 7448 raft_consensus.cc:385] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:19.253597 7448 raft_consensus.cc:740] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4615fa5639440fc820498f897adf17d, State: Initialized, Role: FOLLOWER
I20260505 20:13:19.254340 7448 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.259457 7558 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.259902 7558 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.261821 7448 sys_catalog.cc:565] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: configured and running, proceeding with master startup.
I20260505 20:13:19.261850 7422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73028cd481e446daa9432a35522a7967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d"
I20260505 20:13:19.262293 7422 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:19.265640 7422 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73028cd481e446daa9432a35522a7967 in term 1.
I20260505 20:13:19.265898 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73028cd481e446daa9432a35522a7967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:19.266175 7423 raft_consensus.cc:2376] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73028cd481e446daa9432a35522a7967 in term 1. Re-sending same reply.
I20260505 20:13:19.260075 7556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73028cd481e446daa9432a35522a7967. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.270058 7556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:19.272563 7564 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260505 20:13:19.276561 7564 catalog_manager.cc:1494] Initializing Kudu cluster ID...
W20260505 20:13:19.296636 7570 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260505 20:13:19.296896 7570 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260505 20:13:19.302423 7422 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Refusing update from remote peer 73028cd481e446daa9432a35522a7967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:19.302443 7494 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Refusing update from remote peer 73028cd481e446daa9432a35522a7967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:19.303802 7556 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:19.304167 7530 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:19.336200 7558 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73028cd481e446daa9432a35522a7967. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.336443 7558 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.338900 7529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73028cd481e446daa9432a35522a7967. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.339016 7572 mvcc.cc:204] Tried to move back new op lower bound from 7282737149130334208 to 7282737148935954432. Current Snapshot: MvccSnapshot[applied={T|T < 7282737149130334208}]
I20260505 20:13:19.339160 7529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.352365 7574 mvcc.cc:204] Tried to move back new op lower bound from 7282737149130334208 to 7282737148935954432. Current Snapshot: MvccSnapshot[applied={T|T < 7282737149130334208}]
I20260505 20:13:19.353780 7556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.354357 7556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:19.354617 7556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.354830 7556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:19.367724 7529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.367957 7529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.368469 7558 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:19.368671 7558 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:19.368991 7564 catalog_manager.cc:1357] Generated new cluster ID: 8e14917c53ec4295b4e8c6dc8fd1b1e5
I20260505 20:13:19.369104 7564 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260505 20:13:19.405313 7564 catalog_manager.cc:1380] Generated new certificate authority record
I20260505 20:13:19.407280 7564 catalog_manager.cc:1514] Loading token signing keys...
I20260505 20:13:19.433048 7564 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Generated new TSK 0
I20260505 20:13:19.434320 7564 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260505 20:13:19.465960 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.33.193:0
--local_ip_for_outbound_sockets=127.7.33.193
--webserver_interface=127.7.33.193
--webserver_port=0
--tserver_master_addrs=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260505 20:13:19.864370 7581 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:19.864717 7581 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:19.864884 7581 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260505 20:13:19.874711 7581 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:19.874960 7581 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.33.193
I20260505 20:13:19.886096 7581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.33.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.33.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.33.193
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:19.887760 7581 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:19.889554 7581 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260505 20:13:19.899282 7587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:19.899322 7589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:19.899529 7586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:19.900497 7581 server_base.cc:1061] running on GCE node
I20260505 20:13:19.901216 7581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:19.902238 7581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260505 20:13:19.903473 7581 hybrid_clock.cc:648] HybridClock initialized: now 1778011999903416 us; error 52 us; skew 500 ppm
I20260505 20:13:19.903862 7581 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260505 20:13:19.906186 7581 webserver.cc:492] Webserver started at http://127.7.33.193:42793/ using document root <none> and password file <none>
I20260505 20:13:19.906984 7581 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:19.907121 7581 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:19.907487 7581 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260505 20:13:19.909962 7581 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data/instance:
uuid: "cab133462c2f46309dc8f0792122bad9"
format_stamp: "Formatted at 2026-05-05 20:13:19 on dist-test-slave-1fq8"
I20260505 20:13:19.910753 7581 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/instance:
uuid: "cab133462c2f46309dc8f0792122bad9"
format_stamp: "Formatted at 2026-05-05 20:13:19 on dist-test-slave-1fq8"
I20260505 20:13:19.916189 7581 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260505 20:13:19.919587 7595 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:19.920961 7581 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:19.921159 7581 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal
uuid: "cab133462c2f46309dc8f0792122bad9"
format_stamp: "Formatted at 2026-05-05 20:13:19 on dist-test-slave-1fq8"
I20260505 20:13:19.921391 7581 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:19.932781 7600 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:19.933030 7600 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:19.934525 7600 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:19.935089 7422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:19.935141 7352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:19.936074 7470 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98; no voters: 73028cd481e446daa9432a35522a7967, f4615fa5639440fc820498f897adf17d
I20260505 20:13:19.936429 7600 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:19.944180 7581 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:19.945015 7581 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:19.945252 7581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:19.946231 7581 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260505 20:13:19.947909 7581 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260505 20:13:19.947995 7581 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:19.948076 7581 ts_tablet_manager.cc:616] Registered 0 tablets
I20260505 20:13:19.948129 7581 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:19.984457 7581 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.193:40347
I20260505 20:13:19.984553 7708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.193:40347 every 8 connection(s)
I20260505 20:13:19.985956 7581 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/data/info.pb
I20260505 20:13:19.988747 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 7581
I20260505 20:13:19.988981 7303 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/instance
I20260505 20:13:19.993942 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.33.194:0
--local_ip_for_outbound_sockets=127.7.33.194
--webserver_interface=127.7.33.194
--webserver_port=0
--tserver_master_addrs=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260505 20:13:20.017782 7711 heartbeater.cc:344] Connected to a master server at 127.7.33.253:39345
I20260505 20:13:20.018298 7711 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.019524 7711 heartbeater.cc:507] Master 127.7.33.253:39345 requested a full tablet report, sending...
I20260505 20:13:20.020450 7709 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:20.020592 7709 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.021131 7709 heartbeater.cc:507] Master 127.7.33.252:42521 requested a full tablet report, sending...
I20260505 20:13:20.022595 7413 ts_manager.cc:194] Registered new tserver with Master: cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:20.022964 7484 ts_manager.cc:194] Registered new tserver with Master: cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:20.025007 7710 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:20.025153 7710 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.025597 7710 heartbeater.cc:507] Master 127.7.33.254:38755 requested a full tablet report, sending...
I20260505 20:13:20.027257 7342 ts_manager.cc:194] Registered new tserver with Master: cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:20.029675 7342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.33.193:49203
I20260505 20:13:20.039299 7543 catalog_manager.cc:1269] Loaded cluster ID: 8e14917c53ec4295b4e8c6dc8fd1b1e5
I20260505 20:13:20.039429 7543 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: loading cluster ID for follower catalog manager: success
I20260505 20:13:20.042193 7543 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: acquiring CA information for follower catalog manager: success
I20260505 20:13:20.043839 7543 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260505 20:13:20.299084 7570 catalog_manager.cc:1269] Loaded cluster ID: 8e14917c53ec4295b4e8c6dc8fd1b1e5
I20260505 20:13:20.299209 7570 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: loading cluster ID for follower catalog manager: success
I20260505 20:13:20.301926 7570 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: acquiring CA information for follower catalog manager: success
I20260505 20:13:20.303795 7570 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260505 20:13:20.347993 7719 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:20.348312 7719 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:20.348477 7719 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260505 20:13:20.357136 7719 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:20.357368 7719 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.33.194
I20260505 20:13:20.367686 7719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.33.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.33.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.33.194
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:20.369344 7719 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:20.371253 7719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260505 20:13:20.380998 7725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:20.381057 7724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:20.381785 7727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:20.382201 7719 server_base.cc:1061] running on GCE node
I20260505 20:13:20.382817 7719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:20.383774 7719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260505 20:13:20.385118 7719 hybrid_clock.cc:648] HybridClock initialized: now 1778012000385064 us; error 49 us; skew 500 ppm
I20260505 20:13:20.385210 7730 raft_consensus.cc:493] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:20.385499 7719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260505 20:13:20.385432 7730 raft_consensus.cc:515] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:20.387167 7730 leader_election.cc:290] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:20.387660 7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4615fa5639440fc820498f897adf17d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29603775b6d74153b21e0bbcc535ff98" is_pre_election: true
I20260505 20:13:20.387630 7352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4615fa5639440fc820498f897adf17d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:20.388391 7399 leader_election.cc:304] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4615fa5639440fc820498f897adf17d; no voters: 29603775b6d74153b21e0bbcc535ff98, 73028cd481e446daa9432a35522a7967
I20260505 20:13:20.388788 7730 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:20.389108 7719 webserver.cc:492] Webserver started at http://127.7.33.194:37211/ using document root <none> and password file <none>
I20260505 20:13:20.389927 7719 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:20.390058 7719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:20.390431 7719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260505 20:13:20.392735 7719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data/instance:
uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
format_stamp: "Formatted at 2026-05-05 20:13:20 on dist-test-slave-1fq8"
I20260505 20:13:20.393478 7719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/instance:
uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
format_stamp: "Formatted at 2026-05-05 20:13:20 on dist-test-slave-1fq8"
I20260505 20:13:20.398834 7719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260505 20:13:20.402137 7734 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:20.403630 7719 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260505 20:13:20.403826 7719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal
uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
format_stamp: "Formatted at 2026-05-05 20:13:20 on dist-test-slave-1fq8"
I20260505 20:13:20.404029 7719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:20.421496 7719 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:20.422619 7719 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:20.422981 7719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:20.424005 7719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260505 20:13:20.425920 7719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260505 20:13:20.426052 7719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:20.426188 7719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260505 20:13:20.426273 7719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:20.462575 7719 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.194:41991
I20260505 20:13:20.462669 7846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.194:41991 every 8 connection(s)
I20260505 20:13:20.464187 7719 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/data/info.pb
I20260505 20:13:20.466492 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 7719
I20260505 20:13:20.466682 7303 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/instance
I20260505 20:13:20.473950 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.33.195:0
--local_ip_for_outbound_sockets=127.7.33.195
--webserver_interface=127.7.33.195
--webserver_port=0
--tserver_master_addrs=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260505 20:13:20.485992 7847 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:20.486466 7847 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.487440 7848 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:20.487553 7847 heartbeater.cc:507] Master 127.7.33.252:42521 requested a full tablet report, sending...
I20260505 20:13:20.487571 7848 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.488063 7848 heartbeater.cc:507] Master 127.7.33.254:38755 requested a full tablet report, sending...
I20260505 20:13:20.489213 7342 ts_manager.cc:194] Registered new tserver with Master: c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:20.489423 7849 heartbeater.cc:344] Connected to a master server at 127.7.33.253:39345
I20260505 20:13:20.489562 7849 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.490038 7849 heartbeater.cc:507] Master 127.7.33.253:39345 requested a full tablet report, sending...
I20260505 20:13:20.490449 7342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.33.194:44947
I20260505 20:13:20.491161 7413 ts_manager.cc:194] Registered new tserver with Master: c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:20.491268 7484 ts_manager.cc:194] Registered new tserver with Master: c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:20.532554 7710 heartbeater.cc:499] Master 127.7.33.254:38755 was elected leader, sending a full tablet report...
W20260505 20:13:20.834344 7854 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:20.834653 7854 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:20.834841 7854 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260505 20:13:20.844107 7854 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:20.844347 7854 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.33.195
I20260505 20:13:20.854904 7854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.33.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.33.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.33.195
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:20.856611 7854 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:20.858619 7854 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260505 20:13:20.869032 7859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:20.869035 7860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260505 20:13:20.869130 7862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:20.869661 7854 server_base.cc:1061] running on GCE node
I20260505 20:13:20.870599 7854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:20.871625 7854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260505 20:13:20.872870 7854 hybrid_clock.cc:648] HybridClock initialized: now 1778012000872827 us; error 38 us; skew 500 ppm
I20260505 20:13:20.873230 7854 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260505 20:13:20.875630 7854 webserver.cc:492] Webserver started at http://127.7.33.195:37879/ using document root <none> and password file <none>
I20260505 20:13:20.876485 7854 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:20.876636 7854 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:20.877033 7854 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260505 20:13:20.880117 7854 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data/instance:
uuid: "974ed93a43c54ccbb58e60bfdae7c546"
format_stamp: "Formatted at 2026-05-05 20:13:20 on dist-test-slave-1fq8"
I20260505 20:13:20.880961 7854 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/instance:
uuid: "974ed93a43c54ccbb58e60bfdae7c546"
format_stamp: "Formatted at 2026-05-05 20:13:20 on dist-test-slave-1fq8"
I20260505 20:13:20.886620 7854 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260505 20:13:20.890360 7868 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:20.891903 7854 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260505 20:13:20.892058 7854 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal
uuid: "974ed93a43c54ccbb58e60bfdae7c546"
format_stamp: "Formatted at 2026-05-05 20:13:20 on dist-test-slave-1fq8"
I20260505 20:13:20.892249 7854 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:20.916517 7854 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:20.917409 7854 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:20.917646 7854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:20.918593 7854 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260505 20:13:20.920182 7854 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260505 20:13:20.920267 7854 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:20.920336 7854 ts_tablet_manager.cc:616] Registered 0 tablets
I20260505 20:13:20.920397 7854 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:20.923440 7876 raft_consensus.cc:493] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:20.923681 7876 raft_consensus.cc:515] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:20.924468 7876 leader_election.cc:290] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:20.925024 7352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4615fa5639440fc820498f897adf17d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:20.925154 7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4615fa5639440fc820498f897adf17d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29603775b6d74153b21e0bbcc535ff98" is_pre_election: true
I20260505 20:13:20.925822 7399 leader_election.cc:304] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4615fa5639440fc820498f897adf17d; no voters: 29603775b6d74153b21e0bbcc535ff98, 73028cd481e446daa9432a35522a7967
I20260505 20:13:20.926155 7876 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:20.958288 7854 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.195:39859
I20260505 20:13:20.958385 7981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.195:39859 every 8 connection(s)
I20260505 20:13:20.959801 7854 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/data/info.pb
I20260505 20:13:20.963263 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 7854
I20260505 20:13:20.963537 7303 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/instance
I20260505 20:13:20.981101 7983 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:20.981323 7982 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:20.981509 7984 heartbeater.cc:344] Connected to a master server at 127.7.33.253:39345
I20260505 20:13:20.981587 7983 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.981592 7982 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.981685 7984 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:20.982805 7984 heartbeater.cc:507] Master 127.7.33.253:39345 requested a full tablet report, sending...
I20260505 20:13:20.982857 7983 heartbeater.cc:507] Master 127.7.33.254:38755 requested a full tablet report, sending...
I20260505 20:13:20.982899 7982 heartbeater.cc:507] Master 127.7.33.252:42521 requested a full tablet report, sending...
I20260505 20:13:20.984652 7484 ts_manager.cc:194] Registered new tserver with Master: 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:20.984653 7413 ts_manager.cc:194] Registered new tserver with Master: 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:20.985247 7342 ts_manager.cc:194] Registered new tserver with Master: 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:20.986234 7342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.7.33.195:36943
I20260505 20:13:20.992476 7303 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260505 20:13:20.993011 7848 heartbeater.cc:499] Master 127.7.33.254:38755 was elected leader, sending a full tablet report...
I20260505 20:13:21.022948 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c086e5c6142648eba35ed16627f110b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.022888 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2951db551a3c42cc95f5ea78274a73ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.023542 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_4201f3d9a9284d8fa69b950809a90dda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.024817 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_fc24f10488ab4376963f7a0c9bc31733"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.026926 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c086e5c6142648eba35ed16627f110b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.026929 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4201f3d9a9284d8fa69b950809a90dda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.027527 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2951db551a3c42cc95f5ea78274a73ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.029316 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a44e5fe432f54a4585b4357ff357b81f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.030133 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a44e5fe432f54a4585b4357ff357b81f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.030035 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_847b5f4e43624ef6a4d94ea0c4f586b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.030644 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.030917 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_ae0b8cc6c43d423b90962230bc1fdad3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.031375 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae0b8cc6c43d423b90962230bc1fdad3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.031674 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d2eb03609f584df8b1864bb4dcc7657b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.032126 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2eb03609f584df8b1864bb4dcc7657b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.032267 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1ca4e07ca11647aea3925a39580491bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.032780 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ca4e07ca11647aea3925a39580491bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.033000 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3e9ced89447c4c2a97be04d5344d52d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.034520 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e9ced89447c4c2a97be04d5344d52d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.037679 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc24f10488ab4376963f7a0c9bc31733 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.092381 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2951db551a3c42cc95f5ea78274a73ac" } new_table_name: "default.Table_21bf596b95564f88b8d7e20935fa66ba" modify_external_catalogs: true
I20260505 20:13:21.113588 7303 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskf21k8s/build/asan/bin/kudu pid 7451
I20260505 20:13:21.115206 7514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260505 20:13:21.129496 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d2eb03609f584df8b1864bb4dcc7657b" } new_table_name: "default.Table_ee6f5cb164d1435ba5955ac615e2249b" modify_external_catalogs: true
W20260505 20:13:21.132288 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 855691b4c37f42bfbfc665bb6a712092 consensus state has no leader
I20260505 20:13:21.132576 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4201f3d9a9284d8fa69b950809a90dda" } new_table_name: "default.Table_59a52d4430a24ca587595b26e0d3cefe" modify_external_catalogs: true
I20260505 20:13:21.132316 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_847b5f4e43624ef6a4d94ea0c4f586b4" } modify_external_catalogs: true
I20260505 20:13:21.134021 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c086e5c6142648eba35ed16627f110b9" } new_table_name: "default.Table_81ec61790b36437490005ea685dc9b2e" modify_external_catalogs: true
I20260505 20:13:21.134488 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_fc24f10488ab4376963f7a0c9bc31733" } modify_external_catalogs: true
I20260505 20:13:21.135257 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3e9ced89447c4c2a97be04d5344d52d3" } new_table_name: "default.Table_0c18b95b0d9840e387da91812077995a" modify_external_catalogs: true
I20260505 20:13:21.136372 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1ca4e07ca11647aea3925a39580491bf" } modify_external_catalogs: true
I20260505 20:13:21.138897 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_847b5f4e43624ef6a4d94ea0c4f586b4" } modify_external_catalogs: true
I20260505 20:13:21.139226 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_fc24f10488ab4376963f7a0c9bc31733" } modify_external_catalogs: true
I20260505 20:13:21.141446 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1ca4e07ca11647aea3925a39580491bf" } modify_external_catalogs: true
W20260505 20:13:21.153081 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38bc883c8e98495882e4d8ef68c9da80 has no consensus state
W20260505 20:13:21.153535 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8af8c7fa9554353a61594c4e426ef2f has no consensus state
I20260505 20:13:21.154522 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_21bf596b95564f88b8d7e20935fa66ba" } modify_external_catalogs: true
I20260505 20:13:21.154772 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_21bf596b95564f88b8d7e20935fa66ba" } modify_external_catalogs: true
I20260505 20:13:21.154569 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ae0b8cc6c43d423b90962230bc1fdad3" } modify_external_catalogs: true
I20260505 20:13:21.155463 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ae0b8cc6c43d423b90962230bc1fdad3" } modify_external_catalogs: true
W20260505 20:13:21.161212 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f09c91392ee4b32b16d1638079ac2cb consensus state has no leader
W20260505 20:13:21.161659 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf0bab3a0fb14e41959f3b96cd47e2ce consensus state has no leader
I20260505 20:13:21.166698 7644 tablet_service.cc:1511] Processing CreateTablet for tablet 855691b4c37f42bfbfc665bb6a712092 (DEFAULT_TABLE table=default.Table_2951db551a3c42cc95f5ea78274a73ac [id=1362ad2a11fd427d814566441a09dec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.168412 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855691b4c37f42bfbfc665bb6a712092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.172732 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d (DEFAULT_TABLE table=default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 [id=3d33e35a14b9400593605d46763f73c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.173234 7337 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet c1c3a20c0e244f8595718ee37460b0cf
I20260505 20:13:21.173281 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.174510 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 (DEFAULT_TABLE table=default.Table_fc24f10488ab4376963f7a0c9bc31733 [id=6d220472d20c42b6844c2185e1dbc9d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.175004 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.176214 7641 tablet_service.cc:1511] Processing CreateTablet for tablet f8af8c7fa9554353a61594c4e426ef2f (DEFAULT_TABLE table=default.Table_59a52d4430a24ca587595b26e0d3cefe [id=680c74a223d54940afd6e814558bf4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.176640 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8af8c7fa9554353a61594c4e426ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.176813 7328 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 855691b4c37f42bfbfc665bb6a712092 (table default.Table_21bf596b95564f88b8d7e20935fa66ba [id=1362ad2a11fd427d814566441a09dec3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 855691b4c37f42bfbfc665bb6a712092 consensus state has no leader
I20260505 20:13:21.179601 7640 tablet_service.cc:1511] Processing CreateTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 (DEFAULT_TABLE table=default.Table_ee6f5cb164d1435ba5955ac615e2249b [id=d79f9a116fdb4912b39f530d6f5d43ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.179656 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 8f09c91392ee4b32b16d1638079ac2cb (DEFAULT_TABLE table=default.Table_81ec61790b36437490005ea685dc9b2e [id=0e17662146d24eaeaa66105b3590b725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.180320 7640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38bc883c8e98495882e4d8ef68c9da80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.180758 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f09c91392ee4b32b16d1638079ac2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.181381 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 (DEFAULT_TABLE table=default.Table_1ca4e07ca11647aea3925a39580491bf [id=18ef752a3c414e21848ef8ea109d9053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.181915 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385cafb44791473ab10a8a9cd78a5cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.184195 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:21.184795 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 855691b4c37f42bfbfc665bb6a712092
I20260505 20:13:21.185657 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 385cafb44791473ab10a8a9cd78a5cb7
I20260505 20:13:21.185472 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 (DEFAULT_TABLE table=default.Table_ee6f5cb164d1435ba5955ac615e2249b [id=d79f9a116fdb4912b39f530d6f5d43ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.186744 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8b6cb875a42d4f16904e2d5bf62c1d0d
I20260505 20:13:21.187250 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38bc883c8e98495882e4d8ef68c9da80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.190502 7914 tablet_service.cc:1511] Processing CreateTablet for tablet f8af8c7fa9554353a61594c4e426ef2f (DEFAULT_TABLE table=default.Table_59a52d4430a24ca587595b26e0d3cefe [id=680c74a223d54940afd6e814558bf4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.190536 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 (DEFAULT_TABLE table=default.Table_fc24f10488ab4376963f7a0c9bc31733 [id=6d220472d20c42b6844c2185e1dbc9d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.190799 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 8f09c91392ee4b32b16d1638079ac2cb (DEFAULT_TABLE table=default.Table_81ec61790b36437490005ea685dc9b2e [id=0e17662146d24eaeaa66105b3590b725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.191072 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8af8c7fa9554353a61594c4e426ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.191025 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d (DEFAULT_TABLE table=default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 [id=3d33e35a14b9400593605d46763f73c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.191617 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f09c91392ee4b32b16d1638079ac2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.191866 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.191783 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 855691b4c37f42bfbfc665bb6a712092 (DEFAULT_TABLE table=default.Table_21bf596b95564f88b8d7e20935fa66ba [id=1362ad2a11fd427d814566441a09dec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.192265 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.193477 7910 tablet_service.cc:1511] Processing CreateTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce (DEFAULT_TABLE table=default.Table_0c18b95b0d9840e387da91812077995a [id=0a78e2ddc7f14316960db11d6dc289c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.193369 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 (DEFAULT_TABLE table=default.Table_1ca4e07ca11647aea3925a39580491bf [id=18ef752a3c414e21848ef8ea109d9053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.194676 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.195204 7637 tablet_service.cc:1511] Processing CreateTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce (DEFAULT_TABLE table=default.Table_0c18b95b0d9840e387da91812077995a [id=0a78e2ddc7f14316960db11d6dc289c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.195560 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.195819 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0bab3a0fb14e41959f3b96cd47e2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.196246 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.196615 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.196877 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.197054 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.203821 7909 tablet_service.cc:1511] Processing CreateTablet for tablet edceecc7eee4477a869acce495aade1c (DEFAULT_TABLE table=default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.208570 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0bab3a0fb14e41959f3b96cd47e2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.209292 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385cafb44791473ab10a8a9cd78a5cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.209897 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edceecc7eee4477a869acce495aade1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.210470 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855691b4c37f42bfbfc665bb6a712092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.209591 7774 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.211158 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.210556 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d (DEFAULT_TABLE table=default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 [id=3d33e35a14b9400593605d46763f73c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.211469 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.211764 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.212261 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.212231 7770 tablet_service.cc:1511] Processing CreateTablet for tablet edceecc7eee4477a869acce495aade1c (DEFAULT_TABLE table=default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.212700 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edceecc7eee4477a869acce495aade1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.214092 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 8f09c91392ee4b32b16d1638079ac2cb (DEFAULT_TABLE table=default.Table_81ec61790b36437490005ea685dc9b2e [id=0e17662146d24eaeaa66105b3590b725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.214658 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f09c91392ee4b32b16d1638079ac2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.217905 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 (DEFAULT_TABLE table=default.Table_fc24f10488ab4376963f7a0c9bc31733 [id=6d220472d20c42b6844c2185e1dbc9d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.218466 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.221913 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 (DEFAULT_TABLE table=default.Table_1ca4e07ca11647aea3925a39580491bf [id=18ef752a3c414e21848ef8ea109d9053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.222497 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385cafb44791473ab10a8a9cd78a5cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.226089 7775 tablet_service.cc:1511] Processing CreateTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce (DEFAULT_TABLE table=default.Table_0c18b95b0d9840e387da91812077995a [id=0a78e2ddc7f14316960db11d6dc289c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.226684 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0bab3a0fb14e41959f3b96cd47e2ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.233119 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 (DEFAULT_TABLE table=default.Table_ee6f5cb164d1435ba5955ac615e2249b [id=d79f9a116fdb4912b39f530d6f5d43ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.238003 7779 tablet_service.cc:1511] Processing CreateTablet for tablet f8af8c7fa9554353a61594c4e426ef2f (DEFAULT_TABLE table=default.Table_59a52d4430a24ca587595b26e0d3cefe [id=680c74a223d54940afd6e814558bf4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.238844 7779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8af8c7fa9554353a61594c4e426ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.241971 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 855691b4c37f42bfbfc665bb6a712092 (DEFAULT_TABLE table=default.Table_2951db551a3c42cc95f5ea78274a73ac [id=1362ad2a11fd427d814566441a09dec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.242700 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855691b4c37f42bfbfc665bb6a712092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.258203 7333 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b6cb875a42d4f16904e2d5bf62c1d0d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.258580 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38bc883c8e98495882e4d8ef68c9da80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.259083 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b6cb875a42d4f16904e2d5bf62c1d0d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.259542 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b6cb875a42d4f16904e2d5bf62c1d0d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.261885 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.265916 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.275417 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b6cb875a42d4f16904e2d5bf62c1d0d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.276712 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b6cb875a42d4f16904e2d5bf62c1d0d from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:21.283136 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 855691b4c37f42bfbfc665bb6a712092 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 855691b4c37f42bfbfc665bb6a712092 already in progress: creating tablet
I20260505 20:13:21.284139 8054 tablet_bootstrap.cc:492] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:21.287004 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 385cafb44791473ab10a8a9cd78a5cb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 385cafb44791473ab10a8a9cd78a5cb7 already in progress: creating tablet
W20260505 20:13:21.287585 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d because the tablet was not found. No further retry: Not found: Tablet not found: 8b6cb875a42d4f16904e2d5bf62c1d0d
W20260505 20:13:21.288130 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 already in progress: creating tablet
I20260505 20:13:21.291441 8054 tablet_bootstrap.cc:654] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.292166 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a3e0c5fe3f78438bbdfe42eeb7c3b94b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.292793 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e0c5fe3f78438bbdfe42eeb7c3b94b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.292872 8054 log.cc:826] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:21.302891 8054 tablet_bootstrap.cc:492] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.303236 8054 ts_tablet_manager.cc:1403] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20260505 20:13:21.305995 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3dab8dc4dc7446dca8a85f6d18cbf18f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.306559 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dab8dc4dc7446dca8a85f6d18cbf18f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.310294 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d5b8d6121e234d70939c2432a603ff18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.310797 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5b8d6121e234d70939c2432a603ff18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.317077 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_5264083122114789aa5598e2f170c57e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.317195 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2329990d33d941799ae7ae7cbb3c3493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.317663 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2329990d33d941799ae7ae7cbb3c3493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.317670 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5264083122114789aa5598e2f170c57e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.324837 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_fbd5e06b0ee545028e591111a5e9e1a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.325309 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_668e9f64503947c3a4a2fb730d2b8406"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.325603 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbd5e06b0ee545028e591111a5e9e1a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.325832 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_668e9f64503947c3a4a2fb730d2b8406 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.327280 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9e1bb2a23514497b9dd3580f1479a03c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.327780 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e1bb2a23514497b9dd3580f1479a03c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.327988 7781 tablet_service.cc:1511] Processing CreateTablet for tablet c552895eb36e49cfba7ad18ff462dba1 (DEFAULT_TABLE table=default.Table_a3e0c5fe3f78438bbdfe42eeb7c3b94b [id=6640ef1039bc44dfb8e16f6fdff9e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:21.328094 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 already in progress: creating tablet
W20260505 20:13:21.328311 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 855691b4c37f42bfbfc665bb6a712092 because the tablet was not found. No further retry: Not found: Tablet not found: 855691b4c37f42bfbfc665bb6a712092
I20260505 20:13:21.328439 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c552895eb36e49cfba7ad18ff462dba1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.328523 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 385cafb44791473ab10a8a9cd78a5cb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 385cafb44791473ab10a8a9cd78a5cb7 already in progress: creating tablet
W20260505 20:13:21.328716 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b6cb875a42d4f16904e2d5bf62c1d0d already in progress: creating tablet
I20260505 20:13:21.329310 7916 tablet_service.cc:1511] Processing CreateTablet for tablet c552895eb36e49cfba7ad18ff462dba1 (DEFAULT_TABLE table=default.Table_a3e0c5fe3f78438bbdfe42eeb7c3b94b [id=6640ef1039bc44dfb8e16f6fdff9e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.329710 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c552895eb36e49cfba7ad18ff462dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.327661 8053 tablet_bootstrap.cc:492] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.338501 7635 tablet_service.cc:1511] Processing CreateTablet for tablet edceecc7eee4477a869acce495aade1c (DEFAULT_TABLE table=default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.338964 8053 tablet_bootstrap.cc:654] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.343149 7912 tablet_service.cc:1511] Processing CreateTablet for tablet c1884e1306ae4aac9d599a93775c5d8d (DEFAULT_TABLE table=default.Table_3dab8dc4dc7446dca8a85f6d18cbf18f [id=db04ad55e6964d88bb71e0eab4cc4f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.343600 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1884e1306ae4aac9d599a93775c5d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.348704 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a3e0c5fe3f78438bbdfe42eeb7c3b94b" } new_table_name: "default.Table_ccc54b09fe5c46f2ba83a103140c2ad7" modify_external_catalogs: true
I20260505 20:13:21.348877 8053 log.cc:826] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:21.350929 7781 tablet_service.cc:1511] Processing CreateTablet for tablet c1884e1306ae4aac9d599a93775c5d8d (DEFAULT_TABLE table=default.Table_3dab8dc4dc7446dca8a85f6d18cbf18f [id=db04ad55e6964d88bb71e0eab4cc4f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.351287 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_28bf27795f15436d86fe48e6b98e9af7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.351431 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1884e1306ae4aac9d599a93775c5d8d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.351795 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28bf27795f15436d86fe48e6b98e9af7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.353984 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3db345f608074d92ad2d8263ce27588b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.354528 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3db345f608074d92ad2d8263ce27588b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.354527 8054 raft_consensus.cc:359] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.355013 8054 raft_consensus.cc:385] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.355120 8054 raft_consensus.cc:740] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.357820 8054 consensus_queue.cc:260] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.361431 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edceecc7eee4477a869acce495aade1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.362681 7779 tablet_service.cc:1511] Processing CreateTablet for tablet 43052ededdae41878a6190334d5a965e (DEFAULT_TABLE table=default.Table_fbd5e06b0ee545028e591111a5e9e1a9 [id=74178f7425164618bd69a1653b75e5d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.363113 7779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43052ededdae41878a6190334d5a965e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.363989 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_81ec61790b36437490005ea685dc9b2e" } new_table_name: "default.Table_7f981352ff52482499c0591c39c57146" modify_external_catalogs: true
I20260505 20:13:21.366032 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_668e9f64503947c3a4a2fb730d2b8406" } new_table_name: "default.Table_7aa01cf42bad4323b9ac63a7e130b521" modify_external_catalogs: true
I20260505 20:13:21.365981 7633 tablet_service.cc:1511] Processing CreateTablet for tablet c552895eb36e49cfba7ad18ff462dba1 (DEFAULT_TABLE table=default.Table_a3e0c5fe3f78438bbdfe42eeb7c3b94b [id=6640ef1039bc44dfb8e16f6fdff9e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.367223 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5264083122114789aa5598e2f170c57e" } new_table_name: "default.Table_dbd33bbe5ad9434fab311cf8991dd607" modify_external_catalogs: true
I20260505 20:13:21.367355 7912 tablet_service.cc:1511] Processing CreateTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 (DEFAULT_TABLE table=default.Table_9e1bb2a23514497b9dd3580f1479a03c [id=0a0faede033d4425b6e1389b4e5d9f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.367655 7771 tablet_service.cc:1511] Processing CreateTablet for tablet d7e47c72827941cca40d20725e0100de (DEFAULT_TABLE table=default.Table_2329990d33d941799ae7ae7cbb3c3493 [id=9016406a2de74726b20ec5215d2d94d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.367753 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffa53ec02b34d408f3a8b4f45299c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.368453 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_fbd5e06b0ee545028e591111a5e9e1a9" } new_table_name: "default.Table_3631118e6e7840f49c54aba4c14e07ea" modify_external_catalogs: true
I20260505 20:13:21.368760 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e47c72827941cca40d20725e0100de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.369781 7913 tablet_service.cc:1511] Processing CreateTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 (DEFAULT_TABLE table=default.Table_668e9f64503947c3a4a2fb730d2b8406 [id=885260685ed345f8a157266967b6606f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.370189 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae94d54b26b24d99b0b382fba9f5a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.371351 7634 tablet_service.cc:1511] Processing CreateTablet for tablet c1884e1306ae4aac9d599a93775c5d8d (DEFAULT_TABLE table=default.Table_3dab8dc4dc7446dca8a85f6d18cbf18f [id=db04ad55e6964d88bb71e0eab4cc4f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.374058 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 43052ededdae41878a6190334d5a965e (DEFAULT_TABLE table=default.Table_fbd5e06b0ee545028e591111a5e9e1a9 [id=74178f7425164618bd69a1653b75e5d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.374524 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43052ededdae41878a6190334d5a965e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.377064 7774 tablet_service.cc:1511] Processing CreateTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 (DEFAULT_TABLE table=default.Table_668e9f64503947c3a4a2fb730d2b8406 [id=885260685ed345f8a157266967b6606f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.377529 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae94d54b26b24d99b0b382fba9f5a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.378052 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 (DEFAULT_TABLE table=default.Table_5264083122114789aa5598e2f170c57e [id=e3793cfcbb3b4d21935d71682a3834b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.378427 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f7886e6b054f458f1d0f02f3e555b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.382046 7909 tablet_service.cc:1511] Processing CreateTablet for tablet c187c7931645429b9c89b92b890c8bba (DEFAULT_TABLE table=default.Table_d5b8d6121e234d70939c2432a603ff18 [id=5ba2ee85cb9147399567f608a97458ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.382419 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c187c7931645429b9c89b92b890c8bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.386026 7910 tablet_service.cc:1511] Processing CreateTablet for tablet d7e47c72827941cca40d20725e0100de (DEFAULT_TABLE table=default.Table_2329990d33d941799ae7ae7cbb3c3493 [id=9016406a2de74726b20ec5215d2d94d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.386399 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e47c72827941cca40d20725e0100de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.386819 7780 tablet_service.cc:1511] Processing CreateTablet for tablet c187c7931645429b9c89b92b890c8bba (DEFAULT_TABLE table=default.Table_d5b8d6121e234d70939c2432a603ff18 [id=5ba2ee85cb9147399567f608a97458ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.387247 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c187c7931645429b9c89b92b890c8bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.388095 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2329990d33d941799ae7ae7cbb3c3493" } modify_external_catalogs: true
I20260505 20:13:21.388351 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2329990d33d941799ae7ae7cbb3c3493" } modify_external_catalogs: true
I20260505 20:13:21.389978 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 (DEFAULT_TABLE table=default.Table_5264083122114789aa5598e2f170c57e [id=e3793cfcbb3b4d21935d71682a3834b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.390049 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ee6f5cb164d1435ba5955ac615e2249b" } modify_external_catalogs: true
I20260505 20:13:21.390261 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ee6f5cb164d1435ba5955ac615e2249b" } modify_external_catalogs: true
I20260505 20:13:21.390398 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f7886e6b054f458f1d0f02f3e555b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.390852 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0c18b95b0d9840e387da91812077995a" } modify_external_catalogs: true
I20260505 20:13:21.391058 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0c18b95b0d9840e387da91812077995a" } modify_external_catalogs: true
W20260505 20:13:21.394879 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c552895eb36e49cfba7ad18ff462dba1 consensus state has no leader
I20260505 20:13:21.395450 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_9e1bb2a23514497b9dd3580f1479a03c" } modify_external_catalogs: true
I20260505 20:13:21.395421 7632 tablet_service.cc:1511] Processing CreateTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 (DEFAULT_TABLE table=default.Table_9e1bb2a23514497b9dd3580f1479a03c [id=0a0faede033d4425b6e1389b4e5d9f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.395629 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_9e1bb2a23514497b9dd3580f1479a03c" } modify_external_catalogs: true
I20260505 20:13:21.396318 7781 tablet_service.cc:1511] Processing CreateTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 (DEFAULT_TABLE table=default.Table_9e1bb2a23514497b9dd3580f1479a03c [id=0a0faede033d4425b6e1389b4e5d9f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.396714 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffa53ec02b34d408f3a8b4f45299c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.397185 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d5b8d6121e234d70939c2432a603ff18" } modify_external_catalogs: true
I20260505 20:13:21.397336 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d5b8d6121e234d70939c2432a603ff18" } modify_external_catalogs: true
I20260505 20:13:21.399917 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1884e1306ae4aac9d599a93775c5d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.401284 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffa53ec02b34d408f3a8b4f45299c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.402215 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c552895eb36e49cfba7ad18ff462dba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.414965 7303 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskf21k8s/build/asan/bin/kudu with pid 7451
W20260505 20:13:21.417433 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae94d54b26b24d99b0b382fba9f5a542 consensus state has no leader
I20260505 20:13:21.418058 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet bf0bab3a0fb14e41959f3b96cd47e2ce
W20260505 20:13:21.418864 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42f7886e6b054f458f1d0f02f3e555b0 consensus state has no leader
W20260505 20:13:21.419270 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43052ededdae41878a6190334d5a965e consensus state has no leader
I20260505 20:13:21.419405 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.419696 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet bffa53ec02b34d408f3a8b4f45299c57
I20260505 20:13:21.419929 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet d7e47c72827941cca40d20725e0100de
W20260505 20:13:21.420154 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet bf0bab3a0fb14e41959f3b96cd47e2ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf0bab3a0fb14e41959f3b96cd47e2ce already in progress: creating tablet
I20260505 20:13:21.420969 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:21.421561 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet d7e47c72827941cca40d20725e0100de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7e47c72827941cca40d20725e0100de already in progress: creating tablet
I20260505 20:13:21.421924 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.421965 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c187c7931645429b9c89b92b890c8bba
W20260505 20:13:21.424911 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet bffa53ec02b34d408f3a8b4f45299c57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bffa53ec02b34d408f3a8b4f45299c57 already in progress: creating tablet
I20260505 20:13:21.425091 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:21.425773 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c187c7931645429b9c89b92b890c8bba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c187c7931645429b9c89b92b890c8bba already in progress: creating tablet
I20260505 20:13:21.425876 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:21.426596 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f09c91392ee4b32b16d1638079ac2cb consensus state has no leader
I20260505 20:13:21.419270 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 38bc883c8e98495882e4d8ef68c9da80
W20260505 20:13:21.427474 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c187c7931645429b9c89b92b890c8bba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c187c7931645429b9c89b92b890c8bba already in progress: creating tablet
I20260505 20:13:21.428226 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.428798 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:21.428817 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 38bc883c8e98495882e4d8ef68c9da80 because the tablet was not found. No further retry: Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
W20260505 20:13:21.429493 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 38bc883c8e98495882e4d8ef68c9da80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38bc883c8e98495882e4d8ef68c9da80 already in progress: creating tablet
I20260505 20:13:21.433702 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.433977 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.434224 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:21.435550 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet d7e47c72827941cca40d20725e0100de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7e47c72827941cca40d20725e0100de already in progress: creating tablet
W20260505 20:13:21.435798 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bffa53ec02b34d408f3a8b4f45299c57 because the tablet was not found. No further retry: Not found: Tablet not found: bffa53ec02b34d408f3a8b4f45299c57
W20260505 20:13:21.436017 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bf0bab3a0fb14e41959f3b96cd47e2ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf0bab3a0fb14e41959f3b96cd47e2ce already in progress: creating tablet
I20260505 20:13:21.440064 8054 ts_tablet_manager.cc:1434] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.137s user 0.013s sys 0.000s
I20260505 20:13:21.441901 7983 heartbeater.cc:499] Master 127.7.33.254:38755 was elected leader, sending a full tablet report...
I20260505 20:13:21.443460 8054 tablet_bootstrap.cc:492] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.447228 8054 tablet_bootstrap.cc:654] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.450395 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc05b2d65594e16abee960ad3c7721a (DEFAULT_TABLE table=default.Table_28bf27795f15436d86fe48e6b98e9af7 [id=cf0b5ed94ed2455a9251be84a2ef204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.450910 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc05b2d65594e16abee960ad3c7721a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.451248 7335 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_59a52d4430a24ca587595b26e0d3cefe [id=680c74a223d54940afd6e814558bf4ae]). Expected version 1 got 0
I20260505 20:13:21.451587 7335 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8f09c91392ee4b32b16d1638079ac2cb (table default.Table_7f981352ff52482499c0591c39c57146 [id=0e17662146d24eaeaa66105b3590b725]). Expected version 2 got 0
I20260505 20:13:21.451797 7335 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43052ededdae41878a6190334d5a965e (table default.Table_3631118e6e7840f49c54aba4c14e07ea [id=74178f7425164618bd69a1653b75e5d1]). Expected version 1 got 0
I20260505 20:13:21.451985 7335 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 42f7886e6b054f458f1d0f02f3e555b0 (table default.Table_dbd33bbe5ad9434fab311cf8991dd607 [id=e3793cfcbb3b4d21935d71682a3834b8]). Expected version 1 got 0
I20260505 20:13:21.452149 7335 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ae94d54b26b24d99b0b382fba9f5a542 (table default.Table_7aa01cf42bad4323b9ac63a7e130b521 [id=885260685ed345f8a157266967b6606f]). Expected version 1 got 0
I20260505 20:13:21.453377 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc05b2d65594e16abee960ad3c7721a (DEFAULT_TABLE table=default.Table_28bf27795f15436d86fe48e6b98e9af7 [id=cf0b5ed94ed2455a9251be84a2ef204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.453944 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc05b2d65594e16abee960ad3c7721a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.470898 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:21.471905 7985 tablet.cc:2404] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:21.472591 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet bffa53ec02b34d408f3a8b4f45299c57 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.474067 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet edceecc7eee4477a869acce495aade1c from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.475462 7775 tablet_service.cc:1511] Processing CreateTablet for tablet be214aeb495244a6b58f761c01b7faa5 (DEFAULT_TABLE table=default.Table_3db345f608074d92ad2d8263ce27588b [id=bec691f68e1c4e6bbfd4986e6dbbb36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.475952 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be214aeb495244a6b58f761c01b7faa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.476482 8054 tablet_bootstrap.cc:492] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.481735 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet c552895eb36e49cfba7ad18ff462dba1 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.484504 8053 tablet_bootstrap.cc:492] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.484859 8053 ts_tablet_manager.cc:1403] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.158s user 0.016s sys 0.029s
I20260505 20:13:21.486821 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet edceecc7eee4477a869acce495aade1c
I20260505 20:13:21.487546 7338 catalog_manager.cc:6741] ReplaceTablet: tablet edceecc7eee4477a869acce495aade1c deleted and replaced by tablet de9b7c48be9042a19958c09941c2e429
I20260505 20:13:21.487558 8054 ts_tablet_manager.cc:1403] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260505 20:13:21.487862 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet edceecc7eee4477a869acce495aade1c with delete_type TABLET_DATA_DELETED (replaced by tablet de9b7c48be9042a19958c09941c2e429) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.488473 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet edceecc7eee4477a869acce495aade1c with delete_type TABLET_DATA_DELETED (replaced by tablet de9b7c48be9042a19958c09941c2e429) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.488992 8054 raft_consensus.cc:359] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:21.489193 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet edceecc7eee4477a869acce495aade1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edceecc7eee4477a869acce495aade1c already in progress: creating tablet
I20260505 20:13:21.489260 8054 raft_consensus.cc:385] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.489447 8054 raft_consensus.cc:740] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:21.489614 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet edceecc7eee4477a869acce495aade1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edceecc7eee4477a869acce495aade1c already in progress: creating tablet
I20260505 20:13:21.489832 8054 consensus_queue.cc:260] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.490506 8054 ts_tablet_manager.cc:1434] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:21.491436 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet edceecc7eee4477a869acce495aade1c from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.491691 8054 tablet_bootstrap.cc:492] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.493137 8053 raft_consensus.cc:359] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.493590 8053 raft_consensus.cc:385] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.493718 8053 raft_consensus.cc:740] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.494127 8054 tablet_bootstrap.cc:654] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:21.496073 7738 connection.cc:582] client connection to 127.7.33.252:42521 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:21.496462 7872 connection.cc:582] client connection to 127.7.33.252:42521 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:21.496764 7847 heartbeater.cc:646] Failed to heartbeat to 127.7.33.252:42521 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:21.497151 7982 heartbeater.cc:646] Failed to heartbeat to 127.7.33.252:42521 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260505 20:13:21.498808 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c552895eb36e49cfba7ad18ff462dba1
I20260505 20:13:21.499302 7339 catalog_manager.cc:6741] ReplaceTablet: tablet c552895eb36e49cfba7ad18ff462dba1 deleted and replaced by tablet 9146142e112e43a7a6ce0369122d5a46
I20260505 20:13:21.499657 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet c552895eb36e49cfba7ad18ff462dba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9146142e112e43a7a6ce0369122d5a46) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.500197 8054 tablet_bootstrap.cc:492] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
W20260505 20:13:21.500315 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c552895eb36e49cfba7ad18ff462dba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c552895eb36e49cfba7ad18ff462dba1 already in progress: creating tablet
I20260505 20:13:21.500427 8054 ts_tablet_manager.cc:1403] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260505 20:13:21.500996 8054 raft_consensus.cc:359] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.501192 8054 raft_consensus.cc:385] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.501307 8054 raft_consensus.cc:740] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.501582 8054 consensus_queue.cc:260] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.502101 8054 ts_tablet_manager.cc:1434] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:21.503582 8054 tablet_bootstrap.cc:492] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.505052 8053 consensus_queue.cc:260] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.506489 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_87d54561ed754d9b83ec983b110c6899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.506991 8054 tablet_bootstrap.cc:654] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:21.507300 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87d54561ed754d9b83ec983b110c6899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.513949 8053 ts_tablet_manager.cc:1434] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.029s user 0.013s sys 0.007s
I20260505 20:13:21.515336 7639 tablet_service.cc:1511] Processing CreateTablet for tablet d7e47c72827941cca40d20725e0100de (DEFAULT_TABLE table=default.Table_2329990d33d941799ae7ae7cbb3c3493 [id=9016406a2de74726b20ec5215d2d94d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.515878 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e47c72827941cca40d20725e0100de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.523680 8053 tablet_bootstrap.cc:492] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.525775 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 43052ededdae41878a6190334d5a965e (DEFAULT_TABLE table=default.Table_fbd5e06b0ee545028e591111a5e9e1a9 [id=74178f7425164618bd69a1653b75e5d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.526924 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43052ededdae41878a6190334d5a965e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.528540 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3fe7759921d94264b2db628ddfdd199c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.529277 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fe7759921d94264b2db628ddfdd199c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.532256 7637 tablet_service.cc:1511] Processing CreateTablet for tablet c187c7931645429b9c89b92b890c8bba (DEFAULT_TABLE table=default.Table_d5b8d6121e234d70939c2432a603ff18 [id=5ba2ee85cb9147399567f608a97458ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.532796 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c187c7931645429b9c89b92b890c8bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.535334 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.535979 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_50fe331fc2b042a59cbe8680d748f55d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.536736 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50fe331fc2b042a59cbe8680d748f55d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.536746 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.537007 8053 tablet_bootstrap.cc:654] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.538748 8058 tablet_bootstrap.cc:492] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:21.540984 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.536257 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 (DEFAULT_TABLE table=default.Table_5264083122114789aa5598e2f170c57e [id=e3793cfcbb3b4d21935d71682a3834b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.541481 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_baef00c4f9f1479fb9d61dfb47506804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.542181 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baef00c4f9f1479fb9d61dfb47506804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.542249 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.542621 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_206e9638b58b41f892b4b9f29c7b7e3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.543174 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_206e9638b58b41f892b4b9f29c7b7e3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.545511 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7f774c4256454a39904f5517cbcd9d9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.546092 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f774c4256454a39904f5517cbcd9d9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.546475 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8f5799bc8b2b4f39b309936338cbe0fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.546993 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f5799bc8b2b4f39b309936338cbe0fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.547551 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6d0efc4c31774452a20d42a0135965e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.548103 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d0efc4c31774452a20d42a0135965e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.550132 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc05b2d65594e16abee960ad3c7721a (DEFAULT_TABLE table=default.Table_28bf27795f15436d86fe48e6b98e9af7 [id=cf0b5ed94ed2455a9251be84a2ef204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.552970 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.554215 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f7886e6b054f458f1d0f02f3e555b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.552855 7635 tablet_service.cc:1511] Processing CreateTablet for tablet be214aeb495244a6b58f761c01b7faa5 (DEFAULT_TABLE table=default.Table_3db345f608074d92ad2d8263ce27588b [id=bec691f68e1c4e6bbfd4986e6dbbb36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.555680 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be214aeb495244a6b58f761c01b7faa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.559592 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet edceecc7eee4477a869acce495aade1c with delete_type TABLET_DATA_DELETED (replaced by tablet de9b7c48be9042a19958c09941c2e429) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:21.561836 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 already in progress: creating tablet
W20260505 20:13:21.562201 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 385cafb44791473ab10a8a9cd78a5cb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 385cafb44791473ab10a8a9cd78a5cb7 already in progress: creating tablet
I20260505 20:13:21.560487 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet c552895eb36e49cfba7ad18ff462dba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9146142e112e43a7a6ce0369122d5a46) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:21.567059 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d because the tablet was not found. No further retry: Not found: Tablet not found: 8b6cb875a42d4f16904e2d5bf62c1d0d
W20260505 20:13:21.567440 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 855691b4c37f42bfbfc665bb6a712092 because the tablet was not found. No further retry: Not found: Tablet not found: 855691b4c37f42bfbfc665bb6a712092
W20260505 20:13:21.567663 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet bffa53ec02b34d408f3a8b4f45299c57 because the tablet was not found. No further retry: Not found: Tablet not found: bffa53ec02b34d408f3a8b4f45299c57
W20260505 20:13:21.567880 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet bf0bab3a0fb14e41959f3b96cd47e2ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf0bab3a0fb14e41959f3b96cd47e2ce already in progress: creating tablet
W20260505 20:13:21.568559 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet c187c7931645429b9c89b92b890c8bba because the tablet was not found. No further retry: Not found: Tablet not found: c187c7931645429b9c89b92b890c8bba
W20260505 20:13:21.568917 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet d7e47c72827941cca40d20725e0100de because the tablet was not found. No further retry: Not found: Tablet not found: d7e47c72827941cca40d20725e0100de
I20260505 20:13:21.569170 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc05b2d65594e16abee960ad3c7721a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.575960 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 38bc883c8e98495882e4d8ef68c9da80 because the tablet was not found. No further retry: Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
W20260505 20:13:21.577016 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet edceecc7eee4477a869acce495aade1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edceecc7eee4477a869acce495aade1c already in progress: creating tablet
W20260505 20:13:21.579535 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet c552895eb36e49cfba7ad18ff462dba1 because the tablet was not found. No further retry: Not found: Tablet not found: c552895eb36e49cfba7ad18ff462dba1
I20260505 20:13:21.593400 8058 tablet_bootstrap.cc:654] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.595466 8058 log.cc:826] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:21.641870 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b6a4eac6e65d4294b1b4173a96b48c1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.642644 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6a4eac6e65d4294b1b4173a96b48c1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.648386 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.648895 8052 tablet_replica.cc:333] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:21.649529 8052 raft_consensus.cc:2243] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.650074 8052 raft_consensus.cc:2272] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.652436 8052 ts_tablet_manager.cc:1916] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.657927 8053 tablet_bootstrap.cc:492] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.658078 8053 ts_tablet_manager.cc:1403] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.135s user 0.022s sys 0.059s
I20260505 20:13:21.658090 8054 tablet_bootstrap.cc:492] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.658248 8054 ts_tablet_manager.cc:1403] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.155s user 0.059s sys 0.088s
I20260505 20:13:21.659057 8053 raft_consensus.cc:359] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.659293 8053 raft_consensus.cc:385] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.659192 8054 raft_consensus.cc:359] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.659389 8054 raft_consensus.cc:385] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.659390 8053 raft_consensus.cc:740] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.659482 8054 raft_consensus.cc:740] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.659662 8053 consensus_queue.cc:260] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.659704 8054 consensus_queue.cc:260] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.662688 8054 ts_tablet_manager.cc:1434] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:21.663344 8053 ts_tablet_manager.cc:1434] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:21.664346 8054 tablet_bootstrap.cc:492] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.666740 8053 tablet_bootstrap.cc:492] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.666908 8054 tablet_bootstrap.cc:654] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.667847 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3631118e6e7840f49c54aba4c14e07ea" } new_table_name: "default.Table_69ed4f92674c49b291ba8561c5117bfb" modify_external_catalogs: true
I20260505 20:13:21.668421 8053 tablet_bootstrap.cc:654] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.676554 8053 tablet_bootstrap.cc:492] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.676745 8053 ts_tablet_manager.cc:1403] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260505 20:13:21.677688 8053 raft_consensus.cc:359] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.677950 8053 raft_consensus.cc:385] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.678045 8053 raft_consensus.cc:740] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.678330 8053 consensus_queue.cc:260] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.681433 8052 ts_tablet_manager.cc:1929] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.683722 7642 tablet_service.cc:1511] Processing CreateTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 (DEFAULT_TABLE table=default.Table_668e9f64503947c3a4a2fb730d2b8406 [id=885260685ed345f8a157266967b6606f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.684309 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae94d54b26b24d99b0b382fba9f5a542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.686501 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_dbd33bbe5ad9434fab311cf8991dd607" } modify_external_catalogs: true
I20260505 20:13:21.686547 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ccc54b09fe5c46f2ba83a103140c2ad7" } modify_external_catalogs: true
I20260505 20:13:21.686705 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_dbd33bbe5ad9434fab311cf8991dd607" } modify_external_catalogs: true
I20260505 20:13:21.686741 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ccc54b09fe5c46f2ba83a103140c2ad7" } modify_external_catalogs: true
I20260505 20:13:21.687464 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7aa01cf42bad4323b9ac63a7e130b521" } modify_external_catalogs: true
I20260505 20:13:21.687654 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7aa01cf42bad4323b9ac63a7e130b521" } modify_external_catalogs: true
I20260505 20:13:21.688347 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_ce9ec72e24eb4a94888f70a816c84df0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.688938 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce9ec72e24eb4a94888f70a816c84df0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.690227 8054 tablet_bootstrap.cc:492] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.690404 8054 ts_tablet_manager.cc:1403] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.004s
I20260505 20:13:21.690412 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_59a52d4430a24ca587595b26e0d3cefe" } new_table_name: "default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd" modify_external_catalogs: true
I20260505 20:13:21.691190 8054 raft_consensus.cc:359] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.691417 8054 raft_consensus.cc:385] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.691488 8054 raft_consensus.cc:740] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:21.691668 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43052ededdae41878a6190334d5a965e consensus state has no leader
I20260505 20:13:21.691802 8054 consensus_queue.cc:260] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.692014 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_28bf27795f15436d86fe48e6b98e9af7" } new_table_name: "default.Table_c738b338e02745d989d767b3cf2954a8" modify_external_catalogs: true
I20260505 20:13:21.693368 8054 ts_tablet_manager.cc:1434] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:21.693709 8054 tablet_bootstrap.cc:492] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.695241 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3dab8dc4dc7446dca8a85f6d18cbf18f" } new_table_name: "default.Table_6507c22f6b464474a97953cee8978d22" modify_external_catalogs: true
W20260505 20:13:21.697023 7709 heartbeater.cc:646] Failed to heartbeat to 127.7.33.252:42521 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111)
I20260505 20:13:21.697405 8054 tablet_bootstrap.cc:654] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:21.700014 8062 negotiation.cc:336] Failed RPC negotiation. Trace:
0505 20:13:21.497685 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.7.33.252:42521 (local address 127.7.33.195:46549)
0505 20:13:21.698089 (+200404us) negotiation.cc:107] Waiting for socket to connect
0505 20:13:21.698223 (+ 134us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":200244,"threads_started":1}
I20260505 20:13:21.701038 8057 raft_consensus.cc:493] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:21.701278 8057 raft_consensus.cc:515] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.701553 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet c552895eb36e49cfba7ad18ff462dba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9146142e112e43a7a6ce0369122d5a46) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.702068 7916 tablet_service.cc:1511] Processing CreateTablet for tablet be214aeb495244a6b58f761c01b7faa5 (DEFAULT_TABLE table=default.Table_3db345f608074d92ad2d8263ce27588b [id=bec691f68e1c4e6bbfd4986e6dbbb36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.702533 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be214aeb495244a6b58f761c01b7faa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.702479 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.703508 8057 leader_election.cc:290] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:21.706524 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.707631 8058 tablet_bootstrap.cc:492] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:21.708025 8058 ts_tablet_manager.cc:1403] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.190s user 0.013s sys 0.000s
I20260505 20:13:21.709965 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:21.712483 7329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.252:42521, user_credentials={real_user=slave}} blocked reactor thread for 212549us
I20260505 20:13:21.713059 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:21.714417 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c552895eb36e49cfba7ad18ff462dba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c552895eb36e49cfba7ad18ff462dba1 already in progress: creating tablet
W20260505 20:13:21.715119 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet d7e47c72827941cca40d20725e0100de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7e47c72827941cca40d20725e0100de already in progress: creating tablet
I20260505 20:13:21.717442 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7f981352ff52482499c0591c39c57146" } modify_external_catalogs: true
I20260505 20:13:21.717643 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7f981352ff52482499c0591c39c57146" } modify_external_catalogs: true
I20260505 20:13:21.713614 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.720479 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.720782 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.721005 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.721155 8050 tablet_replica.cc:333] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:21.721782 8050 raft_consensus.cc:2243] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.722257 8050 raft_consensus.cc:2272] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.682017 8053 ts_tablet_manager.cc:1434] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260505 20:13:21.723632 8052 log.cc:1199] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8b6cb875a42d4f16904e2d5bf62c1d0d
I20260505 20:13:21.723924 8053 tablet_bootstrap.cc:492] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.724004 8050 ts_tablet_manager.cc:1916] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:21.720602 7850 tablet.cc:2404] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:21.726209 8053 tablet_bootstrap.cc:654] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.728763 8052 ts_tablet_manager.cc:1950] T 8b6cb875a42d4f16904e2d5bf62c1d0d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:21.731060 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 8b6cb875a42d4f16904e2d5bf62c1d0d (table default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 [id=3d33e35a14b9400593605d46763f73c2]) successfully deleted
I20260505 20:13:21.740206 8058 raft_consensus.cc:359] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.740705 8058 raft_consensus.cc:385] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.740824 8058 raft_consensus.cc:740] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.741439 8050 ts_tablet_manager.cc:1929] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.742333 8053 tablet_bootstrap.cc:492] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.742493 8053 ts_tablet_manager.cc:1403] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.000s
I20260505 20:13:21.743418 8053 raft_consensus.cc:359] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.743635 8053 raft_consensus.cc:385] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.743729 8053 raft_consensus.cc:740] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.743964 8053 consensus_queue.cc:260] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.744599 8053 ts_tablet_manager.cc:1434] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:21.744900 8053 tablet_bootstrap.cc:492] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.746327 8058 consensus_queue.cc:260] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.747706 8053 tablet_bootstrap.cc:654] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.748823 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f09c91392ee4b32b16d1638079ac2cb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:21.751641 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f09c91392ee4b32b16d1638079ac2cb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:21.750048 7870 leader_election.cc:343] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:21.751647 8054 tablet_bootstrap.cc:492] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.752072 8054 ts_tablet_manager.cc:1403] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.058s user 0.010s sys 0.008s
I20260505 20:13:21.752110 7802 raft_consensus.cc:2468] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:21.752748 8064 raft_consensus.cc:493] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:21.752875 7869 leader_election.cc:304] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:21.752954 8054 raft_consensus.cc:359] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.752918 8064 raft_consensus.cc:515] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.753139 8054 raft_consensus.cc:385] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.753229 8054 raft_consensus.cc:740] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.753434 8054 consensus_queue.cc:260] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.753588 8057 raft_consensus.cc:2804] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:21.753715 8057 raft_consensus.cc:493] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:21.753846 8057 raft_consensus.cc:3060] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:21.755007 8064 leader_election.cc:290] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:21.755183 8058 ts_tablet_manager.cc:1434] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.047s user 0.009s sys 0.004s
I20260505 20:13:21.756464 8058 tablet_bootstrap.cc:492] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:21.756806 8057 raft_consensus.cc:515] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.758112 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f09c91392ee4b32b16d1638079ac2cb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:21.758709 7870 leader_election.cc:343] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:21.758845 8058 tablet_bootstrap.cc:654] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.759117 8057 leader_election.cc:290] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:21.753865 8050 log.cc:1199] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:21.762784 8050 ts_tablet_manager.cc:1950] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:21.765484 8050 tablet_replica.cc:333] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:21.765645 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 (table default.Table_fc24f10488ab4376963f7a0c9bc31733 [id=6d220472d20c42b6844c2185e1dbc9d0]) successfully deleted
I20260505 20:13:21.775384 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af8c7fa9554353a61594c4e426ef2f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:21.776254 7736 leader_election.cc:343] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:21.779091 7329 consensus_peers.cc:597] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 -> Peer 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521): Couldn't send request to peer 29603775b6d74153b21e0bbcc535ff98. Status: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:21.784163 8050 raft_consensus.cc:2243] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.784545 8050 raft_consensus.cc:2272] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.785367 8053 tablet_bootstrap.cc:492] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.785557 8053 ts_tablet_manager.cc:1403] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260505 20:13:21.785804 8050 ts_tablet_manager.cc:1916] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.786437 8053 raft_consensus.cc:359] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.786649 8053 raft_consensus.cc:385] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.786746 8053 raft_consensus.cc:740] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.787005 8053 consensus_queue.cc:260] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.787497 8053 ts_tablet_manager.cc:1434] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:21.787860 8053 tablet_bootstrap.cc:492] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.789661 8053 tablet_bootstrap.cc:654] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.790162 8058 tablet_bootstrap.cc:492] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:21.790373 8058 ts_tablet_manager.cc:1403] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.023s
I20260505 20:13:21.791451 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3db345f608074d92ad2d8263ce27588b" } new_table_name: "default.Table_ee151aa3a641443babaff433f49444e7" modify_external_catalogs: true
I20260505 20:13:21.791446 8058 raft_consensus.cc:359] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.791764 8058 raft_consensus.cc:385] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.791891 8058 raft_consensus.cc:740] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.792161 8058 consensus_queue.cc:260] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.792666 8050 ts_tablet_manager.cc:1929] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.792762 8058 ts_tablet_manager.cc:1434] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:21.793110 8058 tablet_bootstrap.cc:492] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:21.793150 7339 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8f09c91392ee4b32b16d1638079ac2cb (table default.Table_7f981352ff52482499c0591c39c57146 [id=0e17662146d24eaeaa66105b3590b725]). Expected version 2 got 0
I20260505 20:13:21.793421 7339 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_59a52d4430a24ca587595b26e0d3cefe [id=680c74a223d54940afd6e814558bf4ae]). Expected version 1 got 0
I20260505 20:13:21.796017 8058 tablet_bootstrap.cc:654] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.795993 7338 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_59a52d4430a24ca587595b26e0d3cefe [id=680c74a223d54940afd6e814558bf4ae]). Expected version 1 got 0
I20260505 20:13:21.800830 8050 log.cc:1199] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/bf0bab3a0fb14e41959f3b96cd47e2ce
I20260505 20:13:21.801656 8050 ts_tablet_manager.cc:1950] T bf0bab3a0fb14e41959f3b96cd47e2ce P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:21.802548 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 9146142e112e43a7a6ce0369122d5a46 (DEFAULT_TABLE table=default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.804082 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9146142e112e43a7a6ce0369122d5a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.804579 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 9146142e112e43a7a6ce0369122d5a46 (DEFAULT_TABLE table=default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.804955 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9146142e112e43a7a6ce0369122d5a46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.806519 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5fc05b2d65594e16abee960ad3c7721a consensus state has no leader
I20260505 20:13:21.803071 7912 tablet_service.cc:1511] Processing CreateTablet for tablet de9b7c48be9042a19958c09941c2e429 (DEFAULT_TABLE table=default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.808735 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9b7c48be9042a19958c09941c2e429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.809424 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a44e5fe432f54a4585b4357ff357b81f" } modify_external_catalogs: true
I20260505 20:13:21.809623 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a44e5fe432f54a4585b4357ff357b81f" } modify_external_catalogs: true
I20260505 20:13:21.810329 7636 tablet_service.cc:1511] Processing CreateTablet for tablet de9b7c48be9042a19958c09941c2e429 (DEFAULT_TABLE table=default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.810684 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9b7c48be9042a19958c09941c2e429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.811662 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.812456 7778 tablet_service.cc:1511] Processing CreateTablet for tablet de9b7c48be9042a19958c09941c2e429 (DEFAULT_TABLE table=default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.812860 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de9b7c48be9042a19958c09941c2e429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.814114 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f09c91392ee4b32b16d1638079ac2cb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:21.814314 7802 raft_consensus.cc:3060] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:21.819342 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.819630 8051 tablet_replica.cc:333] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:21.820139 8051 raft_consensus.cc:2243] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.820554 8051 raft_consensus.cc:2272] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.822069 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 9146142e112e43a7a6ce0369122d5a46 (DEFAULT_TABLE table=default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.822161 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af8c7fa9554353a61594c4e426ef2f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:21.822527 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9146142e112e43a7a6ce0369122d5a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.822540 7937 raft_consensus.cc:2468] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:21.823413 8051 ts_tablet_manager.cc:1916] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.829260 8053 tablet_bootstrap.cc:492] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.829473 8053 ts_tablet_manager.cc:1403] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.007s
I20260505 20:13:21.830708 8051 ts_tablet_manager.cc:1929] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.830618 7737 leader_election.cc:304] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:21.830870 8051 log.cc:1199] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:21.831266 8064 raft_consensus.cc:2804] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:21.831313 8051 ts_tablet_manager.cc:1950] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:21.831423 8064 raft_consensus.cc:493] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:21.831539 8064 raft_consensus.cc:3060] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:21.832262 7802 raft_consensus.cc:2468] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:21.833181 8051 tablet_replica.cc:333] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:21.833367 8051 raft_consensus.cc:2243] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.833539 8051 raft_consensus.cc:2272] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.834640 8053 raft_consensus.cc:359] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.834889 8064 raft_consensus.cc:515] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.836030 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 (table default.Table_fc24f10488ab4376963f7a0c9bc31733 [id=6d220472d20c42b6844c2185e1dbc9d0]) successfully deleted
I20260505 20:13:21.836546 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af8c7fa9554353a61594c4e426ef2f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:21.837071 7736 leader_election.cc:343] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:21.837134 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet 8f09c91392ee4b32b16d1638079ac2cb from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.837353 8064 leader_election.cc:290] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:21.837535 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8af8c7fa9554353a61594c4e426ef2f consensus state has no leader
I20260505 20:13:21.838155 7869 leader_election.cc:304] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:21.838855 8081 raft_consensus.cc:2804] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:21.838928 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1884e1306ae4aac9d599a93775c5d8d consensus state has no leader
I20260505 20:13:21.839206 7333 master_service.cc:954] ReplaceTablet: received request to replace tablet be214aeb495244a6b58f761c01b7faa5 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.839428 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8af8c7fa9554353a61594c4e426ef2f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:21.839586 8081 raft_consensus.cc:697] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:21.839622 7937 raft_consensus.cc:3060] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:21.840471 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet edceecc7eee4477a869acce495aade1c from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.842134 7937 raft_consensus.cc:2468] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:21.842850 8081 consensus_queue.cc:237] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.844269 7737 leader_election.cc:304] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:21.844705 8064 raft_consensus.cc:2804] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:21.850122 8051 ts_tablet_manager.cc:1916] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.853669 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 9146142e112e43a7a6ce0369122d5a46
I20260505 20:13:21.854521 8054 ts_tablet_manager.cc:1434] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.102s user 0.003s sys 0.003s
I20260505 20:13:21.855089 8054 tablet_bootstrap.cc:492] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.855495 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet ae94d54b26b24d99b0b382fba9f5a542
I20260505 20:13:21.856115 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 5fc05b2d65594e16abee960ad3c7721a from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.857017 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.857074 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet edceecc7eee4477a869acce495aade1c from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:21.857254 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 9146142e112e43a7a6ce0369122d5a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.858055 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.854017 8064 raft_consensus.cc:697] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
W20260505 20:13:21.858903 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet ae94d54b26b24d99b0b382fba9f5a542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae94d54b26b24d99b0b382fba9f5a542 already in progress: creating tablet
W20260505 20:13:21.859115 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be214aeb495244a6b58f761c01b7faa5 consensus state has no leader
I20260505 20:13:21.859257 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.859511 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 9146142e112e43a7a6ce0369122d5a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.859787 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 9146142e112e43a7a6ce0369122d5a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.859635 8064 consensus_queue.cc:237] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:21.860496 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 9146142e112e43a7a6ce0369122d5a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9146142e112e43a7a6ce0369122d5a46 already in progress: creating tablet
I20260505 20:13:21.861413 8054 tablet_bootstrap.cc:654] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.864048 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet bf0bab3a0fb14e41959f3b96cd47e2ce (table default.Table_0c18b95b0d9840e387da91812077995a [id=0a78e2ddc7f14316960db11d6dc289c9]) successfully deleted
W20260505 20:13:21.864321 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 38bc883c8e98495882e4d8ef68c9da80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38bc883c8e98495882e4d8ef68c9da80 already in progress: creating tablet
W20260505 20:13:21.864563 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 855691b4c37f42bfbfc665bb6a712092 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 855691b4c37f42bfbfc665bb6a712092 already in progress: creating tablet
I20260505 20:13:21.864750 8050 tablet_replica.cc:333] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
W20260505 20:13:21.864774 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b6cb875a42d4f16904e2d5bf62c1d0d already in progress: creating tablet
I20260505 20:13:21.864938 8050 raft_consensus.cc:2243] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:21.865005 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c187c7931645429b9c89b92b890c8bba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c187c7931645429b9c89b92b890c8bba already in progress: creating tablet
I20260505 20:13:21.865139 8050 raft_consensus.cc:2272] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.834887 8053 raft_consensus.cc:385] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.868858 8053 raft_consensus.cc:740] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.869318 8050 ts_tablet_manager.cc:1916] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.869226 8053 consensus_queue.cc:260] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.870012 8053 ts_tablet_manager.cc:1434] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.040s user 0.003s sys 0.000s
I20260505 20:13:21.870404 8053 tablet_bootstrap.cc:492] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.870785 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet de9b7c48be9042a19958c09941c2e429
I20260505 20:13:21.871961 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet be214aeb495244a6b58f761c01b7faa5
I20260505 20:13:21.872044 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet de9b7c48be9042a19958c09941c2e429 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.872450 7333 catalog_manager.cc:6741] ReplaceTablet: tablet be214aeb495244a6b58f761c01b7faa5 deleted and replaced by tablet 02eafc72ff7d4055b424322e01dc0c84
I20260505 20:13:21.874308 8053 tablet_bootstrap.cc:654] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:21.878676 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet de9b7c48be9042a19958c09941c2e429 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de9b7c48be9042a19958c09941c2e429 already in progress: creating tablet
I20260505 20:13:21.879238 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet be214aeb495244a6b58f761c01b7faa5 with delete_type TABLET_DATA_DELETED (replaced by tablet 02eafc72ff7d4055b424322e01dc0c84) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.880002 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet de9b7c48be9042a19958c09941c2e429 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.880023 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_ee9c40896ce845dd9843cecf2a713762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.880265 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet be214aeb495244a6b58f761c01b7faa5 with delete_type TABLET_DATA_DELETED (replaced by tablet 02eafc72ff7d4055b424322e01dc0c84) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:21.880502 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet be214aeb495244a6b58f761c01b7faa5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be214aeb495244a6b58f761c01b7faa5 already in progress: creating tablet
W20260505 20:13:21.880666 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee9c40896ce845dd9843cecf2a713762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.881043 8051 ts_tablet_manager.cc:1929] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.881204 8051 log.cc:1199] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/bf0bab3a0fb14e41959f3b96cd47e2ce
I20260505 20:13:21.881687 8051 ts_tablet_manager.cc:1950] T bf0bab3a0fb14e41959f3b96cd47e2ce P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:21.883065 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet bf0bab3a0fb14e41959f3b96cd47e2ce (table default.Table_0c18b95b0d9840e387da91812077995a [id=0a78e2ddc7f14316960db11d6dc289c9]) successfully deleted
W20260505 20:13:21.883498 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet ae94d54b26b24d99b0b382fba9f5a542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae94d54b26b24d99b0b382fba9f5a542 already in progress: creating tablet
W20260505 20:13:21.883739 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 9146142e112e43a7a6ce0369122d5a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9146142e112e43a7a6ce0369122d5a46 already in progress: creating tablet
I20260505 20:13:21.883821 8053 tablet_bootstrap.cc:492] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.884119 8053 ts_tablet_manager.cc:1403] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
W20260505 20:13:21.884369 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet de9b7c48be9042a19958c09941c2e429 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de9b7c48be9042a19958c09941c2e429 already in progress: creating tablet
W20260505 20:13:21.884650 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet be214aeb495244a6b58f761c01b7faa5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be214aeb495244a6b58f761c01b7faa5 already in progress: creating tablet
I20260505 20:13:21.884882 8053 raft_consensus.cc:359] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.885052 8053 raft_consensus.cc:385] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.885146 8053 raft_consensus.cc:740] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.885445 8053 consensus_queue.cc:260] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.886062 8053 ts_tablet_manager.cc:1434] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:21.887403 8053 tablet_bootstrap.cc:492] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.888617 8058 tablet_bootstrap.cc:492] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:21.889021 8058 ts_tablet_manager.cc:1403] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.015s
I20260505 20:13:21.889374 8053 tablet_bootstrap.cc:654] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.890116 8058 raft_consensus.cc:359] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.890511 8058 raft_consensus.cc:385] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.890724 8058 raft_consensus.cc:740] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.890985 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet de9b7c48be9042a19958c09941c2e429 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.891036 8058 consensus_queue.cc:260] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.891671 8058 ts_tablet_manager.cc:1434] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:21.892032 8058 tablet_bootstrap.cc:492] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:21.893461 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet be214aeb495244a6b58f761c01b7faa5 with delete_type TABLET_DATA_DELETED (replaced by tablet 02eafc72ff7d4055b424322e01dc0c84) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.893814 8058 tablet_bootstrap.cc:654] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.895210 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet edceecc7eee4477a869acce495aade1c with delete_type TABLET_DATA_DELETED (replaced by tablet de9b7c48be9042a19958c09941c2e429) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:21.895537 8051 tablet_replica.cc:333] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:21.895777 8051 raft_consensus.cc:2243] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.896163 8051 raft_consensus.cc:2272] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.897460 8053 tablet_bootstrap.cc:492] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.897626 8053 ts_tablet_manager.cc:1403] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260505 20:13:21.898520 8053 raft_consensus.cc:359] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.898700 8053 raft_consensus.cc:385] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.898780 8053 raft_consensus.cc:740] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.899006 8053 consensus_queue.cc:260] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.899222 8051 ts_tablet_manager.cc:1916] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.899497 8053 ts_tablet_manager.cc:1434] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:21.899833 8053 tablet_bootstrap.cc:492] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.901170 8050 ts_tablet_manager.cc:1929] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.901659 8053 tablet_bootstrap.cc:654] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.901878 8050 log.cc:1199] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/385cafb44791473ab10a8a9cd78a5cb7
I20260505 20:13:21.902400 8050 ts_tablet_manager.cc:1950] T 385cafb44791473ab10a8a9cd78a5cb7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:21.902935 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_0f93d0177af14c798f5bc3df1c317875"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.903409 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2ab91975ab364881980fbe5ec6b592f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.903491 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_53975b00e0754d1690d32fa9b48b41d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.903666 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f93d0177af14c798f5bc3df1c317875 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.903954 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ab91975ab364881980fbe5ec6b592f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:21.904021 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53975b00e0754d1690d32fa9b48b41d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.907097 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 385cafb44791473ab10a8a9cd78a5cb7 (table default.Table_1ca4e07ca11647aea3925a39580491bf [id=18ef752a3c414e21848ef8ea109d9053]) successfully deleted
W20260505 20:13:21.907438 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet ae94d54b26b24d99b0b382fba9f5a542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae94d54b26b24d99b0b382fba9f5a542 already in progress: creating tablet
W20260505 20:13:21.907681 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 9146142e112e43a7a6ce0369122d5a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9146142e112e43a7a6ce0369122d5a46 already in progress: creating tablet
W20260505 20:13:21.907922 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet de9b7c48be9042a19958c09941c2e429 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de9b7c48be9042a19958c09941c2e429 already in progress: creating tablet
W20260505 20:13:21.908133 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet be214aeb495244a6b58f761c01b7faa5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be214aeb495244a6b58f761c01b7faa5 already in progress: creating tablet
I20260505 20:13:21.908488 8054 tablet_bootstrap.cc:492] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.908571 8053 tablet_bootstrap.cc:492] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.908712 8054 ts_tablet_manager.cc:1403] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.002s
I20260505 20:13:21.908737 8053 ts_tablet_manager.cc:1403] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260505 20:13:21.909432 8053 raft_consensus.cc:359] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.909657 8053 raft_consensus.cc:385] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.909790 8053 raft_consensus.cc:740] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.909804 8054 raft_consensus.cc:359] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.910060 8054 raft_consensus.cc:385] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.910157 8054 raft_consensus.cc:740] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.910091 8053 consensus_queue.cc:260] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.910455 8054 consensus_queue.cc:260] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.910670 8053 ts_tablet_manager.cc:1434] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:21.910936 8054 ts_tablet_manager.cc:1434] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260505 20:13:21.910997 8053 tablet_bootstrap.cc:492] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:21.911262 8054 tablet_bootstrap.cc:492] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.913439 8064 raft_consensus.cc:493] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:21.913597 8064 raft_consensus.cc:515] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.914253 8064 leader_election.cc:290] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:21.914690 8054 tablet_bootstrap.cc:654] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.915031 8053 tablet_bootstrap.cc:654] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.915339 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43052ededdae41878a6190334d5a965e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:21.915371 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43052ededdae41878a6190334d5a965e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:21.915992 7737 leader_election.cc:343] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:21.916175 7736 leader_election.cc:343] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:21.916337 7736 leader_election.cc:304] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:21.919481 8064 raft_consensus.cc:2749] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:21.922986 8054 tablet_bootstrap.cc:492] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:21.923101 8053 tablet_bootstrap.cc:492] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:21.923138 8054 ts_tablet_manager.cc:1403] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260505 20:13:21.923235 8053 ts_tablet_manager.cc:1403] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260505 20:13:21.924024 8053 raft_consensus.cc:359] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.924201 8053 raft_consensus.cc:385] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.924283 8053 raft_consensus.cc:740] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.924600 8054 raft_consensus.cc:359] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.924777 8054 raft_consensus.cc:385] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.924865 8054 raft_consensus.cc:740] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.925079 8054 consensus_queue.cc:260] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.926587 8054 ts_tablet_manager.cc:1434] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:21.926940 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 (DEFAULT_TABLE table=default.Table_8f5799bc8b2b4f39b309936338cbe0fa [id=5a01343c41cf47d3b1fe5c49ff9d9660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.927376 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0138b762a0c74ecda3b43167dd5bfc04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.928179 8051 ts_tablet_manager.cc:1929] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.928310 8051 log.cc:1199] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/edceecc7eee4477a869acce495aade1c
I20260505 20:13:21.928750 8054 tablet_bootstrap.cc:492] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:21.928750 8051 ts_tablet_manager.cc:1950] T edceecc7eee4477a869acce495aade1c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:21.930059 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 40dfb8da73284065a3d97df18a738dc4 (DEFAULT_TABLE table=default.Table_87d54561ed754d9b83ec983b110c6899 [id=066d18dc94b24dc48ded2961f4b4f567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.930480 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dfb8da73284065a3d97df18a738dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.930897 8058 tablet_bootstrap.cc:492] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:21.931041 8058 ts_tablet_manager.cc:1403] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.018s
I20260505 20:13:21.931294 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8f09c91392ee4b32b16d1638079ac2cb
I20260505 20:13:21.932551 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 40dfb8da73284065a3d97df18a738dc4 (DEFAULT_TABLE table=default.Table_87d54561ed754d9b83ec983b110c6899 [id=066d18dc94b24dc48ded2961f4b4f567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.932796 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 56b775db329949bcbab3fd81c75e951d (DEFAULT_TABLE table=default.Table_3fe7759921d94264b2db628ddfdd199c [id=9a902245cb0d463b9540e1b0dc6a908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.933003 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dfb8da73284065a3d97df18a738dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.933252 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f09c91392ee4b32b16d1638079ac2cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.933323 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b775db329949bcbab3fd81c75e951d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.933494 8050 tablet_replica.cc:333] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:21.933704 8050 raft_consensus.cc:2243] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:21.934195 8050 pending_rounds.cc:70] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:21.934232 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3ebd6a4281b1477dbc833a9f7bde8612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.934423 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_aecb05072dc5457dab50f3e96887c93e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.934423 8050 pending_rounds.cc:77] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737159559950336 op_type: NO_OP noop_request { }
I20260505 20:13:21.934612 8050 raft_consensus.cc:2889] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:21.934748 8050 raft_consensus.cc:2272] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:21.934819 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aecb05072dc5457dab50f3e96887c93e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.935880 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 (DEFAULT_TABLE table=default.Table_8f5799bc8b2b4f39b309936338cbe0fa [id=5a01343c41cf47d3b1fe5c49ff9d9660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.935949 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 8824bed6d2e9411d86651dfcffa77718 (DEFAULT_TABLE table=default.Table_7f774c4256454a39904f5517cbcd9d9f [id=f615586594f3465e9ee9f554048cce6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.936292 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0138b762a0c74ecda3b43167dd5bfc04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.936257 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3fe7759921d94264b2db628ddfdd199c" } new_table_name: "default.Table_976061a8cd004c20a33f68445f330d0e" modify_external_catalogs: true
I20260505 20:13:21.936344 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8824bed6d2e9411d86651dfcffa77718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.938383 8054 tablet_bootstrap.cc:654] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:21.942016 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f09c91392ee4b32b16d1638079ac2cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.942704 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 (DEFAULT_TABLE table=default.Table_8f5799bc8b2b4f39b309936338cbe0fa [id=5a01343c41cf47d3b1fe5c49ff9d9660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.942764 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_245e946b31e8475f805cdc16988071aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.943094 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0138b762a0c74ecda3b43167dd5bfc04. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.943450 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_245e946b31e8475f805cdc16988071aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.944809 8052 tablet_replica.cc:333] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:21.945111 8052 raft_consensus.cc:2243] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.945302 8052 raft_consensus.cc:2272] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.946041 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 40dfb8da73284065a3d97df18a738dc4 (DEFAULT_TABLE table=default.Table_87d54561ed754d9b83ec983b110c6899 [id=066d18dc94b24dc48ded2961f4b4f567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.946384 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40dfb8da73284065a3d97df18a738dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.948287 8052 ts_tablet_manager.cc:1916] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.950029 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 56b775db329949bcbab3fd81c75e951d (DEFAULT_TABLE table=default.Table_3fe7759921d94264b2db628ddfdd199c [id=9a902245cb0d463b9540e1b0dc6a908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.950068 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a1437fdc2e924e39b8a96205ee5adc40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:21.950356 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b775db329949bcbab3fd81c75e951d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.950721 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1437fdc2e924e39b8a96205ee5adc40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.954469 8050 ts_tablet_manager.cc:1916] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.959959 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.960609 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 8af906f570a04b668c8696817739a412 (DEFAULT_TABLE table=default.Table_6d0efc4c31774452a20d42a0135965e0 [id=087098008f924e61874b6d84181048bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.961119 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af906f570a04b668c8696817739a412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.961086 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:21.961995 7781 tablet_service.cc:1511] Processing CreateTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c (DEFAULT_TABLE table=default.Table_206e9638b58b41f892b4b9f29c7b7e3e [id=2d1a1f685c25435d84db53ec232bea74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.962177 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet edceecc7eee4477a869acce495aade1c (table default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]) successfully deleted
I20260505 20:13:21.962399 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd0f0fba5284283b472d6ddd1fcd69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.966132 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 18ce59c1f3b64b518e244e32ac85b216 (DEFAULT_TABLE table=default.Table_baef00c4f9f1479fb9d61dfb47506804 [id=864842f5805c4e8aa36af98c0a5425a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.966565 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce59c1f3b64b518e244e32ac85b216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.967013 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.967271 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:21.967715 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 8824bed6d2e9411d86651dfcffa77718 (DEFAULT_TABLE table=default.Table_7f774c4256454a39904f5517cbcd9d9f [id=f615586594f3465e9ee9f554048cce6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.968138 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8824bed6d2e9411d86651dfcffa77718. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:21.934814 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ebd6a4281b1477dbc833a9f7bde8612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.970057 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d (DEFAULT_TABLE table=default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.970096 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 18ce59c1f3b64b518e244e32ac85b216 (DEFAULT_TABLE table=default.Table_baef00c4f9f1479fb9d61dfb47506804 [id=864842f5805c4e8aa36af98c0a5425a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.970144 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 (DEFAULT_TABLE table=default.Table_b6a4eac6e65d4294b1b4173a96b48c1a [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.970444 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78edaee6c4e946b1a7c7302d20aa5d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.970511 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce59c1f3b64b518e244e32ac85b216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.970651 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 (DEFAULT_TABLE table=default.Table_b6a4eac6e65d4294b1b4173a96b48c1a [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.971000 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a4a2fef35c4b9bb68edca0fb2dd127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.973862 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d (DEFAULT_TABLE table=default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.974366 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a4a2fef35c4b9bb68edca0fb2dd127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.974931 8064 raft_consensus.cc:493] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:21.975096 8064 raft_consensus.cc:515] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.975804 8064 leader_election.cc:290] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:21.975996 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 8af906f570a04b668c8696817739a412 (DEFAULT_TABLE table=default.Table_6d0efc4c31774452a20d42a0135965e0 [id=087098008f924e61874b6d84181048bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.976318 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af906f570a04b668c8696817739a412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:21.982093 7908 tablet_service.cc:1511] Processing CreateTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c (DEFAULT_TABLE table=default.Table_206e9638b58b41f892b4b9f29c7b7e3e [id=2d1a1f685c25435d84db53ec232bea74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.983722 8064 raft_consensus.cc:493] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:21.983887 8064 raft_consensus.cc:515] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.984529 8064 leader_election.cc:290] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:21.984826 8052 ts_tablet_manager.cc:1929] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:21.984990 8052 log.cc:1199] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8f09c91392ee4b32b16d1638079ac2cb
I20260505 20:13:21.985363 8052 ts_tablet_manager.cc:1950] T 8f09c91392ee4b32b16d1638079ac2cb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:21.987663 7736 leader_election.cc:343] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:21.988420 8058 raft_consensus.cc:359] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.988633 8058 raft_consensus.cc:385] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:21.988943 8058 raft_consensus.cc:740] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:21.989197 8058 consensus_queue.cc:260] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:21.990715 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_0f94e742e8824ee9876636e1c38babd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:21.991329 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f94e742e8824ee9876636e1c38babd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:21.992091 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 8f09c91392ee4b32b16d1638079ac2cb (table default.Table_7f981352ff52482499c0591c39c57146 [id=0e17662146d24eaeaa66105b3590b725]) successfully deleted
I20260505 20:13:21.992690 8052 tablet_replica.cc:333] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:21.992775 7340 catalog_manager.cc:5671] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:21.993824 8052 raft_consensus.cc:2243] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:21.994288 8052 raft_consensus.cc:2272] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:21.995532 7340 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd [id=680c74a223d54940afd6e814558bf4ae]). Expected version 2 got 0
I20260505 20:13:21.995548 8052 ts_tablet_manager.cc:1916] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:21.995813 7340 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_6507c22f6b464474a97953cee8978d22 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 1 got 0
I20260505 20:13:21.996451 7340 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 43052ededdae41878a6190334d5a965e (table default.Table_69ed4f92674c49b291ba8561c5117bfb [id=74178f7425164618bd69a1653b75e5d1]). Expected version 2 got 0
I20260505 20:13:21.999904 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.252:42521
--webserver_interface=127.7.33.252
--webserver_port=39007
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260505 20:13:22.000962 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 56b775db329949bcbab3fd81c75e951d (DEFAULT_TABLE table=default.Table_3fe7759921d94264b2db628ddfdd199c [id=9a902245cb0d463b9540e1b0dc6a908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:21.988173 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c552895eb36e49cfba7ad18ff462dba1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.001688 7712 tablet.cc:2404] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:22.002010 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 42f7886e6b054f458f1d0f02f3e555b0
I20260505 20:13:22.002460 8058 ts_tablet_manager.cc:1434] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.059s user 0.001s sys 0.002s
I20260505 20:13:22.002802 8058 tablet_bootstrap.cc:492] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:22.004762 7736 leader_election.cc:343] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.006621 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd0f0fba5284283b472d6ddd1fcd69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.006969 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 5fc05b2d65594e16abee960ad3c7721a
I20260505 20:13:22.007483 7336 catalog_manager.cc:6741] ReplaceTablet: tablet 5fc05b2d65594e16abee960ad3c7721a deleted and replaced by tablet 5a809fab787b48e29ff5901791fd3e0d
I20260505 20:13:22.008284 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc05b2d65594e16abee960ad3c7721a with delete_type TABLET_DATA_DELETED (replaced by tablet 5a809fab787b48e29ff5901791fd3e0d) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.008667 8052 ts_tablet_manager.cc:1929] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.008795 8052 log.cc:1199] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/385cafb44791473ab10a8a9cd78a5cb7
I20260505 20:13:22.009253 8052 ts_tablet_manager.cc:1950] T 385cafb44791473ab10a8a9cd78a5cb7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.010387 8052 tablet_replica.cc:333] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.010355 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 385cafb44791473ab10a8a9cd78a5cb7 (table default.Table_1ca4e07ca11647aea3925a39580491bf [id=18ef752a3c414e21848ef8ea109d9053]) successfully deleted
I20260505 20:13:22.010649 8052 raft_consensus.cc:2243] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.010912 8052 raft_consensus.cc:2272] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.010977 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 8824bed6d2e9411d86651dfcffa77718 (DEFAULT_TABLE table=default.Table_7f774c4256454a39904f5517cbcd9d9f [id=f615586594f3465e9ee9f554048cce6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.010875 8053 consensus_queue.cc:260] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.011396 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8824bed6d2e9411d86651dfcffa77718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.015317 8053 ts_tablet_manager.cc:1434] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.092s user 0.001s sys 0.001s
I20260505 20:13:22.016124 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_baef00c4f9f1479fb9d61dfb47506804" } new_table_name: "default.Table_faae7516687d41909cdaef29533f7400" modify_external_catalogs: true
I20260505 20:13:22.016510 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_207fda948999454b99cc51dc2fca63c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.017053 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_207fda948999454b99cc51dc2fca63c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.017465 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78edaee6c4e946b1a7c7302d20aa5d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.016162 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:22.018299 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56b775db329949bcbab3fd81c75e951d consensus state has no leader
I20260505 20:13:22.019011 8058 tablet_bootstrap.cc:654] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.016721 8052 ts_tablet_manager.cc:1916] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:22.020219 7737 leader_election.cc:343] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:22.020370 7737 leader_election.cc:304] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:22.020546 7737 raft_consensus.cc:2686] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:22.023064 8053 tablet_bootstrap.cc:492] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.024910 8053 tablet_bootstrap.cc:654] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.026044 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f09c91392ee4b32b16d1638079ac2cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.026350 8051 tablet_replica.cc:333] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.027269 8051 raft_consensus.cc:2243] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.027484 8051 raft_consensus.cc:2272] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.028715 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b775db329949bcbab3fd81c75e951d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.031316 8052 ts_tablet_manager.cc:1929] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.031453 8052 log.cc:1199] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:22.031796 8052 ts_tablet_manager.cc:1950] T 0c88743f76dc4cd1a8edef8f0fa6b6e2 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.033967 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet edceecc7eee4477a869acce495aade1c with delete_type TABLET_DATA_DELETED (replaced by tablet de9b7c48be9042a19958c09941c2e429) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.033991 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 (table default.Table_fc24f10488ab4376963f7a0c9bc31733 [id=6d220472d20c42b6844c2185e1dbc9d0]) successfully deleted
I20260505 20:13:22.034123 8051 ts_tablet_manager.cc:1916] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:22.034260 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 5fc05b2d65594e16abee960ad3c7721a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fc05b2d65594e16abee960ad3c7721a already in progress: creating tablet
I20260505 20:13:22.034343 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:22.034511 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 42f7886e6b054f458f1d0f02f3e555b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42f7886e6b054f458f1d0f02f3e555b0 already in progress: creating tablet
I20260505 20:13:22.034614 8054 tablet_bootstrap.cc:492] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.034791 8054 ts_tablet_manager.cc:1403] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.106s user 0.008s sys 0.003s
I20260505 20:13:22.035662 8054 raft_consensus.cc:359] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.035881 8054 raft_consensus.cc:385] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.035957 8054 raft_consensus.cc:740] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.036206 8054 consensus_queue.cc:260] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.036708 8054 ts_tablet_manager.cc:1434] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:22.037046 8054 tablet_bootstrap.cc:492] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.038798 8054 tablet_bootstrap.cc:654] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.040343 7644 tablet_service.cc:1511] Processing CreateTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 (DEFAULT_TABLE table=default.Table_b6a4eac6e65d4294b1b4173a96b48c1a [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.040541 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 8af906f570a04b668c8696817739a412 (DEFAULT_TABLE table=default.Table_6d0efc4c31774452a20d42a0135965e0 [id=087098008f924e61874b6d84181048bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.040750 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a4a2fef35c4b9bb68edca0fb2dd127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.041093 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d (DEFAULT_TABLE table=default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.041463 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78edaee6c4e946b1a7c7302d20aa5d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.042855 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet c552895eb36e49cfba7ad18ff462dba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9146142e112e43a7a6ce0369122d5a46) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.043130 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet bf0bab3a0fb14e41959f3b96cd47e2ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.044028 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_69ed4f92674c49b291ba8561c5117bfb" } new_table_name: "default.Table_63b4b5338b3f472285d47e294a30bc8e" modify_external_catalogs: true
I20260505 20:13:22.045128 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc05b2d65594e16abee960ad3c7721a with delete_type TABLET_DATA_DELETED (replaced by tablet 5a809fab787b48e29ff5901791fd3e0d) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.046180 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.046329 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2ab91975ab364881980fbe5ec6b592f8" } new_table_name: "default.Table_e2bec7fdd76f4bd7b695c78b0ce063c3" modify_external_catalogs: true
I20260505 20:13:22.046439 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 18ce59c1f3b64b518e244e32ac85b216 (DEFAULT_TABLE table=default.Table_baef00c4f9f1479fb9d61dfb47506804 [id=864842f5805c4e8aa36af98c0a5425a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.050999 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.049328 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c552895eb36e49cfba7ad18ff462dba1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:22.051277 8052 tablet_replica.cc:333] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.051445 8052 raft_consensus.cc:2243] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.051631 8052 raft_consensus.cc:2272] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.052482 8053 tablet_bootstrap.cc:492] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.052651 8053 ts_tablet_manager.cc:1403] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260505 20:13:22.053395 8053 raft_consensus.cc:359] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.053599 8053 raft_consensus.cc:385] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.053661 8053 raft_consensus.cc:740] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.053928 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.053930 8053 consensus_queue.cc:260] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.054714 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc05b2d65594e16abee960ad3c7721a with delete_type TABLET_DATA_DELETED (replaced by tablet 5a809fab787b48e29ff5901791fd3e0d) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.055229 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.055771 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:22.059005 7737 leader_election.cc:343] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.059165 7737 leader_election.cc:304] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:22.059437 7737 raft_consensus.cc:2686] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:22.059868 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_53975b00e0754d1690d32fa9b48b41d5" } modify_external_catalogs: true
I20260505 20:13:22.060086 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_53975b00e0754d1690d32fa9b48b41d5" } modify_external_catalogs: true
I20260505 20:13:22.061482 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_206e9638b58b41f892b4b9f29c7b7e3e" } modify_external_catalogs: true
I20260505 20:13:22.061651 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_206e9638b58b41f892b4b9f29c7b7e3e" } modify_external_catalogs: true
I20260505 20:13:22.062633 8052 ts_tablet_manager.cc:1916] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.064307 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.064707 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.065418 8053 ts_tablet_manager.cc:1434] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:22.065896 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ce59c1f3b64b518e244e32ac85b216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.065534 7639 tablet_service.cc:1511] Processing CreateTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c (DEFAULT_TABLE table=default.Table_206e9638b58b41f892b4b9f29c7b7e3e [id=2d1a1f685c25435d84db53ec232bea74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.069782 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 78edaee6c4e946b1a7c7302d20aa5d7d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.070314 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b6a4eac6e65d4294b1b4173a96b48c1a" } new_table_name: "default.Table_d07784067e0b40159e17122e8ddfb020" modify_external_catalogs: true
I20260505 20:13:22.072000 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet be214aeb495244a6b58f761c01b7faa5 from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:22.073853 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18ce59c1f3b64b518e244e32ac85b216 consensus state has no leader
I20260505 20:13:22.075121 8053 tablet_bootstrap.cc:492] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.076766 8053 tablet_bootstrap.cc:654] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.077373 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd0f0fba5284283b472d6ddd1fcd69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.081422 8053 tablet_bootstrap.cc:492] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.081564 8053 ts_tablet_manager.cc:1403] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260505 20:13:22.081715 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af906f570a04b668c8696817739a412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.082983 8053 raft_consensus.cc:359] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.083199 8053 raft_consensus.cc:385] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.083302 8053 raft_consensus.cc:740] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.083541 8053 consensus_queue.cc:260] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.086848 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd" } modify_external_catalogs: true
I20260505 20:13:22.087074 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd" } modify_external_catalogs: true
I20260505 20:13:22.088400 8053 ts_tablet_manager.cc:1434] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260505 20:13:22.088533 8050 ts_tablet_manager.cc:1929] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:22.088656 8050 log.cc:1199] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8f09c91392ee4b32b16d1638079ac2cb
I20260505 20:13:22.089083 8050 ts_tablet_manager.cc:1950] T 8f09c91392ee4b32b16d1638079ac2cb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.089937 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet 43052ededdae41878a6190334d5a965e from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.092077 8053 tablet_bootstrap.cc:492] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.094129 8053 tablet_bootstrap.cc:654] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.098572 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 8f09c91392ee4b32b16d1638079ac2cb (table default.Table_7f981352ff52482499c0591c39c57146 [id=0e17662146d24eaeaa66105b3590b725]) successfully deleted
I20260505 20:13:22.098832 8050 tablet_replica.cc:333] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
W20260505 20:13:22.098865 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 385cafb44791473ab10a8a9cd78a5cb7 because the tablet was not found. No further retry: Not found: Tablet not found: 385cafb44791473ab10a8a9cd78a5cb7
I20260505 20:13:22.099066 8050 raft_consensus.cc:2243] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:22.099143 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bf0bab3a0fb14e41959f3b96cd47e2ce because the tablet was not found. No further retry: Not found: Tablet not found: bf0bab3a0fb14e41959f3b96cd47e2ce
I20260505 20:13:22.099220 8050 raft_consensus.cc:2272] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.100157 8050 ts_tablet_manager.cc:1916] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.103549 8053 tablet_bootstrap.cc:492] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.103747 8053 ts_tablet_manager.cc:1403] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260505 20:13:22.104532 8053 raft_consensus.cc:359] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.104758 8053 raft_consensus.cc:385] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.104835 8053 raft_consensus.cc:740] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.105113 8053 consensus_queue.cc:260] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.109030 8051 ts_tablet_manager.cc:1929] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.109668 8053 ts_tablet_manager.cc:1434] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:22.113463 8053 tablet_bootstrap.cc:492] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.108780 8050 ts_tablet_manager.cc:1929] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.113852 8050 log.cc:1199] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/edceecc7eee4477a869acce495aade1c
I20260505 20:13:22.114360 8050 ts_tablet_manager.cc:1950] T edceecc7eee4477a869acce495aade1c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.115423 8050 tablet_replica.cc:333] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.115515 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet edceecc7eee4477a869acce495aade1c (table default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]) successfully deleted
I20260505 20:13:22.115679 8050 raft_consensus.cc:2243] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.115882 8050 raft_consensus.cc:2272] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.118811 8050 ts_tablet_manager.cc:1916] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.120131 8054 tablet_bootstrap.cc:492] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.120360 8054 ts_tablet_manager.cc:1403] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.010s
I20260505 20:13:22.121369 8054 raft_consensus.cc:359] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.121683 8054 raft_consensus.cc:385] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.121891 8054 raft_consensus.cc:740] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.122196 8054 consensus_queue.cc:260] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.126021 8054 ts_tablet_manager.cc:1434] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260505 20:13:22.128077 8050 ts_tablet_manager.cc:1929] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.128258 8050 log.cc:1199] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/855691b4c37f42bfbfc665bb6a712092
I20260505 20:13:22.128513 8054 tablet_bootstrap.cc:492] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.128721 8050 ts_tablet_manager.cc:1950] T 855691b4c37f42bfbfc665bb6a712092 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.129122 8051 log.cc:1199] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/8f09c91392ee4b32b16d1638079ac2cb
I20260505 20:13:22.130026 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 855691b4c37f42bfbfc665bb6a712092 (table default.Table_21bf596b95564f88b8d7e20935fa66ba [id=1362ad2a11fd427d814566441a09dec3]) successfully deleted
I20260505 20:13:22.130108 8051 ts_tablet_manager.cc:1950] T 8f09c91392ee4b32b16d1638079ac2cb P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.130637 8054 tablet_bootstrap.cc:654] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.130700 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 0c88743f76dc4cd1a8edef8f0fa6b6e2 because the tablet was not found. No further retry: Not found: Tablet not found: 0c88743f76dc4cd1a8edef8f0fa6b6e2
I20260505 20:13:22.131112 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 8f09c91392ee4b32b16d1638079ac2cb (table default.Table_7f981352ff52482499c0591c39c57146 [id=0e17662146d24eaeaa66105b3590b725]) successfully deleted
W20260505 20:13:22.131661 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 5fc05b2d65594e16abee960ad3c7721a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fc05b2d65594e16abee960ad3c7721a already in progress: creating tablet
I20260505 20:13:22.132134 8053 tablet_bootstrap.cc:654] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.132267 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 42f7886e6b054f458f1d0f02f3e555b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42f7886e6b054f458f1d0f02f3e555b0 already in progress: creating tablet
W20260505 20:13:22.133625 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 5fc05b2d65594e16abee960ad3c7721a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fc05b2d65594e16abee960ad3c7721a already in progress: creating tablet
W20260505 20:13:22.133917 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 42f7886e6b054f458f1d0f02f3e555b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42f7886e6b054f458f1d0f02f3e555b0 already in progress: creating tablet
I20260505 20:13:22.134791 8053 tablet_bootstrap.cc:492] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.134997 8053 ts_tablet_manager.cc:1403] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260505 20:13:22.135917 8053 raft_consensus.cc:359] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.136099 8052 ts_tablet_manager.cc:1929] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.132601 8050 tablet_replica.cc:333] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.136445 8050 raft_consensus.cc:2243] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.136662 8050 raft_consensus.cc:2272] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.137560 8050 ts_tablet_manager.cc:1916] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.138515 8058 tablet_bootstrap.cc:492] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.138688 8058 ts_tablet_manager.cc:1403] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.136s user 0.000s sys 0.007s
I20260505 20:13:22.139387 8058 raft_consensus.cc:359] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.139600 8058 raft_consensus.cc:385] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.139665 8058 raft_consensus.cc:740] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.139914 8058 consensus_queue.cc:260] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.136165 8053 raft_consensus.cc:385] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.140514 8053 raft_consensus.cc:740] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.140877 8053 consensus_queue.cc:260] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.144760 8053 ts_tablet_manager.cc:1434] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260505 20:13:22.148110 8053 tablet_bootstrap.cc:492] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.148651 8058 ts_tablet_manager.cc:1434] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260505 20:13:22.150441 8058 tablet_bootstrap.cc:492] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.150468 8053 tablet_bootstrap.cc:654] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.151960 8054 tablet_bootstrap.cc:492] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.152146 8054 ts_tablet_manager.cc:1403] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260505 20:13:22.153105 8054 raft_consensus.cc:359] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.153314 8054 raft_consensus.cc:385] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.153401 8054 raft_consensus.cc:740] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.153625 8058 tablet_bootstrap.cc:654] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.153682 8054 consensus_queue.cc:260] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.140489 8052 log.cc:1199] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c552895eb36e49cfba7ad18ff462dba1
I20260505 20:13:22.155633 8052 ts_tablet_manager.cc:1950] T c552895eb36e49cfba7ad18ff462dba1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.156827 8054 ts_tablet_manager.cc:1434] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:22.156842 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c552895eb36e49cfba7ad18ff462dba1 (table default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]) successfully deleted
I20260505 20:13:22.158313 8052 tablet_replica.cc:333] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.158535 8052 raft_consensus.cc:2243] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.160393 8050 ts_tablet_manager.cc:1929] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.160527 8050 log.cc:1199] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:22.160874 8050 ts_tablet_manager.cc:1950] T 38bc883c8e98495882e4d8ef68c9da80 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.161371 8052 raft_consensus.cc:2272] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.161427 8054 tablet_bootstrap.cc:492] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.167575 7580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:22.167811 7580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:22.168726 8054 tablet_bootstrap.cc:654] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.170015 8050 tablet_replica.cc:333] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.170202 8050 raft_consensus.cc:2243] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.170396 8050 raft_consensus.cc:2272] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.171139 8050 ts_tablet_manager.cc:1916] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.172916 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 (DEFAULT_TABLE table=default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.173341 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02eafc72ff7d4055b424322e01dc0c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.177393 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 (DEFAULT_TABLE table=default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.177675 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (DEFAULT_TABLE table=default.Table_ee9c40896ce845dd9843cecf2a713762 [id=2e394d60c73d48ad9efb558eb5df83a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.177877 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02eafc72ff7d4055b424322e01dc0c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.178120 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:22.179312 7328 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_6507c22f6b464474a97953cee8978d22 [id=db04ad55e6964d88bb71e0eab4cc4f65], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c1884e1306ae4aac9d599a93775c5d8d consensus state has no leader
I20260505 20:13:22.179353 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f (DEFAULT_TABLE table=default.Table_ce9ec72e24eb4a94888f70a816c84df0 [id=3c74b3f7e0944d40857db619bc1058e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.179463 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 38bc883c8e98495882e4d8ef68c9da80 (table default.Table_ee6f5cb164d1435ba5955ac615e2249b [id=d79f9a116fdb4912b39f530d6f5d43ff]) successfully deleted
I20260505 20:13:22.179787 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e64ed9bb7c44219dac4a36bfbec24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.180152 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f (DEFAULT_TABLE table=default.Table_ce9ec72e24eb4a94888f70a816c84df0 [id=3c74b3f7e0944d40857db619bc1058e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.180554 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e64ed9bb7c44219dac4a36bfbec24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.180972 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2461ad6b3ec94233b9dd7f60cbad4639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.177395 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f (DEFAULT_TABLE table=default.Table_ce9ec72e24eb4a94888f70a816c84df0 [id=3c74b3f7e0944d40857db619bc1058e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.182358 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_6507c22f6b464474a97953cee8978d22 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 1 got 0
I20260505 20:13:22.182544 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e64ed9bb7c44219dac4a36bfbec24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.183084 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 5fc05b2d65594e16abee960ad3c7721a from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.183591 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c738b338e02745d989d767b3cf2954a8" } modify_external_catalogs: true
I20260505 20:13:22.183768 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c738b338e02745d989d767b3cf2954a8" } modify_external_catalogs: true
I20260505 20:13:22.185823 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (DEFAULT_TABLE table=default.Table_ee9c40896ce845dd9843cecf2a713762 [id=2e394d60c73d48ad9efb558eb5df83a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.186094 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (DEFAULT_TABLE table=default.Table_ee9c40896ce845dd9843cecf2a713762 [id=2e394d60c73d48ad9efb558eb5df83a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.186226 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2461ad6b3ec94233b9dd7f60cbad4639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.186463 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2461ad6b3ec94233b9dd7f60cbad4639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.190088 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 (DEFAULT_TABLE table=default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.190482 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02eafc72ff7d4055b424322e01dc0c84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.190603 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43052ededdae41878a6190334d5a965e consensus state has no leader
I20260505 20:13:22.191593 7342 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_6507c22f6b464474a97953cee8978d22 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 1 got 0
I20260505 20:13:22.192628 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_264d0b6fcd884b629f0fb38091195668"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.193156 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_264d0b6fcd884b629f0fb38091195668 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.196529 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.197608 8052 ts_tablet_manager.cc:1916] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.200879 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_55818053abfc4ea0a0cc4ef3f1bab479"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.201560 7736 consensus_peers.cc:597] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:22.203591 7774 tablet_service.cc:1558] Processing DeleteTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.203775 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.204742 7936 raft_consensus.cc:1275] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260505 20:13:22.206604 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55818053abfc4ea0a0cc4ef3f1bab479 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.207661 8058 tablet_bootstrap.cc:492] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.207857 8058 ts_tablet_manager.cc:1403] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.003s
I20260505 20:13:22.208803 8058 raft_consensus.cc:359] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.209059 8058 raft_consensus.cc:385] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.209183 8058 raft_consensus.cc:740] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.209477 8058 consensus_queue.cc:260] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.210471 8064 consensus_queue.cc:1048] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:22.213148 8058 ts_tablet_manager.cc:1434] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260505 20:13:22.214890 8058 tablet_bootstrap.cc:492] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.217247 8058 tablet_bootstrap.cc:654] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.218482 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 385cafb44791473ab10a8a9cd78a5cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.218820 8051 tablet_replica.cc:333] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.218986 8051 raft_consensus.cc:2243] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.219167 8051 raft_consensus.cc:2272] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.219995 8051 ts_tablet_manager.cc:1916] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.222738 8054 tablet_bootstrap.cc:492] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.222906 8054 ts_tablet_manager.cc:1403] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.004s
I20260505 20:13:22.223740 8054 raft_consensus.cc:359] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.223963 8054 raft_consensus.cc:385] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.224046 8054 raft_consensus.cc:740] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.224257 8054 consensus_queue.cc:260] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.224777 8054 ts_tablet_manager.cc:1434] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:22.225095 8054 tablet_bootstrap.cc:492] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.226955 8054 tablet_bootstrap.cc:654] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.230188 8050 ts_tablet_manager.cc:1929] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.230382 8050 log.cc:1199] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8b6cb875a42d4f16904e2d5bf62c1d0d
I20260505 20:13:22.230767 8064 raft_consensus.cc:493] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.230841 8050 ts_tablet_manager.cc:1950] T 8b6cb875a42d4f16904e2d5bf62c1d0d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.230937 8064 raft_consensus.cc:515] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.231624 8064 leader_election.cc:290] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.231729 8050 tablet_replica.cc:333] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.231952 8050 raft_consensus.cc:2243] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.232146 8050 raft_consensus.cc:2272] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.232178 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1884e1306ae4aac9d599a93775c5d8d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:22.232576 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1884e1306ae4aac9d599a93775c5d8d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.233225 7736 leader_election.cc:343] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.233381 7937 raft_consensus.cc:2468] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:22.234257 7737 leader_election.cc:304] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.234665 8064 raft_consensus.cc:2804] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:22.234782 8064 raft_consensus.cc:493] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:22.234860 8064 raft_consensus.cc:3060] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:22.235361 8051 ts_tablet_manager.cc:1929] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.235471 8051 log.cc:1199] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/385cafb44791473ab10a8a9cd78a5cb7
I20260505 20:13:22.235737 8050 ts_tablet_manager.cc:1916] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.235834 8051 ts_tablet_manager.cc:1950] T 385cafb44791473ab10a8a9cd78a5cb7 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.237536 8064 raft_consensus.cc:515] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.238848 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1884e1306ae4aac9d599a93775c5d8d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:22.239378 7736 leader_election.cc:343] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.239749 8064 leader_election.cc:290] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:22.239957 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43f656c47c5f46fe811ff64c58972e76 has no consensus state
I20260505 20:13:22.240437 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 8b6cb875a42d4f16904e2d5bf62c1d0d (table default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 [id=3d33e35a14b9400593605d46763f73c2]) successfully deleted
I20260505 20:13:22.241111 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1884e1306ae4aac9d599a93775c5d8d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:22.241284 7937 raft_consensus.cc:3060] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:22.241926 8050 ts_tablet_manager.cc:1929] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.241890 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b8ff08fb11684cdcb173222f3f74ad15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.242074 8050 log.cc:1199] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c187c7931645429b9c89b92b890c8bba
I20260505 20:13:22.242437 8050 ts_tablet_manager.cc:1950] T c187c7931645429b9c89b92b890c8bba P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:22.242689 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8ff08fb11684cdcb173222f3f74ad15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.244087 7937 raft_consensus.cc:2468] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:22.244246 7335 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 5265e0ea072d4910b09d12d3a2f062c7
I20260505 20:13:22.244539 7737 leader_election.cc:304] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.244683 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_76b9386a48e94edcabaf5284ccf85588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.245419 8064 raft_consensus.cc:2804] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:22.245594 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96a4a2fef35c4b9bb68edca0fb2dd127 consensus state has no leader
I20260505 20:13:22.246007 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f93d0177af14c798f5bc3df1c317875" } modify_external_catalogs: true
I20260505 20:13:22.246250 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f93d0177af14c798f5bc3df1c317875" } modify_external_catalogs: true
I20260505 20:13:22.247279 8064 raft_consensus.cc:697] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:22.247692 8064 consensus_queue.cc:237] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.249248 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet acd0f0fba5284283b472d6ddd1fcd69c
I20260505 20:13:22.250061 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 78edaee6c4e946b1a7c7302d20aa5d7d
I20260505 20:13:22.250612 7341 catalog_manager.cc:6741] ReplaceTablet: tablet 78edaee6c4e946b1a7c7302d20aa5d7d deleted and replaced by tablet a9719876757e409b991b21410983e3bf
I20260505 20:13:22.250981 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f94e742e8824ee9876636e1c38babd1" } new_table_name: "default.Table_1e208cbf87594a0288a8c70a5d2e476e" modify_external_catalogs: true
W20260505 20:13:22.253383 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76b9386a48e94edcabaf5284ccf85588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.255074 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet ae94d54b26b24d99b0b382fba9f5a542 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.255795 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f4365ce42d9d4cc4ae2eb1fbff18d439"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.256415 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4365ce42d9d4cc4ae2eb1fbff18d439 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.259076 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c187c7931645429b9c89b92b890c8bba (table default.Table_d5b8d6121e234d70939c2432a603ff18 [id=5ba2ee85cb9147399567f608a97458ad]) successfully deleted
I20260505 20:13:22.259730 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d with delete_type TABLET_DATA_DELETED (replaced by tablet a9719876757e409b991b21410983e3bf) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.260126 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.260317 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d with delete_type TABLET_DATA_DELETED (replaced by tablet a9719876757e409b991b21410983e3bf) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.260555 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.260828 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d with delete_type TABLET_DATA_DELETED (replaced by tablet a9719876757e409b991b21410983e3bf) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:22.261296 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 78edaee6c4e946b1a7c7302d20aa5d7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78edaee6c4e946b1a7c7302d20aa5d7d already in progress: creating tablet
I20260505 20:13:22.261348 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:22.261615 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet acd0f0fba5284283b472d6ddd1fcd69c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acd0f0fba5284283b472d6ddd1fcd69c already in progress: creating tablet
I20260505 20:13:22.263818 8053 tablet_bootstrap.cc:492] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.264034 8053 ts_tablet_manager.cc:1403] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.004s
I20260505 20:13:22.264863 8053 raft_consensus.cc:359] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.265159 8053 raft_consensus.cc:385] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.265305 8053 raft_consensus.cc:740] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.267100 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f8af8c7fa9554353a61594c4e426ef2f
I20260505 20:13:22.269125 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_cff6727e6bcd4190ac7c0cf6c82bc3de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.272435 7336 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 5a809fab787b48e29ff5901791fd3e0d
I20260505 20:13:22.272918 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7c4d921cc7404bab95415fb55b417bc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.274830 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet f8af8c7fa9554353a61594c4e426ef2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.275313 8053 consensus_queue.cc:260] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.276338 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1737b54ebbda4728ac1deda9e7c836dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.277161 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cff6727e6bcd4190ac7c0cf6c82bc3de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.279356 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet f8af8c7fa9554353a61594c4e426ef2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:22.279485 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c4d921cc7404bab95415fb55b417bc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.279646 8050 tablet_replica.cc:333] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
W20260505 20:13:22.281523 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1737b54ebbda4728ac1deda9e7c836dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.282989 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet f8af8c7fa9554353a61594c4e426ef2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.285701 8089 raft_consensus.cc:493] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.285897 8089 raft_consensus.cc:515] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.286711 8089 leader_election.cc:290] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.287343 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f7886e6b054f458f1d0f02f3e555b0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.288017 7736 leader_election.cc:343] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.291539 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f7886e6b054f458f1d0f02f3e555b0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:22.292233 7737 leader_election.cc:343] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.292377 7737 leader_election.cc:304] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.292757 8089 raft_consensus.cc:2749] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.293368 8053 ts_tablet_manager.cc:1434] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260505 20:13:22.295609 8051 tablet_replica.cc:333] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.295962 8051 raft_consensus.cc:2243] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.296245 8051 raft_consensus.cc:2272] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.296710 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 385cafb44791473ab10a8a9cd78a5cb7 (table default.Table_1ca4e07ca11647aea3925a39580491bf [id=18ef752a3c414e21848ef8ea109d9053]) successfully deleted
W20260505 20:13:22.297063 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 78edaee6c4e946b1a7c7302d20aa5d7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78edaee6c4e946b1a7c7302d20aa5d7d already in progress: creating tablet
W20260505 20:13:22.297330 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet acd0f0fba5284283b472d6ddd1fcd69c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acd0f0fba5284283b472d6ddd1fcd69c already in progress: creating tablet
I20260505 20:13:22.297711 8053 tablet_bootstrap.cc:492] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.299624 8053 tablet_bootstrap.cc:654] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.300833 8054 tablet_bootstrap.cc:492] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.301016 8054 ts_tablet_manager.cc:1403] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.076s user 0.017s sys 0.039s
I20260505 20:13:22.302012 8054 raft_consensus.cc:359] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.302219 8054 raft_consensus.cc:385] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.302311 8054 raft_consensus.cc:740] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.302594 8054 consensus_queue.cc:260] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.303449 8050 raft_consensus.cc:2243] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.303951 8050 pending_rounds.cc:70] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 2 pending ops.
I20260505 20:13:22.304023 8050 pending_rounds.cc:77] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7282737160991748096 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "f8af8c7fa9554353a61594c4e426ef2f" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd" dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" new_extra_config { } }
I20260505 20:13:22.304729 8050 pending_rounds.cc:77] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737159624732672 op_type: NO_OP noop_request { }
I20260505 20:13:22.304843 8050 raft_consensus.cc:2889] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:22.304988 8050 raft_consensus.cc:2272] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.303375 8054 ts_tablet_manager.cc:1434] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:22.305434 8051 ts_tablet_manager.cc:1916] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.305599 8054 tablet_bootstrap.cc:492] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.307312 8054 tablet_bootstrap.cc:654] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.311579 8118 consensus_queue.cc:1175] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "974ed93a43c54ccbb58e60bfdae7c546" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260505 20:13:22.316083 8054 tablet_bootstrap.cc:492] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.316164 8058 tablet_bootstrap.cc:492] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.316248 8054 ts_tablet_manager.cc:1403] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260505 20:13:22.316427 8058 ts_tablet_manager.cc:1403] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.001s
I20260505 20:13:22.317059 8054 raft_consensus.cc:359] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.317262 8054 raft_consensus.cc:385] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.317363 8054 raft_consensus.cc:740] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.317303 8058 raft_consensus.cc:359] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.317667 8058 raft_consensus.cc:385] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.317625 8054 consensus_queue.cc:260] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.317885 8058 raft_consensus.cc:740] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.318210 8058 consensus_queue.cc:260] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.319609 8054 ts_tablet_manager.cc:1434] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:22.320056 8054 tablet_bootstrap.cc:492] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.321218 8058 ts_tablet_manager.cc:1434] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:22.321250 8122 raft_consensus.cc:493] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.321835 8054 tablet_bootstrap.cc:654] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.322026 8122 raft_consensus.cc:515] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.321799 8121 tablet.cc:1724] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:22.323305 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae94d54b26b24d99b0b382fba9f5a542" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.323879 7736 leader_election.cc:343] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.324162 8122 leader_election.cc:290] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.324184 8058 tablet_bootstrap.cc:492] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.326143 8058 tablet_bootstrap.cc:654] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.328588 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae94d54b26b24d99b0b382fba9f5a542" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:22.331705 7737 leader_election.cc:343] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.331873 7737 leader_election.cc:304] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.332979 8064 raft_consensus.cc:2749] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.334002 7333 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 945a731699c043959d5da5fb18b43cb2
W20260505 20:13:22.334179 7737 consensus_peers.cc:597] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:22.334494 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_61d9b0e280f5450ea9007d9a0d283072"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.335254 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61d9b0e280f5450ea9007d9a0d283072 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.336707 8050 ts_tablet_manager.cc:1916] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:22.336905 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e32780089f084e57ab07a222e1353eff has no consensus state
I20260505 20:13:22.337337 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_63b4b5338b3f472285d47e294a30bc8e" } new_table_name: "default.Table_0e377ae2a3924b33ada3c0ce8495101d" modify_external_catalogs: true
I20260505 20:13:22.341504 8053 tablet_bootstrap.cc:492] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.341648 8053 ts_tablet_manager.cc:1403] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260505 20:13:22.342186 8081 raft_consensus.cc:493] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.342367 8081 raft_consensus.cc:515] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.342809 8053 raft_consensus.cc:359] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.342971 8053 raft_consensus.cc:385] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.343046 8053 raft_consensus.cc:740] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.343032 8081 leader_election.cc:290] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:22.343678 8050 ts_tablet_manager.cc:1929] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:22.343864 8050 log.cc:1199] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f8af8c7fa9554353a61594c4e426ef2f
I20260505 20:13:22.343820 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43052ededdae41878a6190334d5a965e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:22.344372 8050 ts_tablet_manager.cc:1950] T f8af8c7fa9554353a61594c4e426ef2f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.344269 8053 consensus_queue.cc:260] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:22.344408 7870 leader_election.cc:343] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.345685 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd [id=680c74a223d54940afd6e814558bf4ae]) successfully deleted
I20260505 20:13:22.346964 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet c552895eb36e49cfba7ad18ff462dba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9146142e112e43a7a6ce0369122d5a46) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.348269 8053 ts_tablet_manager.cc:1434] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:22.349646 8053 tablet_bootstrap.cc:492] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.352025 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43052ededdae41878a6190334d5a965e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:22.352515 7802 raft_consensus.cc:2468] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:22.353489 7869 leader_election.cc:304] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.354234 8081 raft_consensus.cc:2804] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:22.354358 8081 raft_consensus.cc:493] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:22.354496 8081 raft_consensus.cc:3060] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:22.359036 8081 raft_consensus.cc:515] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.359930 8053 tablet_bootstrap.cc:654] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.360500 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43052ededdae41878a6190334d5a965e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:22.360533 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43052ededdae41878a6190334d5a965e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:22.360707 7802 raft_consensus.cc:3060] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:22.361132 7870 leader_election.cc:343] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.361233 8081 leader_election.cc:290] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:22.362809 8051 ts_tablet_manager.cc:1929] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.367465 7802 raft_consensus.cc:2468] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:22.367938 8054 tablet_bootstrap.cc:492] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.367972 7869 leader_election.cc:304] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.368233 8054 ts_tablet_manager.cc:1403] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.048s user 0.023s sys 0.016s
I20260505 20:13:22.368435 8081 raft_consensus.cc:2804] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:22.369268 8054 raft_consensus.cc:359] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.369563 8054 raft_consensus.cc:385] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.369689 8054 raft_consensus.cc:740] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.370174 8054 consensus_queue.cc:260] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.362965 8051 log.cc:1199] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f8af8c7fa9554353a61594c4e426ef2f
I20260505 20:13:22.370918 8081 raft_consensus.cc:697] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:22.371183 8081 consensus_queue.cc:237] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.372406 8052 ts_tablet_manager.cc:1929] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.372570 8052 log.cc:1199] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/bf0bab3a0fb14e41959f3b96cd47e2ce
I20260505 20:13:22.372067 8051 ts_tablet_manager.cc:1950] T f8af8c7fa9554353a61594c4e426ef2f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.372946 8052 ts_tablet_manager.cc:1950] T bf0bab3a0fb14e41959f3b96cd47e2ce P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.373829 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd [id=680c74a223d54940afd6e814558bf4ae]) successfully deleted
I20260505 20:13:22.374171 8051 tablet_replica.cc:333] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.374469 8051 raft_consensus.cc:2243] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.374745 8053 tablet_bootstrap.cc:492] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.374912 8053 ts_tablet_manager.cc:1403] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260505 20:13:22.375686 8053 raft_consensus.cc:359] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.375885 8053 raft_consensus.cc:385] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.375953 8053 raft_consensus.cc:740] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.376504 8051 raft_consensus.cc:2272] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.377048 8053 consensus_queue.cc:260] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.377579 8053 ts_tablet_manager.cc:1434] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:22.379429 8054 ts_tablet_manager.cc:1434] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20260505 20:13:22.379953 8054 tablet_bootstrap.cc:492] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.379891 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet bf0bab3a0fb14e41959f3b96cd47e2ce (table default.Table_0c18b95b0d9840e387da91812077995a [id=0a78e2ddc7f14316960db11d6dc289c9]) successfully deleted
I20260505 20:13:22.381865 8054 tablet_bootstrap.cc:654] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.382951 8051 ts_tablet_manager.cc:1916] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.384900 8053 tablet_bootstrap.cc:492] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.391286 8053 tablet_bootstrap.cc:654] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.391839 7335 master_service.cc:954] ReplaceTablet: received request to replace tablet 43052ededdae41878a6190334d5a965e from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.392756 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2dd912da5ad54a6fb5b2b20cc24b2b9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.393550 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dd912da5ad54a6fb5b2b20cc24b2b9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.398401 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b8ff08fb11684cdcb173222f3f74ad15" } new_table_name: "default.Table_ff6f9b07cd9040f9b22cd78b16700030" modify_external_catalogs: true
I20260505 20:13:22.402427 8051 ts_tablet_manager.cc:1929] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.402663 8052 tablet_replica.cc:333] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.402951 8052 raft_consensus.cc:2243] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.403227 8052 raft_consensus.cc:2272] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.404047 8052 ts_tablet_manager.cc:1916] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.404414 8051 log.cc:1199] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c552895eb36e49cfba7ad18ff462dba1
I20260505 20:13:22.404882 8051 ts_tablet_manager.cc:1950] T c552895eb36e49cfba7ad18ff462dba1 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.406239 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c552895eb36e49cfba7ad18ff462dba1 (table default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]) successfully deleted
I20260505 20:13:22.409986 8053 tablet_bootstrap.cc:492] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.410136 8053 ts_tablet_manager.cc:1403] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
I20260505 20:13:22.410950 8053 raft_consensus.cc:359] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.411126 8053 raft_consensus.cc:385] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.411222 8053 raft_consensus.cc:740] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.411504 8053 consensus_queue.cc:260] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.413093 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 8af906f570a04b668c8696817739a412 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.413484 8053 ts_tablet_manager.cc:1434] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:22.413690 8052 ts_tablet_manager.cc:1929] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.413808 8053 tablet_bootstrap.cc:492] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.414520 8058 tablet_bootstrap.cc:492] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.414703 8058 ts_tablet_manager.cc:1403] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.000s
I20260505 20:13:22.415958 8058 raft_consensus.cc:359] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.413833 8052 log.cc:1199] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/ae94d54b26b24d99b0b382fba9f5a542
I20260505 20:13:22.416864 8052 ts_tablet_manager.cc:1950] T ae94d54b26b24d99b0b382fba9f5a542 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.416198 8058 raft_consensus.cc:385] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.417703 8058 raft_consensus.cc:740] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.418071 8058 consensus_queue.cc:260] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.418208 8053 tablet_bootstrap.cc:654] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.419042 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet ae94d54b26b24d99b0b382fba9f5a542 (table default.Table_7aa01cf42bad4323b9ac63a7e130b521 [id=885260685ed345f8a157266967b6606f]) successfully deleted
I20260505 20:13:22.419764 8052 tablet_replica.cc:333] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.419974 8052 raft_consensus.cc:2243] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.420130 8052 raft_consensus.cc:2272] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.421880 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.421986 8052 ts_tablet_manager.cc:1916] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.422240 8058 ts_tablet_manager.cc:1434] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:22.426142 8058 tablet_bootstrap.cc:492] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.427531 8053 tablet_bootstrap.cc:492] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:22.428058 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 38bc883c8e98495882e4d8ef68c9da80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38bc883c8e98495882e4d8ef68c9da80 already in progress: creating tablet
I20260505 20:13:22.427785 8053 ts_tablet_manager.cc:1403] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260505 20:13:22.430013 8053 raft_consensus.cc:359] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.430307 8053 raft_consensus.cc:385] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.430454 8053 raft_consensus.cc:740] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.431093 8053 consensus_queue.cc:260] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.432312 8058 tablet_bootstrap.cc:654] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.433210 8053 ts_tablet_manager.cc:1434] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:22.434767 8052 ts_tablet_manager.cc:1929] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.435801 8052 log.cc:1199] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/d7e47c72827941cca40d20725e0100de
I20260505 20:13:22.435089 8053 tablet_bootstrap.cc:492] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.436578 8052 ts_tablet_manager.cc:1950] T d7e47c72827941cca40d20725e0100de P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.437315 8054 tablet_bootstrap.cc:492] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.437441 8058 tablet_bootstrap.cc:492] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.437592 8054 ts_tablet_manager.cc:1403] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.058s user 0.016s sys 0.021s
I20260505 20:13:22.437606 8058 ts_tablet_manager.cc:1403] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260505 20:13:22.438410 8058 raft_consensus.cc:359] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.438457 8054 raft_consensus.cc:359] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.438633 8058 raft_consensus.cc:385] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.438736 8058 raft_consensus.cc:740] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.438786 8054 raft_consensus.cc:385] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.438962 8054 raft_consensus.cc:740] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.439025 8058 consensus_queue.cc:260] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.439309 8054 consensus_queue.cc:260] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.440165 8054 ts_tablet_manager.cc:1434] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:22.440515 8054 tablet_bootstrap.cc:492] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.438104 8053 tablet_bootstrap.cc:654] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.443637 8054 tablet_bootstrap.cc:654] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.443720 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet d7e47c72827941cca40d20725e0100de (table default.Table_2329990d33d941799ae7ae7cbb3c3493 [id=9016406a2de74726b20ec5215d2d94d3]) successfully deleted
I20260505 20:13:22.443928 8052 tablet_replica.cc:333] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.444118 8052 raft_consensus.cc:2243] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.444315 8052 raft_consensus.cc:2272] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.445909 8052 ts_tablet_manager.cc:1916] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.451306 7908 tablet_service.cc:1511] Processing CreateTablet for tablet e32780089f084e57ab07a222e1353eff (DEFAULT_TABLE table=default.Table_1e208cbf87594a0288a8c70a5d2e476e [id=6521a9dc88b746aebd36af503e674dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.451308 7631 tablet_service.cc:1511] Processing CreateTablet for tablet e32780089f084e57ab07a222e1353eff (DEFAULT_TABLE table=default.Table_1e208cbf87594a0288a8c70a5d2e476e [id=6521a9dc88b746aebd36af503e674dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.451740 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32780089f084e57ab07a222e1353eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.451772 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32780089f084e57ab07a222e1353eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.454062 7642 tablet_service.cc:1511] Processing CreateTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (DEFAULT_TABLE table=default.Table_3ebd6a4281b1477dbc833a9f7bde8612 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.454461 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41cf3b6cf3a4ef6b7c077f78b793283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.458346 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 (DEFAULT_TABLE table=default.Table_a1437fdc2e924e39b8a96205ee5adc40 [id=dc99b341dea243b9aa707fb2ba807db9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.458730 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dbde45980c4f2b8d6bee05416fa2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.459347 8054 tablet_bootstrap.cc:492] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.459496 8054 ts_tablet_manager.cc:1403] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260505 20:13:22.460250 8054 raft_consensus.cc:359] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.460443 8054 raft_consensus.cc:385] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.460510 8054 raft_consensus.cc:740] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.460753 8054 consensus_queue.cc:260] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.461584 8054 ts_tablet_manager.cc:1434] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:22.462033 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 47de1578fdd74a198c48606aec33880a (DEFAULT_TABLE table=default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.462353 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47de1578fdd74a198c48606aec33880a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.468822 7770 tablet_service.cc:1511] Processing CreateTablet for tablet e32780089f084e57ab07a222e1353eff (DEFAULT_TABLE table=default.Table_1e208cbf87594a0288a8c70a5d2e476e [id=6521a9dc88b746aebd36af503e674dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.469028 7776 tablet_service.cc:1511] Processing CreateTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (DEFAULT_TABLE table=default.Table_3ebd6a4281b1477dbc833a9f7bde8612 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.469225 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32780089f084e57ab07a222e1353eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.469431 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41cf3b6cf3a4ef6b7c077f78b793283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.469532 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 (DEFAULT_TABLE table=default.Table_a1437fdc2e924e39b8a96205ee5adc40 [id=dc99b341dea243b9aa707fb2ba807db9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.469905 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dbde45980c4f2b8d6bee05416fa2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.471400 8054 tablet_bootstrap.cc:492] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.449697 7337 catalog_manager.cc:5671] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:22.476490 7908 tablet_service.cc:1511] Processing CreateTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (DEFAULT_TABLE table=default.Table_3ebd6a4281b1477dbc833a9f7bde8612 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.477001 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41cf3b6cf3a4ef6b7c077f78b793283. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.481804 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 (DEFAULT_TABLE table=default.Table_a1437fdc2e924e39b8a96205ee5adc40 [id=dc99b341dea243b9aa707fb2ba807db9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.482184 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dbde45980c4f2b8d6bee05416fa2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.483645 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6507c22f6b464474a97953cee8978d22" } new_table_name: "default.Table_5b53b579079e4a1e9dbbb6cdcf198434" modify_external_catalogs: true
I20260505 20:13:22.485770 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 47de1578fdd74a198c48606aec33880a (DEFAULT_TABLE table=default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.486176 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47de1578fdd74a198c48606aec33880a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.486626 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9b375a4bbec4527af704aa6cd08acec has no consensus state
I20260505 20:13:22.487506 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8f5799bc8b2b4f39b309936338cbe0fa" } modify_external_catalogs: true
I20260505 20:13:22.487682 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8f5799bc8b2b4f39b309936338cbe0fa" } modify_external_catalogs: true
I20260505 20:13:22.488907 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1737b54ebbda4728ac1deda9e7c836dc" } new_table_name: "default.Table_f4773b76a3564290a6bc4a8870c4e836" modify_external_catalogs: true
I20260505 20:13:22.490386 7337 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_6507c22f6b464474a97953cee8978d22 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 1 got 0
I20260505 20:13:22.496464 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 43f656c47c5f46fe811ff64c58972e76 (DEFAULT_TABLE table=default.Table_e2bec7fdd76f4bd7b695c78b0ce063c3 [id=3301fb46a9e340309c987b52bb312f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.497051 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f656c47c5f46fe811ff64c58972e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.497372 8127 raft_consensus.cc:493] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.497512 8127 raft_consensus.cc:515] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.498253 8127 leader_election.cc:290] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:22.498808 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 611bba6267194d058cd08a27cdd2af49 (DEFAULT_TABLE table=default.Table_aecb05072dc5457dab50f3e96887c93e [id=25578717c43d40dfb1999130c1208d98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.499502 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 89f6ba8e4cba410daad729576d876329 (DEFAULT_TABLE table=default.Table_245e946b31e8475f805cdc16988071aa [id=69324a8030d643c68a8d1098bc282fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.500855 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae94d54b26b24d99b0b382fba9f5a542" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:22.500944 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 89f6ba8e4cba410daad729576d876329 (DEFAULT_TABLE table=default.Table_245e946b31e8475f805cdc16988071aa [id=69324a8030d643c68a8d1098bc282fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.501317 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f6ba8e4cba410daad729576d876329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.501641 7870 leader_election.cc:343] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.502151 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 611bba6267194d058cd08a27cdd2af49 (DEFAULT_TABLE table=default.Table_aecb05072dc5457dab50f3e96887c93e [id=25578717c43d40dfb1999130c1208d98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.502712 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f6ba8e4cba410daad729576d876329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.505915 7869 leader_election.cc:343] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: ae94d54b26b24d99b0b382fba9f5a542
I20260505 20:13:22.506038 7869 leader_election.cc:304] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.506520 8127 raft_consensus.cc:2749] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.509554 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611bba6267194d058cd08a27cdd2af49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.515298 8054 tablet_bootstrap.cc:654] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.525997 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 43f656c47c5f46fe811ff64c58972e76 (DEFAULT_TABLE table=default.Table_e2bec7fdd76f4bd7b695c78b0ce063c3 [id=3301fb46a9e340309c987b52bb312f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.526541 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f656c47c5f46fe811ff64c58972e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.527664 8122 raft_consensus.cc:493] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.532516 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 611bba6267194d058cd08a27cdd2af49 (DEFAULT_TABLE table=default.Table_aecb05072dc5457dab50f3e96887c93e [id=25578717c43d40dfb1999130c1208d98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.532986 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611bba6267194d058cd08a27cdd2af49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.534972 8052 ts_tablet_manager.cc:1929] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.535137 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611bba6267194d058cd08a27cdd2af49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.535274 8052 log.cc:1199] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/42f7886e6b054f458f1d0f02f3e555b0
I20260505 20:13:22.535019 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 43f656c47c5f46fe811ff64c58972e76 (DEFAULT_TABLE table=default.Table_e2bec7fdd76f4bd7b695c78b0ce063c3 [id=3301fb46a9e340309c987b52bb312f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.537268 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 47de1578fdd74a198c48606aec33880a (DEFAULT_TABLE table=default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.538079 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8af906f570a04b668c8696817739a412
I20260505 20:13:22.538645 7336 catalog_manager.cc:6741] ReplaceTablet: tablet 8af906f570a04b668c8696817739a412 deleted and replaced by tablet ca8329b75b6946d08337c1cfbe49623b
I20260505 20:13:22.538978 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6d0efc4c31774452a20d42a0135965e0" } modify_external_catalogs: true
I20260505 20:13:22.539170 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6d0efc4c31774452a20d42a0135965e0" } modify_external_catalogs: true
I20260505 20:13:22.539254 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 89f6ba8e4cba410daad729576d876329 (DEFAULT_TABLE table=default.Table_245e946b31e8475f805cdc16988071aa [id=69324a8030d643c68a8d1098bc282fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.540427 8122 raft_consensus.cc:515] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.540638 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 43052ededdae41878a6190334d5a965e
I20260505 20:13:22.541086 7338 catalog_manager.cc:6741] ReplaceTablet: tablet 43052ededdae41878a6190334d5a965e deleted and replaced by tablet 9e8d5190032443d4bf6fdb83a34fabd8
I20260505 20:13:22.541226 8122 leader_election.cc:290] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.541399 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1e208cbf87594a0288a8c70a5d2e476e" } modify_external_catalogs: true
I20260505 20:13:22.541560 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1e208cbf87594a0288a8c70a5d2e476e" } modify_external_catalogs: true
I20260505 20:13:22.541725 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47de1578fdd74a198c48606aec33880a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.541841 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855691b4c37f42bfbfc665bb6a712092" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.542405 7736 leader_election.cc:343] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.543752 7335 master_service.cc:954] ReplaceTablet: received request to replace tablet 96a4a2fef35c4b9bb68edca0fb2dd127 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.544255 8054 tablet_bootstrap.cc:492] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.544396 8054 ts_tablet_manager.cc:1403] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.083s user 0.001s sys 0.002s
I20260505 20:13:22.545209 8054 raft_consensus.cc:359] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.545410 8054 raft_consensus.cc:385] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.545509 8054 raft_consensus.cc:740] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.545794 8054 consensus_queue.cc:260] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:22.545974 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e8d5190032443d4bf6fdb83a34fabd8 has no consensus state
I20260505 20:13:22.546334 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7f774c4256454a39904f5517cbcd9d9f" } modify_external_catalogs: true
I20260505 20:13:22.546566 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7f774c4256454a39904f5517cbcd9d9f" } modify_external_catalogs: true
I20260505 20:13:22.546891 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f656c47c5f46fe811ff64c58972e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.547776 8054 ts_tablet_manager.cc:1434] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:22.548061 8054 tablet_bootstrap.cc:492] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.548828 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f6ba8e4cba410daad729576d876329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.549176 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_528b585197824127a1f24d4f16e3f840"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.549803 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_528b585197824127a1f24d4f16e3f840 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.550202 8054 tablet_bootstrap.cc:654] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.552933 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet 43052ededdae41878a6190334d5a965e with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8d5190032443d4bf6fdb83a34fabd8) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.553125 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 8af906f570a04b668c8696817739a412 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8329b75b6946d08337c1cfbe49623b) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:22.553282 7737 leader_election.cc:343] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 855691b4c37f42bfbfc665bb6a712092
I20260505 20:13:22.553426 7737 leader_election.cc:304] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.554060 8122 raft_consensus.cc:2749] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.558174 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.558424 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.558642 8050 tablet_replica.cc:333] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.558840 8050 raft_consensus.cc:2243] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.558991 8050 raft_consensus.cc:2272] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.559911 8050 ts_tablet_manager.cc:1916] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.560372 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 0138b762a0c74ecda3b43167dd5bfc04
I20260505 20:13:22.564965 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 8af906f570a04b668c8696817739a412 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8329b75b6946d08337c1cfbe49623b) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.565559 7333 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_6507c22f6b464474a97953cee8978d22 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 1 got 0
I20260505 20:13:22.566030 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 43052ededdae41878a6190334d5a965e with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8d5190032443d4bf6fdb83a34fabd8) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.566872 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_901be6cdffc546c09f6cdde630e17f3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.567485 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_901be6cdffc546c09f6cdde630e17f3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.567512 8050 ts_tablet_manager.cc:1929] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.567762 8050 log.cc:1199] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/42f7886e6b054f458f1d0f02f3e555b0
I20260505 20:13:22.568223 8050 ts_tablet_manager.cc:1950] T 42f7886e6b054f458f1d0f02f3e555b0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:22.568830 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cbb29bc765d476cb4634178f2806c10 has no consensus state
I20260505 20:13:22.569248 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1bfd0f2780b54332816e770c0a339b9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.569613 8050 tablet_replica.cc:333] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.569854 8050 raft_consensus.cc:2243] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.570086 8050 raft_consensus.cc:2272] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.570518 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_87d54561ed754d9b83ec983b110c6899" } modify_external_catalogs: true
I20260505 20:13:22.570693 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_87d54561ed754d9b83ec983b110c6899" } modify_external_catalogs: true
I20260505 20:13:22.571027 8052 ts_tablet_manager.cc:1950] T 42f7886e6b054f458f1d0f02f3e555b0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.571084 8050 ts_tablet_manager.cc:1916] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.572028 8052 tablet_replica.cc:333] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.571992 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f4365ce42d9d4cc4ae2eb1fbff18d439" } new_table_name: "default.Table_366c60e571684325a5f3c6bf45c40753" modify_external_catalogs: true
I20260505 20:13:22.573832 8052 raft_consensus.cc:2243] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.573985 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet 15e64ed9bb7c44219dac4a36bfbec24f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.574023 8052 raft_consensus.cc:2272] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.574700 8054 tablet_bootstrap.cc:492] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.574859 8054 ts_tablet_manager.cc:1403] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260505 20:13:22.575515 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 42f7886e6b054f458f1d0f02f3e555b0 (table default.Table_dbd33bbe5ad9434fab311cf8991dd607 [id=e3793cfcbb3b4d21935d71682a3834b8]) successfully deleted
I20260505 20:13:22.575740 8054 raft_consensus.cc:359] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.575948 8054 raft_consensus.cc:385] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.576033 8054 raft_consensus.cc:740] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.576319 8054 consensus_queue.cc:260] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.577633 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.578151 8052 ts_tablet_manager.cc:1916] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.579636 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 42f7886e6b054f458f1d0f02f3e555b0 (table default.Table_dbd33bbe5ad9434fab311cf8991dd607 [id=e3793cfcbb3b4d21935d71682a3834b8]) successfully deleted
I20260505 20:13:22.580013 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc05b2d65594e16abee960ad3c7721a with delete_type TABLET_DATA_DELETED (replaced by tablet 5a809fab787b48e29ff5901791fd3e0d) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.580242 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet c552895eb36e49cfba7ad18ff462dba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9146142e112e43a7a6ce0369122d5a46) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.580431 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.581065 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:22.581632 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bfd0f2780b54332816e770c0a339b9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.581692 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:22.581892 7736 consensus_peers.cc:597] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:22.582842 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 43052ededdae41878a6190334d5a965e with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8d5190032443d4bf6fdb83a34fabd8) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:22.583557 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 43052ededdae41878a6190334d5a965e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43052ededdae41878a6190334d5a965e already in progress: creating tablet
I20260505 20:13:22.583588 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.584877 7936 raft_consensus.cc:1275] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:22.585546 8050 ts_tablet_manager.cc:1929] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.585656 8050 log.cc:1199] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/d7e47c72827941cca40d20725e0100de
I20260505 20:13:22.586519 8050 ts_tablet_manager.cc:1950] T d7e47c72827941cca40d20725e0100de P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.586651 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 8af906f570a04b668c8696817739a412 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8329b75b6946d08337c1cfbe49623b) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:22.587393 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8af906f570a04b668c8696817739a412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af906f570a04b668c8696817739a412 already in progress: creating tablet
W20260505 20:13:22.587750 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 0138b762a0c74ecda3b43167dd5bfc04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0138b762a0c74ecda3b43167dd5bfc04 already in progress: creating tablet
I20260505 20:13:22.588654 8054 ts_tablet_manager.cc:1434] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260505 20:13:22.588887 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet d7e47c72827941cca40d20725e0100de (table default.Table_2329990d33d941799ae7ae7cbb3c3493 [id=9016406a2de74726b20ec5215d2d94d3]) successfully deleted
I20260505 20:13:22.588428 8058 ts_tablet_manager.cc:1434] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.151s user 0.002s sys 0.000s
I20260505 20:13:22.590404 8054 tablet_bootstrap.cc:492] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:22.591442 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8af906f570a04b668c8696817739a412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af906f570a04b668c8696817739a412 already in progress: creating tablet
I20260505 20:13:22.588337 8064 consensus_queue.cc:1048] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260505 20:13:22.591254 8058 tablet_bootstrap.cc:492] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.593068 8050 tablet_replica.cc:333] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.593796 8058 tablet_bootstrap.cc:654] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.595239 8050 raft_consensus.cc:2243] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:22.595297 8052 ts_tablet_manager.cc:1929] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.595440 8052 log.cc:1199] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/bffa53ec02b34d408f3a8b4f45299c57
I20260505 20:13:22.596578 8064 raft_consensus.cc:493] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.596750 8064 raft_consensus.cc:515] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.593560 8054 tablet_bootstrap.cc:654] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.597466 8064 leader_election.cc:290] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.597700 8050 pending_rounds.cc:70] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:22.597890 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c187c7931645429b9c89b92b890c8bba" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.598394 7736 leader_election.cc:343] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:22.598567 7737 leader_election.cc:343] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c187c7931645429b9c89b92b890c8bba
I20260505 20:13:22.598695 7737 leader_election.cc:304] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.598968 8064 raft_consensus.cc:2749] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.599306 8050 pending_rounds.cc:77] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737161715851264 op_type: NO_OP noop_request { }
I20260505 20:13:22.599718 8050 raft_consensus.cc:2889] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:22.600077 8050 raft_consensus.cc:2272] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.601220 8113 mvcc.cc:204] Tried to move back new op lower bound from 7282737162561228800 to 7282737161203396608. Current Snapshot: MvccSnapshot[applied={T|T < 7282737162561228800}]
I20260505 20:13:22.601666 8121 tablet.cc:1724] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:22.607959 8052 ts_tablet_manager.cc:1950] T bffa53ec02b34d408f3a8b4f45299c57 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.609045 8052 tablet_replica.cc:333] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.609257 8052 raft_consensus.cc:2243] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.609462 8052 raft_consensus.cc:2272] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.610386 7336 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet ca8329b75b6946d08337c1cfbe49623b
I20260505 20:13:22.612056 8052 ts_tablet_manager.cc:1916] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.612510 7336 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_5b53b579079e4a1e9dbbb6cdcf198434 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 2 got 0
I20260505 20:13:22.618603 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e32780089f084e57ab07a222e1353eff
I20260505 20:13:22.619516 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d533f0e3c58043698845036dc6f256d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.620206 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d533f0e3c58043698845036dc6f256d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.622434 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet bffa53ec02b34d408f3a8b4f45299c57 (table default.Table_9e1bb2a23514497b9dd3580f1479a03c [id=0a0faede033d4425b6e1389b4e5d9f65]) successfully deleted
I20260505 20:13:22.619994 8140 tablet.cc:1724] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:22.622882 8054 tablet_bootstrap.cc:492] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.623513 8054 ts_tablet_manager.cc:1403] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.004s
I20260505 20:13:22.624922 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet be214aeb495244a6b58f761c01b7faa5 with delete_type TABLET_DATA_DELETED (replaced by tablet 02eafc72ff7d4055b424322e01dc0c84) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.624996 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet e32780089f084e57ab07a222e1353eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.624404 8054 raft_consensus.cc:359] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.625430 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet e32780089f084e57ab07a222e1353eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.625490 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet e32780089f084e57ab07a222e1353eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.625659 8054 raft_consensus.cc:385] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.625845 8054 raft_consensus.cc:740] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:22.626150 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e32780089f084e57ab07a222e1353eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32780089f084e57ab07a222e1353eff already in progress: creating tablet
I20260505 20:13:22.626159 8054 consensus_queue.cc:260] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.627817 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.628003 8054 ts_tablet_manager.cc:1434] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:22.628362 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet be214aeb495244a6b58f761c01b7faa5 with delete_type TABLET_DATA_DELETED (replaced by tablet 02eafc72ff7d4055b424322e01dc0c84) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.628991 8054 tablet_bootstrap.cc:492] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.629035 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.629768 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc05b2d65594e16abee960ad3c7721a with delete_type TABLET_DATA_DELETED (replaced by tablet 5a809fab787b48e29ff5901791fd3e0d) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.630453 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet edceecc7eee4477a869acce495aade1c with delete_type TABLET_DATA_DELETED (replaced by tablet de9b7c48be9042a19958c09941c2e429) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.631109 8054 tablet_bootstrap.cc:654] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.632735 8050 ts_tablet_manager.cc:1916] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.633028 8052 ts_tablet_manager.cc:1929] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.633158 8052 log.cc:1199] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c187c7931645429b9c89b92b890c8bba
I20260505 20:13:22.633673 8052 ts_tablet_manager.cc:1950] T c187c7931645429b9c89b92b890c8bba P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.634878 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c187c7931645429b9c89b92b890c8bba (table default.Table_d5b8d6121e234d70939c2432a603ff18 [id=5ba2ee85cb9147399567f608a97458ad]) successfully deleted
I20260505 20:13:22.641378 8050 ts_tablet_manager.cc:1929] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:22.642182 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 96a4a2fef35c4b9bb68edca0fb2dd127
I20260505 20:13:22.642594 8054 tablet_bootstrap.cc:492] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.642771 7335 catalog_manager.cc:6741] ReplaceTablet: tablet 96a4a2fef35c4b9bb68edca0fb2dd127 deleted and replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:22.642939 8054 ts_tablet_manager.cc:1403] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260505 20:13:22.643204 8052 tablet_replica.cc:333] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.643442 8052 raft_consensus.cc:2243] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:22.643927 8054 raft_consensus.cc:359] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.644222 8054 raft_consensus.cc:385] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.644378 8054 raft_consensus.cc:740] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.644726 8054 consensus_queue.cc:260] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.646088 8052 raft_consensus.cc:2272] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.646212 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8824bed6d2e9411d86651dfcffa77718
I20260505 20:13:22.646704 8054 ts_tablet_manager.cc:1434] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:22.647006 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_65f1198f03024f6182354be70b9abe9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.647208 8054 tablet_bootstrap.cc:492] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.647308 8052 ts_tablet_manager.cc:1916] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:22.647624 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65f1198f03024f6182354be70b9abe9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.648960 8050 log.cc:1199] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/43052ededdae41878a6190334d5a965e
I20260505 20:13:22.649266 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_cfe51d65e3714a898d30eb1ee2551e7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.649899 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfe51d65e3714a898d30eb1ee2551e7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.650064 8050 ts_tablet_manager.cc:1950] T 43052ededdae41878a6190334d5a965e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.651285 8054 tablet_bootstrap.cc:654] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.651767 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 78edaee6c4e946b1a7c7302d20aa5d7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78edaee6c4e946b1a7c7302d20aa5d7d already in progress: creating tablet
W20260505 20:13:22.652015 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet acd0f0fba5284283b472d6ddd1fcd69c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acd0f0fba5284283b472d6ddd1fcd69c already in progress: creating tablet
I20260505 20:13:22.652056 8050 tablet_replica.cc:333] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.652335 8050 raft_consensus.cc:2243] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.652704 7774 tablet_service.cc:1558] Processing DeleteTablet for tablet 8824bed6d2e9411d86651dfcffa77718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.652949 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 with delete_type TABLET_DATA_DELETED (replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.653326 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 43052ededdae41878a6190334d5a965e (table default.Table_0e377ae2a3924b33ada3c0ce8495101d [id=74178f7425164618bd69a1653b75e5d1]) successfully deleted
I20260505 20:13:22.653654 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 with delete_type TABLET_DATA_DELETED (replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.653932 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 8824bed6d2e9411d86651dfcffa77718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.653584 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 with delete_type TABLET_DATA_DELETED (replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.653723 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 8824bed6d2e9411d86651dfcffa77718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.654655 8050 raft_consensus.cc:2272] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.655424 8050 ts_tablet_manager.cc:1916] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:22.655812 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a4a2fef35c4b9bb68edca0fb2dd127 already in progress: creating tablet
W20260505 20:13:22.656160 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8824bed6d2e9411d86651dfcffa77718 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8824bed6d2e9411d86651dfcffa77718 already in progress: creating tablet
I20260505 20:13:22.658639 8058 tablet_bootstrap.cc:492] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.658839 8058 ts_tablet_manager.cc:1403] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.000s
I20260505 20:13:22.659682 8058 raft_consensus.cc:359] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.659914 8058 raft_consensus.cc:385] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.660032 8058 raft_consensus.cc:740] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.660285 8058 consensus_queue.cc:260] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.662238 8079 raft_consensus.cc:493] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.662410 8058 ts_tablet_manager.cc:1434] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:22.662482 8079 raft_consensus.cc:515] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.662732 8058 tablet_bootstrap.cc:492] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.664541 8079 leader_election.cc:290] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.664707 8058 tablet_bootstrap.cc:654] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.666963 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8f812ed4658e43018df5551d9bbe2e2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.667652 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f812ed4658e43018df5551d9bbe2e2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.670612 8052 ts_tablet_manager.cc:1929] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:22.670785 8052 log.cc:1199] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f8af8c7fa9554353a61594c4e426ef2f
I20260505 20:13:22.671195 8052 ts_tablet_manager.cc:1950] T f8af8c7fa9554353a61594c4e426ef2f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.672204 8052 tablet_replica.cc:333] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.672382 8052 raft_consensus.cc:2243] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:22.672410 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 725cb481751048c29695726011c80c08 has no consensus state
I20260505 20:13:22.672616 8052 raft_consensus.cc:2272] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.672896 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_aef313ad65fe4481a016b5b6f222270a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.673558 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef313ad65fe4481a016b5b6f222270a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.675058 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 15e64ed9bb7c44219dac4a36bfbec24f
I20260505 20:13:22.675639 7337 catalog_manager.cc:6741] ReplaceTablet: tablet 15e64ed9bb7c44219dac4a36bfbec24f deleted and replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2
I20260505 20:13:22.676056 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c8694c481ad84d5099a1ba7bab8a7557"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.676412 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f with delete_type TABLET_DATA_DELETED (replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:22.676497 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8694c481ad84d5099a1ba7bab8a7557 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.676878 8054 tablet_bootstrap.cc:492] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.677027 8054 ts_tablet_manager.cc:1403] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.001s
W20260505 20:13:22.677070 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 15e64ed9bb7c44219dac4a36bfbec24f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15e64ed9bb7c44219dac4a36bfbec24f already in progress: creating tablet
I20260505 20:13:22.678107 8054 raft_consensus.cc:359] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.678393 8054 raft_consensus.cc:385] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.678539 8054 raft_consensus.cc:740] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.678861 8054 consensus_queue.cc:260] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.678958 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f with delete_type TABLET_DATA_DELETED (replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.680254 8052 ts_tablet_manager.cc:1916] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.680754 8064 raft_consensus.cc:493] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.680917 8064 raft_consensus.cc:515] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.681582 8064 leader_election.cc:290] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.681846 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f with delete_type TABLET_DATA_DELETED (replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.682426 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f8af8c7fa9554353a61594c4e426ef2f (table default.Table_7b1092ae7f0e4eeabbf11dee1c003bcd [id=680c74a223d54940afd6e814558bf4ae]) successfully deleted
I20260505 20:13:22.682464 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be214aeb495244a6b58f761c01b7faa5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.683003 7736 leader_election.cc:343] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.683221 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be214aeb495244a6b58f761c01b7faa5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:22.683429 7936 raft_consensus.cc:2468] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:22.683877 7737 leader_election.cc:304] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.684312 8064 raft_consensus.cc:2804] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:22.684427 8064 raft_consensus.cc:493] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:22.684566 8064 raft_consensus.cc:3060] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:22.687988 8064 raft_consensus.cc:515] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.688720 8064 leader_election.cc:290] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.689126 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be214aeb495244a6b58f761c01b7faa5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:22.689771 7736 leader_election.cc:343] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.690601 8058 tablet_bootstrap.cc:492] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.690825 8058 ts_tablet_manager.cc:1403] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.004s
I20260505 20:13:22.691918 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be214aeb495244a6b58f761c01b7faa5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:22.691885 8058 raft_consensus.cc:359] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.692178 7936 raft_consensus.cc:3060] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:22.692193 8058 raft_consensus.cc:385] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.692338 8058 raft_consensus.cc:740] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.692651 8058 consensus_queue.cc:260] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.694948 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1884e1306ae4aac9d599a93775c5d8d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:22.695001 7936 raft_consensus.cc:2468] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:22.695300 8054 ts_tablet_manager.cc:1434] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260505 20:13:22.695493 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.695685 8054 tablet_bootstrap.cc:492] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.695808 8051 tablet_replica.cc:333] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.696038 8051 raft_consensus.cc:2243] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.696213 7737 leader_election.cc:304] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.696687 8064 raft_consensus.cc:2804] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:22.697937 8064 raft_consensus.cc:697] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:22.698212 8064 consensus_queue.cc:237] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.699972 8051 raft_consensus.cc:2272] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.700838 8051 ts_tablet_manager.cc:1916] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.703212 8054 tablet_bootstrap.cc:654] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.707552 8051 ts_tablet_manager.cc:1929] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.707708 8051 log.cc:1199] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/8b6cb875a42d4f16904e2d5bf62c1d0d
I20260505 20:13:22.708048 8051 ts_tablet_manager.cc:1950] T 8b6cb875a42d4f16904e2d5bf62c1d0d P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.708295 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 40dfb8da73284065a3d97df18a738dc4
I20260505 20:13:22.710312 8058 ts_tablet_manager.cc:1434] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260505 20:13:22.710762 8058 tablet_bootstrap.cc:492] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.711447 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 8b6cb875a42d4f16904e2d5bf62c1d0d (table default.Table_847b5f4e43624ef6a4d94ea0c4f586b4 [id=3d33e35a14b9400593605d46763f73c2]) successfully deleted
I20260505 20:13:22.713677 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1884e1306ae4aac9d599a93775c5d8d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:22.713945 8050 ts_tablet_manager.cc:1929] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.714363 7598 leader_election.cc:304] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:22.715260 8079 raft_consensus.cc:2749] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.719129 8058 tablet_bootstrap.cc:654] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.719879 8050 log.cc:1199] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/5fc05b2d65594e16abee960ad3c7721a
I20260505 20:13:22.719880 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_29001463734546aca853e3e6b2df78a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.720285 8050 ts_tablet_manager.cc:1950] T 5fc05b2d65594e16abee960ad3c7721a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.720959 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5b53b579079e4a1e9dbbb6cdcf198434" } new_table_name: "default.Table_bbfb07ee69c44ed680d5e4709cd7ee63" modify_external_catalogs: true
I20260505 20:13:22.721418 8050 tablet_replica.cc:333] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.722919 8050 raft_consensus.cc:2243] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.723147 8050 raft_consensus.cc:2272] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.723903 8050 ts_tablet_manager.cc:1916] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.721689 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 5fc05b2d65594e16abee960ad3c7721a (table default.Table_c738b338e02745d989d767b3cf2954a8 [id=cf0b5ed94ed2455a9251be84a2ef204e]) successfully deleted
I20260505 20:13:22.724928 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 855691b4c37f42bfbfc665bb6a712092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.725215 8051 tablet_replica.cc:333] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.725607 8051 raft_consensus.cc:2243] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.725852 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 40dfb8da73284065a3d97df18a738dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.726001 8051 raft_consensus.cc:2272] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.726404 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 40dfb8da73284065a3d97df18a738dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.726683 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 40dfb8da73284065a3d97df18a738dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.727416 8051 ts_tablet_manager.cc:1916] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.727425 8052 ts_tablet_manager.cc:1929] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.727603 8052 log.cc:1199] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/43052ededdae41878a6190334d5a965e
I20260505 20:13:22.728004 8052 ts_tablet_manager.cc:1950] T 43052ededdae41878a6190334d5a965e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.730340 7336 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_5b53b579079e4a1e9dbbb6cdcf198434 [id=db04ad55e6964d88bb71e0eab4cc4f65] alter complete (version 2)
I20260505 20:13:22.730937 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 43052ededdae41878a6190334d5a965e (table default.Table_0e377ae2a3924b33ada3c0ce8495101d [id=74178f7425164618bd69a1653b75e5d1]) successfully deleted
I20260505 20:13:22.732779 8052 tablet_replica.cc:333] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.732995 8052 raft_consensus.cc:2243] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.733170 8052 raft_consensus.cc:2272] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.735414 8052 ts_tablet_manager.cc:1916] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:22.735613 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 0138b762a0c74ecda3b43167dd5bfc04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0138b762a0c74ecda3b43167dd5bfc04 already in progress: creating tablet
W20260505 20:13:22.735858 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e32780089f084e57ab07a222e1353eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32780089f084e57ab07a222e1353eff already in progress: creating tablet
W20260505 20:13:22.737401 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29001463734546aca853e3e6b2df78a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.738714 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.739434 8050 ts_tablet_manager.cc:1929] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.739925 8051 ts_tablet_manager.cc:1929] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.740042 8053 tablet_bootstrap.cc:492] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.740206 8053 ts_tablet_manager.cc:1403] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.305s user 0.052s sys 0.065s
I20260505 20:13:22.740235 8051 log.cc:1199] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/855691b4c37f42bfbfc665bb6a712092
I20260505 20:13:22.740906 8051 ts_tablet_manager.cc:1950] T 855691b4c37f42bfbfc665bb6a712092 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.741109 8053 raft_consensus.cc:359] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.741328 8053 raft_consensus.cc:385] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.741434 8053 raft_consensus.cc:740] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.741711 8053 consensus_queue.cc:260] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.742832 8053 ts_tablet_manager.cc:1434] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:22.743134 8053 tablet_bootstrap.cc:492] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.744431 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 855691b4c37f42bfbfc665bb6a712092 (table default.Table_21bf596b95564f88b8d7e20935fa66ba [id=1362ad2a11fd427d814566441a09dec3]) successfully deleted
W20260505 20:13:22.745733 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 40dfb8da73284065a3d97df18a738dc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40dfb8da73284065a3d97df18a738dc4 already in progress: creating tablet
W20260505 20:13:22.746384 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8b6cb875a42d4f16904e2d5bf62c1d0d because the tablet was not found. No further retry: Not found: Tablet not found: 8b6cb875a42d4f16904e2d5bf62c1d0d
I20260505 20:13:22.746531 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 8af906f570a04b668c8696817739a412 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.748466 8050 log.cc:1199] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c552895eb36e49cfba7ad18ff462dba1
I20260505 20:13:22.749132 8050 ts_tablet_manager.cc:1950] T c552895eb36e49cfba7ad18ff462dba1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:22.749673 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cff6727e6bcd4190ac7c0cf6c82bc3de" } new_table_name: "default.Table_3cdc5e88c3e742b5a633a8b309333e31" modify_external_catalogs: true
I20260505 20:13:22.751340 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c552895eb36e49cfba7ad18ff462dba1 (table default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]) successfully deleted
I20260505 20:13:22.751626 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet de9b7c48be9042a19958c09941c2e429 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.751924 8050 tablet_replica.cc:333] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:22.752313 8050 raft_consensus.cc:2243] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.752799 8050 raft_consensus.cc:2272] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.754755 8053 tablet_bootstrap.cc:654] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.758705 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 56b775db329949bcbab3fd81c75e951d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.760298 8050 ts_tablet_manager.cc:1916] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.764245 8052 ts_tablet_manager.cc:1929] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.764400 8052 log.cc:1199] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/855691b4c37f42bfbfc665bb6a712092
I20260505 20:13:22.764410 8054 tablet_bootstrap.cc:492] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.764586 8054 ts_tablet_manager.cc:1403] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.011s sys 0.001s
I20260505 20:13:22.764751 8052 ts_tablet_manager.cc:1950] T 855691b4c37f42bfbfc665bb6a712092 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.765525 8054 raft_consensus.cc:359] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.765792 8054 raft_consensus.cc:385] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.765880 8054 raft_consensus.cc:740] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.766119 8054 consensus_queue.cc:260] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.766628 8054 ts_tablet_manager.cc:1434] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:22.768831 8058 tablet_bootstrap.cc:492] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.769043 8058 ts_tablet_manager.cc:1403] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.017s
I20260505 20:13:22.769410 8127 raft_consensus.cc:493] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.769538 8127 raft_consensus.cc:515] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.770079 8054 tablet_bootstrap.cc:492] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.770222 8127 leader_election.cc:290] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:22.771281 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dfb8da73284065a3d97df18a738dc4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:22.771936 7870 leader_election.cc:343] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.772011 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 855691b4c37f42bfbfc665bb6a712092 (table default.Table_21bf596b95564f88b8d7e20935fa66ba [id=1362ad2a11fd427d814566441a09dec3]) successfully deleted
I20260505 20:13:22.772873 8054 tablet_bootstrap.cc:654] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.772791 8058 raft_consensus.cc:359] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.773180 8058 raft_consensus.cc:385] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.773331 8058 raft_consensus.cc:740] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.773640 8058 consensus_queue.cc:260] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.775175 8058 ts_tablet_manager.cc:1434] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:22.775547 8058 tablet_bootstrap.cc:492] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:22.776598 8052 tablet_replica.cc:333] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.776793 8052 raft_consensus.cc:2243] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:22.777055 8052 pending_rounds.cc:70] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:22.777256 8052 pending_rounds.cc:77] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737163056840704 op_type: NO_OP noop_request { }
I20260505 20:13:22.777413 8052 raft_consensus.cc:2889] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:22.777532 8052 raft_consensus.cc:2272] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.778254 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40dfb8da73284065a3d97df18a738dc4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:22.778419 8058 tablet_bootstrap.cc:654] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.778815 7869 leader_election.cc:343] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.778944 7869 leader_election.cc:304] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:22.779326 8127 raft_consensus.cc:2749] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:22.782974 8052 ts_tablet_manager.cc:1916] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.787657 8053 tablet_bootstrap.cc:492] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.787830 8053 ts_tablet_manager.cc:1403] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.001s
I20260505 20:13:22.788592 8054 tablet_bootstrap.cc:492] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.788791 8054 ts_tablet_manager.cc:1403] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260505 20:13:22.789029 8053 raft_consensus.cc:359] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.789265 8053 raft_consensus.cc:385] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.789350 8053 raft_consensus.cc:740] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.789628 8053 consensus_queue.cc:260] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.789933 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 5fc05b2d65594e16abee960ad3c7721a from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.790591 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_76b9386a48e94edcabaf5284ccf85588" } modify_external_catalogs: true
I20260505 20:13:22.790771 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_76b9386a48e94edcabaf5284ccf85588" } modify_external_catalogs: true
I20260505 20:13:22.791186 8053 ts_tablet_manager.cc:1434] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:22.790355 8054 raft_consensus.cc:359] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.791538 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ce9ec72e24eb4a94888f70a816c84df0" } new_table_name: "default.Table_c538874d901d449d9490a324fdc484a3" modify_external_catalogs: true
I20260505 20:13:22.791687 8054 raft_consensus.cc:385] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.791772 8054 raft_consensus.cc:740] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.791967 8054 consensus_queue.cc:260] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.792570 8054 ts_tablet_manager.cc:1434] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:22.792930 8054 tablet_bootstrap.cc:492] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.793111 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2dd912da5ad54a6fb5b2b20cc24b2b9f" } new_table_name: "default.Table_6168f9d927844aadaca4cf743d95c088" modify_external_catalogs: true
I20260505 20:13:22.793203 8053 tablet_bootstrap.cc:492] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.795094 8053 tablet_bootstrap.cc:654] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.795487 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46a5d46461b746be9fc29431e972b7b7 has no consensus state
I20260505 20:13:22.795835 8054 tablet_bootstrap.cc:654] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.796099 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet bffa53ec02b34d408f3a8b4f45299c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.797735 8051 tablet_replica.cc:333] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.797961 8051 raft_consensus.cc:2243] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.798141 8051 raft_consensus.cc:2272] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.798273 8052 ts_tablet_manager.cc:1929] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:22.798429 8052 log.cc:1199] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/be214aeb495244a6b58f761c01b7faa5
I20260505 20:13:22.798851 8052 ts_tablet_manager.cc:1950] T be214aeb495244a6b58f761c01b7faa5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.800208 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet be214aeb495244a6b58f761c01b7faa5 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]) successfully deleted
I20260505 20:13:22.803977 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 46a5d46461b746be9fc29431e972b7b7 (DEFAULT_TABLE table=default.Table_3cdc5e88c3e742b5a633a8b309333e31 [id=f6758da8ac8e49a5b06230e1dcb75c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.804483 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a5d46461b746be9fc29431e972b7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.805078 8052 tablet_replica.cc:333] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.805387 8052 raft_consensus.cc:2243] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.805611 8053 tablet_bootstrap.cc:492] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.805924 8053 ts_tablet_manager.cc:1403] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260505 20:13:22.806157 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 (DEFAULT_TABLE table=default.Table_76b9386a48e94edcabaf5284ccf85588 [id=8c02c85d53eb4657a278fdc32a92d258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.806565 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c8328c49347bf8b15d58cb5380fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.806756 8053 raft_consensus.cc:359] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.806926 8053 raft_consensus.cc:385] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.807001 8053 raft_consensus.cc:740] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.805696 8052 raft_consensus.cc:2272] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.807205 8053 consensus_queue.cc:260] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.807827 8052 ts_tablet_manager.cc:1916] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.809932 8053 ts_tablet_manager.cc:1434] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260505 20:13:22.810961 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d (DEFAULT_TABLE table=default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.811404 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.812168 8053 tablet_bootstrap.cc:492] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.815138 8058 tablet_bootstrap.cc:492] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.814549 8054 tablet_bootstrap.cc:492] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:22.815459 8054 ts_tablet_manager.cc:1403] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20260505 20:13:22.815788 8058 ts_tablet_manager.cc:1403] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.000s
I20260505 20:13:22.816195 8054 raft_consensus.cc:359] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.816373 8054 raft_consensus.cc:385] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.816440 8054 raft_consensus.cc:740] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.816663 8054 consensus_queue.cc:260] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.816664 8058 raft_consensus.cc:359] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.816841 8058 raft_consensus.cc:385] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.817245 8054 ts_tablet_manager.cc:1434] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:22.817545 8054 tablet_bootstrap.cc:492] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:22.816910 8058 raft_consensus.cc:740] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.818588 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d (DEFAULT_TABLE table=default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.818972 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.820318 8052 ts_tablet_manager.cc:1929] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.820443 8052 log.cc:1199] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:22.820377 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_50fe331fc2b042a59cbe8680d748f55d" } modify_external_catalogs: true
I20260505 20:13:22.820585 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_50fe331fc2b042a59cbe8680d748f55d" } modify_external_catalogs: true
I20260505 20:13:22.820820 8052 ts_tablet_manager.cc:1950] T 38bc883c8e98495882e4d8ef68c9da80 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.821426 8054 tablet_bootstrap.cc:654] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.821692 8053 tablet_bootstrap.cc:654] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.822067 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 46a5d46461b746be9fc29431e972b7b7 (DEFAULT_TABLE table=default.Table_3cdc5e88c3e742b5a633a8b309333e31 [id=f6758da8ac8e49a5b06230e1dcb75c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.822485 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a5d46461b746be9fc29431e972b7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.822528 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_29001463734546aca853e3e6b2df78a1" } modify_external_catalogs: true
I20260505 20:13:22.822686 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_29001463734546aca853e3e6b2df78a1" } modify_external_catalogs: true
I20260505 20:13:22.825699 8052 tablet_replica.cc:333] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.826020 8052 raft_consensus.cc:2243] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.826068 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 (DEFAULT_TABLE table=default.Table_76b9386a48e94edcabaf5284ccf85588 [id=8c02c85d53eb4657a278fdc32a92d258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.826203 8052 raft_consensus.cc:2272] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.826431 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c8328c49347bf8b15d58cb5380fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.827644 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d (DEFAULT_TABLE table=default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.828033 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.828208 8052 ts_tablet_manager.cc:1916] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.828591 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 (DEFAULT_TABLE table=default.Table_76b9386a48e94edcabaf5284ccf85588 [id=8c02c85d53eb4657a278fdc32a92d258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.828925 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c8328c49347bf8b15d58cb5380fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.830456 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 46a5d46461b746be9fc29431e972b7b7 (DEFAULT_TABLE table=default.Table_3cdc5e88c3e742b5a633a8b309333e31 [id=f6758da8ac8e49a5b06230e1dcb75c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.830812 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a5d46461b746be9fc29431e972b7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.831152 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 9146142e112e43a7a6ce0369122d5a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.837808 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 38bc883c8e98495882e4d8ef68c9da80 (table default.Table_ee6f5cb164d1435ba5955ac615e2249b [id=d79f9a116fdb4912b39f530d6f5d43ff]) successfully deleted
I20260505 20:13:22.840854 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet de9b7c48be9042a19958c09941c2e429 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.841091 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 9146142e112e43a7a6ce0369122d5a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:22.842449 8140 tablet.cc:1724] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:22.842501 8121 tablet.cc:1724] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:22.846791 7632 tablet_service.cc:1511] Processing CreateTablet for tablet b9b375a4bbec4527af704aa6cd08acec (DEFAULT_TABLE table=default.Table_ff6f9b07cd9040f9b22cd78b16700030 [id=7e050176e69345a8ba527b6fa0d49da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.847362 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b375a4bbec4527af704aa6cd08acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.852092 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 3e77ec84858a4e46a993c579d9990f1b (DEFAULT_TABLE table=default.Table_55818053abfc4ea0a0cc4ef3f1bab479 [id=0149b0d509e947c4a1523cd8645446da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.852468 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e77ec84858a4e46a993c579d9990f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.818154 8058 consensus_queue.cc:260] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.858924 8058 ts_tablet_manager.cc:1434] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20260505 20:13:22.858829 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e2f7ff55dbf84a6caa6a53aabeb2acb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.859328 8058 tablet_bootstrap.cc:492] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:22.859511 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2f7ff55dbf84a6caa6a53aabeb2acb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.862476 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3cdc5e88c3e742b5a633a8b309333e31" } modify_external_catalogs: true
I20260505 20:13:22.862687 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3cdc5e88c3e742b5a633a8b309333e31" } modify_external_catalogs: true
I20260505 20:13:22.861346 8058 tablet_bootstrap.cc:654] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.865880 7913 tablet_service.cc:1511] Processing CreateTablet for tablet b9b375a4bbec4527af704aa6cd08acec (DEFAULT_TABLE table=default.Table_ff6f9b07cd9040f9b22cd78b16700030 [id=7e050176e69345a8ba527b6fa0d49da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.866369 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b375a4bbec4527af704aa6cd08acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.872893 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 3e77ec84858a4e46a993c579d9990f1b (DEFAULT_TABLE table=default.Table_55818053abfc4ea0a0cc4ef3f1bab479 [id=0149b0d509e947c4a1523cd8645446da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.873337 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e77ec84858a4e46a993c579d9990f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.875259 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 13a4ddebda9447389c15be61aa60baaf (DEFAULT_TABLE table=default.Table_2dd912da5ad54a6fb5b2b20cc24b2b9f [id=41e7773608d34ceb98c40adc9c782d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.875654 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a4ddebda9447389c15be61aa60baaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.876322 7642 tablet_service.cc:1511] Processing CreateTablet for tablet a9719876757e409b991b21410983e3bf (DEFAULT_TABLE table=default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.876761 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9719876757e409b991b21410983e3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.878285 7914 tablet_service.cc:1511] Processing CreateTablet for tablet b4f05cad2989475fa0305e98f562037b (DEFAULT_TABLE table=default.Table_264d0b6fcd884b629f0fb38091195668 [id=f93e310a8d8049bfbeabf22d7fced243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.878641 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f05cad2989475fa0305e98f562037b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.884599 8051 ts_tablet_manager.cc:1916] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.894349 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 13a4ddebda9447389c15be61aa60baaf (DEFAULT_TABLE table=default.Table_2dd912da5ad54a6fb5b2b20cc24b2b9f [id=41e7773608d34ceb98c40adc9c782d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.894670 7780 tablet_service.cc:1511] Processing CreateTablet for tablet b4f05cad2989475fa0305e98f562037b (DEFAULT_TABLE table=default.Table_264d0b6fcd884b629f0fb38091195668 [id=f93e310a8d8049bfbeabf22d7fced243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.894884 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a4ddebda9447389c15be61aa60baaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.895165 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f05cad2989475fa0305e98f562037b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.895284 8064 raft_consensus.cc:493] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:22.895439 8064 raft_consensus.cc:515] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.895824 8051 ts_tablet_manager.cc:1929] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.895961 8051 log.cc:1199] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/bffa53ec02b34d408f3a8b4f45299c57
I20260505 20:13:22.896183 8064 leader_election.cc:290] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:22.896327 8051 ts_tablet_manager.cc:1950] T bffa53ec02b34d408f3a8b4f45299c57 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:22.896833 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 13a4ddebda9447389c15be61aa60baaf (DEFAULT_TABLE table=default.Table_2dd912da5ad54a6fb5b2b20cc24b2b9f [id=41e7773608d34ceb98c40adc9c782d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.896883 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b775db329949bcbab3fd81c75e951d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:22.897219 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a4ddebda9447389c15be61aa60baaf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.897544 7736 leader_election.cc:343] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:22.898033 7635 tablet_service.cc:1511] Processing CreateTablet for tablet b4f05cad2989475fa0305e98f562037b (DEFAULT_TABLE table=default.Table_264d0b6fcd884b629f0fb38091195668 [id=f93e310a8d8049bfbeabf22d7fced243]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.898259 7781 tablet_service.cc:1511] Processing CreateTablet for tablet a9719876757e409b991b21410983e3bf (DEFAULT_TABLE table=default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.898404 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f05cad2989475fa0305e98f562037b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.898782 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9719876757e409b991b21410983e3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.902137 7774 tablet_service.cc:1511] Processing CreateTablet for tablet b9b375a4bbec4527af704aa6cd08acec (DEFAULT_TABLE table=default.Table_ff6f9b07cd9040f9b22cd78b16700030 [id=7e050176e69345a8ba527b6fa0d49da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.903825 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b375a4bbec4527af704aa6cd08acec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.906127 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4400792ceb14f0c9f0f3c23a47b91c2 has no consensus state
I20260505 20:13:22.908562 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet 9146142e112e43a7a6ce0369122d5a46 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.909194 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_381e5521f71b4d388d6643fb24a3bc27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.909693 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_381e5521f71b4d388d6643fb24a3bc27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:22.913355 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13a4ddebda9447389c15be61aa60baaf consensus state has no leader
I20260505 20:13:22.916698 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 56b775db329949bcbab3fd81c75e951d
I20260505 20:13:22.917179 7336 catalog_manager.cc:6741] ReplaceTablet: tablet 56b775db329949bcbab3fd81c75e951d deleted and replaced by tablet ee3543a2f89f43a8ab938e3585953953
I20260505 20:13:22.917435 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 43f656c47c5f46fe811ff64c58972e76 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:22.918047 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet a9719876757e409b991b21410983e3bf
I20260505 20:13:22.919847 8053 tablet_bootstrap.cc:492] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.919799 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 4cbb29bc765d476cb4634178f2806c10 (DEFAULT_TABLE table=default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.920260 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbb29bc765d476cb4634178f2806c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.922066 7644 tablet_service.cc:1511] Processing CreateTablet for tablet 725cb481751048c29695726011c80c08 (DEFAULT_TABLE table=default.Table_366c60e571684325a5f3c6bf45c40753 [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.922468 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725cb481751048c29695726011c80c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.925861 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b775db329949bcbab3fd81c75e951d with delete_type TABLET_DATA_DELETED (replaced by tablet ee3543a2f89f43a8ab938e3585953953) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.926200 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet a9719876757e409b991b21410983e3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.913738 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1bfd0f2780b54332816e770c0a339b9f" } new_table_name: "default.Table_936302b13c514b96bd4a3f61995da46d" modify_external_catalogs: true
I20260505 20:13:22.930301 8053 ts_tablet_manager.cc:1403] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.108s user 0.015s sys 0.019s
I20260505 20:13:22.930838 7338 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 4f897977f88547d58d8ff8c60c5d18fa
I20260505 20:13:22.931278 8058 tablet_bootstrap.cc:492] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:22.931321 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2aab7fb908ab42e88832482b231fe6f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.931435 8058 ts_tablet_manager.cc:1403] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.003s
W20260505 20:13:22.931891 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aab7fb908ab42e88832482b231fe6f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.934614 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 3e77ec84858a4e46a993c579d9990f1b (DEFAULT_TABLE table=default.Table_55818053abfc4ea0a0cc4ef3f1bab479 [id=0149b0d509e947c4a1523cd8645446da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.936404 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_99c224cd93784af1a21c3c3260971518"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.936952 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99c224cd93784af1a21c3c3260971518 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.943033 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c538874d901d449d9490a324fdc484a3" } modify_external_catalogs: true
I20260505 20:13:22.943224 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c538874d901d449d9490a324fdc484a3" } modify_external_catalogs: true
I20260505 20:13:22.935284 8053 raft_consensus.cc:359] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.944475 8053 raft_consensus.cc:385] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.944605 8053 raft_consensus.cc:740] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.944869 8053 consensus_queue.cc:260] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.945534 8053 ts_tablet_manager.cc:1434] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260505 20:13:22.945928 8053 tablet_bootstrap.cc:492] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.947090 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_74fed0f29d6a42648143b2b29444f483"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.947167 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet bffa53ec02b34d408f3a8b4f45299c57 (table default.Table_9e1bb2a23514497b9dd3580f1479a03c [id=0a0faede033d4425b6e1389b4e5d9f65]) successfully deleted
W20260505 20:13:22.947665 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74fed0f29d6a42648143b2b29444f483 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.944687 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e77ec84858a4e46a993c579d9990f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.954124 8053 tablet_bootstrap.cc:654] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:22.956971 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24fc8fb89d614388969b5eff86ba31ca has no consensus state
I20260505 20:13:22.957479 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 46a5d46461b746be9fc29431e972b7b7
I20260505 20:13:22.939639 8052 ts_tablet_manager.cc:1929] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:22.957851 8052 log.cc:1199] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/5fc05b2d65594e16abee960ad3c7721a
I20260505 20:13:22.958264 8052 ts_tablet_manager.cc:1950] T 5fc05b2d65594e16abee960ad3c7721a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:22.934285 8058 raft_consensus.cc:359] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.959038 8058 raft_consensus.cc:385] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.959141 8058 raft_consensus.cc:740] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.962805 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a5d46461b746be9fc29431e972b7b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.963299 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 43f656c47c5f46fe811ff64c58972e76
I20260505 20:13:22.963614 8053 tablet_bootstrap.cc:492] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:22.963780 8053 ts_tablet_manager.cc:1403] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.003s
I20260505 20:13:22.963877 7336 catalog_manager.cc:6741] ReplaceTablet: tablet 43f656c47c5f46fe811ff64c58972e76 deleted and replaced by tablet ef996218e8b14e3b80eeab3397edec57
I20260505 20:13:22.965272 8053 raft_consensus.cc:359] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.965495 8053 raft_consensus.cc:385] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:22.965605 8053 raft_consensus.cc:740] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:22.965940 7774 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b775db329949bcbab3fd81c75e951d with delete_type TABLET_DATA_DELETED (replaced by tablet ee3543a2f89f43a8ab938e3585953953) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.965907 8053 consensus_queue.cc:260] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:22.966181 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet a9719876757e409b991b21410983e3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.966518 8053 ts_tablet_manager.cc:1434] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:22.966809 8053 tablet_bootstrap.cc:492] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:22.967978 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f656c47c5f46fe811ff64c58972e76 with delete_type TABLET_DATA_DELETED (replaced by tablet ef996218e8b14e3b80eeab3397edec57) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.968618 8053 tablet_bootstrap.cc:654] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:22.968745 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f656c47c5f46fe811ff64c58972e76 with delete_type TABLET_DATA_DELETED (replaced by tablet ef996218e8b14e3b80eeab3397edec57) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.972797 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 725cb481751048c29695726011c80c08 (DEFAULT_TABLE table=default.Table_366c60e571684325a5f3c6bf45c40753 [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.973258 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725cb481751048c29695726011c80c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.974080 7337 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet c4400792ceb14f0c9f0f3c23a47b91c2
I20260505 20:13:22.975975 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a5d46461b746be9fc29431e972b7b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.976568 7335 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_bbfb07ee69c44ed680d5e4709cd7ee63 [id=db04ad55e6964d88bb71e0eab4cc4f65] alter complete (version 3)
I20260505 20:13:22.976569 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 4cbb29bc765d476cb4634178f2806c10 (DEFAULT_TABLE table=default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.977034 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbb29bc765d476cb4634178f2806c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.978925 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 245c8328c49347bf8b15d58cb5380fe0
I20260505 20:13:22.979688 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 8af906f570a04b668c8696817739a412 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8329b75b6946d08337c1cfbe49623b) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:22.979864 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet be214aeb495244a6b58f761c01b7faa5 with delete_type TABLET_DATA_DELETED (replaced by tablet 02eafc72ff7d4055b424322e01dc0c84) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.980095 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:22.980472 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 862e865d406c4d95b97b579e9fe07df0 (DEFAULT_TABLE table=default.Table_7c4d921cc7404bab95415fb55b417bc8 [id=c7a48b7bdb6d411794fc792531c3bd26]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:22.981314 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 56b775db329949bcbab3fd81c75e951d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56b775db329949bcbab3fd81c75e951d already in progress: creating tablet
W20260505 20:13:22.981671 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet a9719876757e409b991b21410983e3bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9719876757e409b991b21410983e3bf already in progress: creating tablet
I20260505 20:13:22.981634 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e865d406c4d95b97b579e9fe07df0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:22.982143 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 46a5d46461b746be9fc29431e972b7b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46a5d46461b746be9fc29431e972b7b7 already in progress: creating tablet
I20260505 20:13:22.984834 8051 tablet_replica.cc:333] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:22.984886 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 862e865d406c4d95b97b579e9fe07df0 (DEFAULT_TABLE table=default.Table_7c4d921cc7404bab95415fb55b417bc8 [id=c7a48b7bdb6d411794fc792531c3bd26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.985039 8051 raft_consensus.cc:2243] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.985302 8051 raft_consensus.cc:2272] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.985363 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e865d406c4d95b97b579e9fe07df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.985486 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:22.990016 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 43f656c47c5f46fe811ff64c58972e76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43f656c47c5f46fe811ff64c58972e76 already in progress: creating tablet
I20260505 20:13:22.990737 8051 ts_tablet_manager.cc:1916] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.990793 8052 tablet_replica.cc:333] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:22.990988 8052 raft_consensus.cc:2243] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:22.991174 8052 raft_consensus.cc:2272] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:22.991331 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 862e865d406c4d95b97b579e9fe07df0 (DEFAULT_TABLE table=default.Table_7c4d921cc7404bab95415fb55b417bc8 [id=c7a48b7bdb6d411794fc792531c3bd26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.991744 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e865d406c4d95b97b579e9fe07df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.991734 8052 ts_tablet_manager.cc:1916] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:22.993878 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 5fc05b2d65594e16abee960ad3c7721a (table default.Table_c738b338e02745d989d767b3cf2954a8 [id=cf0b5ed94ed2455a9251be84a2ef204e]) successfully deleted
I20260505 20:13:22.994885 7908 tablet_service.cc:1511] Processing CreateTablet for tablet a9719876757e409b991b21410983e3bf (DEFAULT_TABLE table=default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:22.995285 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9719876757e409b991b21410983e3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:22.996995 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_4a3093344fce42508208b7b460168409"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:22.997634 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a3093344fce42508208b7b460168409 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:22.998927 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_dac15532a6214097912a12004f5f2bef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:22.959378 8058 consensus_queue.cc:260] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.002221 8058 ts_tablet_manager.cc:1434] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.071s user 0.001s sys 0.001s
I20260505 20:13:23.002560 8058 tablet_bootstrap.cc:492] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.001896 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b775db329949bcbab3fd81c75e951d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:23.002498 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dac15532a6214097912a12004f5f2bef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.003810 7936 raft_consensus.cc:2468] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:23.005220 8050 ts_tablet_manager.cc:1929] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.012545 8058 tablet_bootstrap.cc:654] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.013724 7737 leader_election.cc:304] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.014086 8064 raft_consensus.cc:2804] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:23.014195 8064 raft_consensus.cc:493] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:23.014295 8064 raft_consensus.cc:3060] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.014942 8053 tablet_bootstrap.cc:492] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.015102 8053 ts_tablet_manager.cc:1403] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.013s
I20260505 20:13:23.015764 8052 ts_tablet_manager.cc:1929] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.015895 8052 log.cc:1199] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/edceecc7eee4477a869acce495aade1c
I20260505 20:13:23.015967 8053 raft_consensus.cc:359] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.016276 8053 raft_consensus.cc:385] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.016321 8052 ts_tablet_manager.cc:1950] T edceecc7eee4477a869acce495aade1c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.016356 8053 raft_consensus.cc:740] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.016618 8053 consensus_queue.cc:260] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.017104 8064 raft_consensus.cc:515] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.018692 8053 ts_tablet_manager.cc:1434] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:23.019625 8052 tablet_replica.cc:333] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.019830 8052 raft_consensus.cc:2243] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.019949 8064 leader_election.cc:290] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.020498 8052 raft_consensus.cc:2272] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.020696 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b775db329949bcbab3fd81c75e951d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:23.021377 8052 ts_tablet_manager.cc:1916] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:23.021646 7736 leader_election.cc:343] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.022351 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b775db329949bcbab3fd81c75e951d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:23.025154 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 245c8328c49347bf8b15d58cb5380fe0 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.027158 8053 tablet_bootstrap.cc:492] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.027114 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_901be6cdffc546c09f6cdde630e17f3f" } new_table_name: "default.Table_0dd057d830894bc0a635f56b257151d7" modify_external_catalogs: true
I20260505 20:13:23.027109 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8f662bf9642940d19389e4fe4f0a5e18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.030311 8053 tablet_bootstrap.cc:654] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.031678 8050 log.cc:1199] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/bffa53ec02b34d408f3a8b4f45299c57
I20260505 20:13:23.032215 8050 ts_tablet_manager.cc:1950] T bffa53ec02b34d408f3a8b4f45299c57 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:23.032791 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f662bf9642940d19389e4fe4f0a5e18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.033309 8050 tablet_replica.cc:333] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.033496 8050 raft_consensus.cc:2243] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.033676 8050 raft_consensus.cc:2272] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.034175 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e2bec7fdd76f4bd7b695c78b0ce063c3" } new_table_name: "default.Table_1e875cacdf694c338cf2535c52a332f4" modify_external_catalogs: true
I20260505 20:13:23.034268 8050 ts_tablet_manager.cc:1916] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.037442 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bd78ac7f2b9041e1b06f223b4585712d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.038000 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd78ac7f2b9041e1b06f223b4585712d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.038305 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 725cb481751048c29695726011c80c08 (DEFAULT_TABLE table=default.Table_366c60e571684325a5f3c6bf45c40753 [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.038798 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725cb481751048c29695726011c80c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.038955 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3f93bb9d891e4ac6b582689068819e21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.039386 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f93bb9d891e4ac6b582689068819e21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.040280 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 15e64ed9bb7c44219dac4a36bfbec24f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.041852 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet a9719876757e409b991b21410983e3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.042074 7936 raft_consensus.cc:3060] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.037865 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 4cbb29bc765d476cb4634178f2806c10 (DEFAULT_TABLE table=default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.044085 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet edceecc7eee4477a869acce495aade1c (table default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]) successfully deleted
I20260505 20:13:23.044258 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbb29bc765d476cb4634178f2806c10. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.044339 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 8824bed6d2e9411d86651dfcffa77718 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8824bed6d2e9411d86651dfcffa77718 already in progress: creating tablet
W20260505 20:13:23.044536 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a4a2fef35c4b9bb68edca0fb2dd127 already in progress: creating tablet
I20260505 20:13:23.044921 8052 ts_tablet_manager.cc:1929] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.045060 8052 log.cc:1199] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/40dfb8da73284065a3d97df18a738dc4
I20260505 20:13:23.045441 8052 ts_tablet_manager.cc:1950] T 40dfb8da73284065a3d97df18a738dc4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.047503 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.048561 8053 tablet_bootstrap.cc:492] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.048703 8053 ts_tablet_manager.cc:1403] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.004s
I20260505 20:13:23.050050 8053 raft_consensus.cc:359] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.050264 8053 raft_consensus.cc:385] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.050360 8053 raft_consensus.cc:740] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.050637 8053 consensus_queue.cc:260] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.052219 7936 raft_consensus.cc:2468] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:23.053515 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f656c47c5f46fe811ff64c58972e76 with delete_type TABLET_DATA_DELETED (replaced by tablet ef996218e8b14e3b80eeab3397edec57) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.053839 7737 leader_election.cc:304] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.053979 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a5d46461b746be9fc29431e972b7b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.054117 8122 raft_consensus.cc:2804] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:23.054275 8122 raft_consensus.cc:697] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:23.054366 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.054544 8122 consensus_queue.cc:237] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.056034 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet bffa53ec02b34d408f3a8b4f45299c57 (table default.Table_9e1bb2a23514497b9dd3580f1479a03c [id=0a0faede033d4425b6e1389b4e5d9f65]) successfully deleted
I20260505 20:13:23.060886 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b775db329949bcbab3fd81c75e951d with delete_type TABLET_DATA_DELETED (replaced by tablet ee3543a2f89f43a8ab938e3585953953) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.060966 8089 raft_consensus.cc:493] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.061120 8089 raft_consensus.cc:515] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.061880 8089 leader_election.cc:290] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.062960 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138b762a0c74ecda3b43167dd5bfc04" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:23.063544 7736 leader_election.cc:343] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.063755 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 74a5d442f25242ea8371fca8643f4ce6 (DEFAULT_TABLE table=default.Table_c8694c481ad84d5099a1ba7bab8a7557 [id=8bb9e97bc80f43c99a93689f548cc8e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.064254 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a5d442f25242ea8371fca8643f4ce6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.064478 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c104bd9c39af48449718b0c7f327f6ec consensus state has no leader
I20260505 20:13:23.070258 8053 ts_tablet_manager.cc:1434] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
W20260505 20:13:23.070572 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef996218e8b14e3b80eeab3397edec57 has no consensus state
I20260505 20:13:23.070639 8053 tablet_bootstrap.cc:492] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.075460 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d with delete_type TABLET_DATA_DELETED (replaced by tablet a9719876757e409b991b21410983e3bf) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.075594 8053 tablet_bootstrap.cc:654] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.075985 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 74a5d442f25242ea8371fca8643f4ce6 (DEFAULT_TABLE table=default.Table_c8694c481ad84d5099a1ba7bab8a7557 [id=8bb9e97bc80f43c99a93689f548cc8e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.076421 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a5d442f25242ea8371fca8643f4ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.077513 8052 tablet_replica.cc:333] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.077718 8052 raft_consensus.cc:2243] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.077941 8052 raft_consensus.cc:2272] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.078147 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 8af906f570a04b668c8696817739a412 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8329b75b6946d08337c1cfbe49623b) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.079041 8054 tablet_bootstrap.cc:492] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.078860 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138b762a0c74ecda3b43167dd5bfc04" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:23.079445 7936 raft_consensus.cc:2468] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:23.079481 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 40dfb8da73284065a3d97df18a738dc4 (table default.Table_87d54561ed754d9b83ec983b110c6899 [id=066d18dc94b24dc48ded2961f4b4f567]) successfully deleted
I20260505 20:13:23.079959 7737 leader_election.cc:304] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.080214 8052 ts_tablet_manager.cc:1916] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.080273 8064 raft_consensus.cc:2804] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:23.080360 8064 raft_consensus.cc:493] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:23.080478 8064 raft_consensus.cc:3060] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.081189 7644 tablet_service.cc:1511] Processing CreateTablet for tablet c95cba502b064583a50fb85ba7dea1b5 (DEFAULT_TABLE table=default.Table_528b585197824127a1f24d4f16e3f840 [id=e4f40ca8f6ce4601b2066218fd09cff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.081679 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95cba502b064583a50fb85ba7dea1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.082593 7770 tablet_service.cc:1511] Processing CreateTablet for tablet c104bd9c39af48449718b0c7f327f6ec (DEFAULT_TABLE table=default.Table_0dd057d830894bc0a635f56b257151d7 [id=7517daa10e164e339a320e44a40bebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.082976 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c104bd9c39af48449718b0c7f327f6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.084537 8064 raft_consensus.cc:515] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.085845 8064 leader_election.cc:290] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.085888 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 99ab400210c54e99bc396674f7ba8235 (DEFAULT_TABLE table=default.Table_aef313ad65fe4481a016b5b6f222270a [id=c00635909bca435eaf43a1e25358fb88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.086354 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ab400210c54e99bc396674f7ba8235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.087026 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 74a5d442f25242ea8371fca8643f4ce6 (DEFAULT_TABLE table=default.Table_c8694c481ad84d5099a1ba7bab8a7557 [id=8bb9e97bc80f43c99a93689f548cc8e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.087558 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a5d442f25242ea8371fca8643f4ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.088310 8054 ts_tablet_manager.cc:1403] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.262s user 0.054s sys 0.064s
I20260505 20:13:23.089923 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 99ab400210c54e99bc396674f7ba8235 (DEFAULT_TABLE table=default.Table_aef313ad65fe4481a016b5b6f222270a [id=c00635909bca435eaf43a1e25358fb88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.090319 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ab400210c54e99bc396674f7ba8235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.090389 7912 tablet_service.cc:1511] Processing CreateTablet for tablet c95cba502b064583a50fb85ba7dea1b5 (DEFAULT_TABLE table=default.Table_528b585197824127a1f24d4f16e3f840 [id=e4f40ca8f6ce4601b2066218fd09cff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.090829 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95cba502b064583a50fb85ba7dea1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.092419 7908 tablet_service.cc:1511] Processing CreateTablet for tablet c104bd9c39af48449718b0c7f327f6ec (DEFAULT_TABLE table=default.Table_0dd057d830894bc0a635f56b257151d7 [id=7517daa10e164e339a320e44a40bebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.092861 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c104bd9c39af48449718b0c7f327f6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.093482 8054 raft_consensus.cc:359] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.093724 8054 raft_consensus.cc:385] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.093856 8054 raft_consensus.cc:740] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.096410 7770 tablet_service.cc:1511] Processing CreateTablet for tablet c95cba502b064583a50fb85ba7dea1b5 (DEFAULT_TABLE table=default.Table_528b585197824127a1f24d4f16e3f840 [id=e4f40ca8f6ce4601b2066218fd09cff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.096769 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95cba502b064583a50fb85ba7dea1b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.099395 8052 ts_tablet_manager.cc:1929] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.099524 8052 log.cc:1199] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/de9b7c48be9042a19958c09941c2e429
I20260505 20:13:23.099872 8052 ts_tablet_manager.cc:1950] T de9b7c48be9042a19958c09941c2e429 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.100502 8050 ts_tablet_manager.cc:1929] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.100641 8050 log.cc:1199] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ae94d54b26b24d99b0b382fba9f5a542
I20260505 20:13:23.100845 8052 tablet_replica.cc:333] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.101069 8050 ts_tablet_manager.cc:1950] T ae94d54b26b24d99b0b382fba9f5a542 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.102063 8064 raft_consensus.cc:493] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.102236 8064 raft_consensus.cc:515] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.102883 8064 leader_election.cc:290] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.103716 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet de9b7c48be9042a19958c09941c2e429 (table default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]) successfully deleted
I20260505 20:13:23.104176 8052 raft_consensus.cc:2243] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.104379 8052 raft_consensus.cc:2272] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.106240 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af906f570a04b668c8696817739a412" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:23.106525 7937 raft_consensus.cc:2468] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:23.106980 7737 leader_election.cc:304] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:23.107331 8064 raft_consensus.cc:2804] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:23.107432 8064 raft_consensus.cc:493] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:23.107534 8064 raft_consensus.cc:3060] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.108301 8052 ts_tablet_manager.cc:1916] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.110354 8064 raft_consensus.cc:515] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.111088 8064 leader_election.cc:290] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.112267 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af906f570a04b668c8696817739a412" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:23.112528 7937 raft_consensus.cc:3060] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.115954 7937 raft_consensus.cc:2468] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:23.116492 7737 leader_election.cc:304] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:23.116827 8064 raft_consensus.cc:2804] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:23.116986 8064 raft_consensus.cc:697] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:23.117233 8064 consensus_queue.cc:237] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.119488 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 (DEFAULT_TABLE table=default.Table_8f812ed4658e43018df5551d9bbe2e2d [id=1a58839ed48640caa2fcb8fe1d77bbaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.119879 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eeb04e0a574132b247d5ce6d7add44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.122056 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 24fc8fb89d614388969b5eff86ba31ca (DEFAULT_TABLE table=default.Table_936302b13c514b96bd4a3f61995da46d [id=cc685c3c73114d9a8ec2533202346623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.122421 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fc8fb89d614388969b5eff86ba31ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.122619 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 24fc8fb89d614388969b5eff86ba31ca (DEFAULT_TABLE table=default.Table_936302b13c514b96bd4a3f61995da46d [id=cc685c3c73114d9a8ec2533202346623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.122959 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fc8fb89d614388969b5eff86ba31ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.092211 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138b762a0c74ecda3b43167dd5bfc04" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:23.126077 7936 raft_consensus.cc:3060] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.128671 7936 raft_consensus.cc:2468] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:23.131325 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 8af906f570a04b668c8696817739a412 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.131372 7737 leader_election.cc:304] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:23.132547 8052 ts_tablet_manager.cc:1929] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.132699 8052 log.cc:1199] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/9146142e112e43a7a6ce0369122d5a46
I20260505 20:13:23.133107 8052 ts_tablet_manager.cc:1950] T 9146142e112e43a7a6ce0369122d5a46 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.136941 8053 tablet_bootstrap.cc:492] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.137162 8053 ts_tablet_manager.cc:1403] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.067s user 0.008s sys 0.006s
I20260505 20:13:23.137189 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 (DEFAULT_TABLE table=default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.137591 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293ea58772bb4b479501d4bf3ead3ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.138080 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 (DEFAULT_TABLE table=default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.138213 8053 raft_consensus.cc:359] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.138444 8053 raft_consensus.cc:385] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.138481 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293ea58772bb4b479501d4bf3ead3ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.138535 8053 raft_consensus.cc:740] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.138806 8053 consensus_queue.cc:260] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.139094 8089 raft_consensus.cc:2804] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:23.139271 8053 ts_tablet_manager.cc:1434] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:23.140239 8053 tablet_bootstrap.cc:492] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.141901 8053 tablet_bootstrap.cc:654] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.141961 8054 consensus_queue.cc:260] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.143404 8052 tablet_replica.cc:333] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.143635 8054 ts_tablet_manager.cc:1434] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.055s user 0.002s sys 0.000s
I20260505 20:13:23.143766 8052 raft_consensus.cc:2243] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:23.143919 8054 tablet_bootstrap.cc:492] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.144029 8052 pending_rounds.cc:70] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:23.144095 8052 pending_rounds.cc:77] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737164514140160 op_type: NO_OP noop_request { }
I20260505 20:13:23.144251 8052 raft_consensus.cc:2889] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:23.144357 8052 raft_consensus.cc:2272] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.146188 8054 tablet_bootstrap.cc:654] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.151276 8053 tablet_bootstrap.cc:492] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.151464 8053 ts_tablet_manager.cc:1403] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260505 20:13:23.152525 8053 raft_consensus.cc:359] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.152726 8053 raft_consensus.cc:385] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.152842 8053 raft_consensus.cc:740] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.153825 8052 ts_tablet_manager.cc:1916] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:23.154224 7329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260505 20:13:23.155365 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 9146142e112e43a7a6ce0369122d5a46 (table default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]) successfully deleted
I20260505 20:13:23.155488 8127 raft_consensus.cc:493] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.155648 8127 raft_consensus.cc:515] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.156388 8127 leader_election.cc:290] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:23.156937 8053 consensus_queue.cc:260] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:23.160163 7869 leader_election.cc:343] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 9146142e112e43a7a6ce0369122d5a46
I20260505 20:13:23.163040 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (DEFAULT_TABLE table=default.Table_0e377ae2a3924b33ada3c0ce8495101d [id=74178f7425164618bd69a1653b75e5d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.163583 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8d5190032443d4bf6fdb83a34fabd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.164342 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138b762a0c74ecda3b43167dd5bfc04" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:23.164723 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af906f570a04b668c8696817739a412" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:23.167093 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 (DEFAULT_TABLE table=default.Table_8f812ed4658e43018df5551d9bbe2e2d [id=1a58839ed48640caa2fcb8fe1d77bbaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.167327 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 99ab400210c54e99bc396674f7ba8235 (DEFAULT_TABLE table=default.Table_aef313ad65fe4481a016b5b6f222270a [id=c00635909bca435eaf43a1e25358fb88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.167714 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 7766caea43904162a2c289b7b17405d4 (DEFAULT_TABLE table=default.Table_65f1198f03024f6182354be70b9abe9f [id=e0c72c789d9547febc28afe78bab3ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.168277 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7766caea43904162a2c289b7b17405d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.169791 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_245e946b31e8475f805cdc16988071aa" } modify_external_catalogs: true
I20260505 20:13:23.169827 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9146142e112e43a7a6ce0369122d5a46" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:23.170011 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_245e946b31e8475f805cdc16988071aa" } modify_external_catalogs: true
I20260505 20:13:23.170302 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af906f570a04b668c8696817739a412" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:23.171260 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 24fc8fb89d614388969b5eff86ba31ca (DEFAULT_TABLE table=default.Table_936302b13c514b96bd4a3f61995da46d [id=cc685c3c73114d9a8ec2533202346623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.171615 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eeb04e0a574132b247d5ce6d7add44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.172399 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_aef313ad65fe4481a016b5b6f222270a" } modify_external_catalogs: true
I20260505 20:13:23.172605 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_aef313ad65fe4481a016b5b6f222270a" } modify_external_catalogs: true
W20260505 20:13:23.172757 7736 leader_election.cc:343] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.173650 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b8dc23a61d1044d387ba34de22f570cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.174778 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8dc23a61d1044d387ba34de22f570cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.179960 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_74fed0f29d6a42648143b2b29444f483" } new_table_name: "default.Table_f31fbcf5dec94763b83bd970260efb87" modify_external_catalogs: true
I20260505 20:13:23.180260 7632 tablet_service.cc:1511] Processing CreateTablet for tablet c104bd9c39af48449718b0c7f327f6ec (DEFAULT_TABLE table=default.Table_0dd057d830894bc0a635f56b257151d7 [id=7517daa10e164e339a320e44a40bebda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.180686 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24fc8fb89d614388969b5eff86ba31ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.181005 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 7766caea43904162a2c289b7b17405d4 (DEFAULT_TABLE table=default.Table_65f1198f03024f6182354be70b9abe9f [id=e0c72c789d9547febc28afe78bab3ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.181440 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7766caea43904162a2c289b7b17405d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.180430 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet ae94d54b26b24d99b0b382fba9f5a542 (table default.Table_7aa01cf42bad4323b9ac63a7e130b521 [id=885260685ed345f8a157266967b6606f]) successfully deleted
I20260505 20:13:23.182220 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_faae7516687d41909cdaef29533f7400" } new_table_name: "default.Table_078e80255cc64422a110908c5afebd6d" modify_external_catalogs: true
I20260505 20:13:23.183116 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_55818053abfc4ea0a0cc4ef3f1bab479" } modify_external_catalogs: true
W20260505 20:13:23.183254 7736 leader_election.cc:343] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.183509 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_55818053abfc4ea0a0cc4ef3f1bab479" } modify_external_catalogs: true
W20260505 20:13:23.184500 7870 leader_election.cc:343] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.184634 7870 leader_election.cc:304] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.185046 8127 raft_consensus.cc:2749] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:23.186084 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0dd057d830894bc0a635f56b257151d7" } modify_external_catalogs: true
I20260505 20:13:23.186265 8052 ts_tablet_manager.cc:1929] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:23.186422 8052 log.cc:1199] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/56b775db329949bcbab3fd81c75e951d
I20260505 20:13:23.186331 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0dd057d830894bc0a635f56b257151d7" } modify_external_catalogs: true
W20260505 20:13:23.186664 7736 leader_election.cc:343] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.187516 8050 tablet_replica.cc:333] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.187779 8050 raft_consensus.cc:2243] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.187987 8050 raft_consensus.cc:2272] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.188596 8052 ts_tablet_manager.cc:1950] T 56b775db329949bcbab3fd81c75e951d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.188862 8050 ts_tablet_manager.cc:1916] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.189311 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_366c60e571684325a5f3c6bf45c40753" } new_table_name: "default.Table_4d8c7cb46fb847a9976a0337b0c7f7fa" modify_external_catalogs: true
I20260505 20:13:23.189857 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (DEFAULT_TABLE table=default.Table_0e377ae2a3924b33ada3c0ce8495101d [id=74178f7425164618bd69a1653b75e5d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.190428 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 7766caea43904162a2c289b7b17405d4 (DEFAULT_TABLE table=default.Table_65f1198f03024f6182354be70b9abe9f [id=e0c72c789d9547febc28afe78bab3ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.190687 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 (DEFAULT_TABLE table=default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.194056 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 (DEFAULT_TABLE table=default.Table_8f812ed4658e43018df5551d9bbe2e2d [id=1a58839ed48640caa2fcb8fe1d77bbaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.194561 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20eeb04e0a574132b247d5ce6d7add44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.195067 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ab400210c54e99bc396674f7ba8235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.195254 8052 tablet_replica.cc:333] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.199590 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bc1096f82cec44098b552845e587e89e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.200201 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc1096f82cec44098b552845e587e89e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.201527 8127 raft_consensus.cc:493] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.201664 8127 raft_consensus.cc:515] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.202345 8127 leader_election.cc:290] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:23.203198 7869 leader_election.cc:343] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: de9b7c48be9042a19958c09941c2e429
I20260505 20:13:23.204654 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 89f6ba8e4cba410daad729576d876329
I20260505 20:13:23.206496 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.207258 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8d5190032443d4bf6fdb83a34fabd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.209668 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.210018 8054 tablet_bootstrap.cc:492] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.210193 8054 ts_tablet_manager.cc:1403] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.000s
W20260505 20:13:23.210489 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.210541 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 293ea58772bb4b479501d4bf3ead3ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.211001 8054 raft_consensus.cc:359] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.211189 8054 raft_consensus.cc:385] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.211252 8054 raft_consensus.cc:740] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.211505 8054 consensus_queue.cc:260] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.212446 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e7d09d8a7d5e40b29fcc715a1863c4ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.212560 8054 ts_tablet_manager.cc:1434] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:23.212980 8054 tablet_bootstrap.cc:492] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:23.213233 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7d09d8a7d5e40b29fcc715a1863c4ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.214748 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_528b585197824127a1f24d4f16e3f840" } modify_external_catalogs: true
I20260505 20:13:23.215004 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_528b585197824127a1f24d4f16e3f840" } modify_external_catalogs: true
I20260505 20:13:23.215166 8054 tablet_bootstrap.cc:654] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:23.216795 7329 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 4cbb29bc765d476cb4634178f2806c10 (table default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4cbb29bc765d476cb4634178f2806c10 consensus state has no leader
I20260505 20:13:23.217204 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7766caea43904162a2c289b7b17405d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.217978 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 99ab400210c54e99bc396674f7ba8235
I20260505 20:13:23.219030 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ab400210c54e99bc396674f7ba8235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.219579 8079 raft_consensus.cc:493] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.219724 8079 raft_consensus.cc:515] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.220901 8079 leader_election.cc:290] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.221047 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de9b7c48be9042a19958c09941c2e429" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:23.221832 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (DEFAULT_TABLE table=default.Table_0e377ae2a3924b33ada3c0ce8495101d [id=74178f7425164618bd69a1653b75e5d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.222474 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8d5190032443d4bf6fdb83a34fabd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.223752 7598 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
W20260505 20:13:23.226904 7870 leader_election.cc:343] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:23.226953 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18ce59c1f3b64b518e244e32ac85b216 consensus state has no leader
I20260505 20:13:23.227041 7870 leader_election.cc:304] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.227653 8127 raft_consensus.cc:2749] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:23.229238 8050 ts_tablet_manager.cc:1929] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.229444 8050 log.cc:1199] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/0138b762a0c74ecda3b43167dd5bfc04
I20260505 20:13:23.229470 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c6fb56a940914efea745a3928384c125"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.230090 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6fb56a940914efea745a3928384c125 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.230839 8050 ts_tablet_manager.cc:1950] T 0138b762a0c74ecda3b43167dd5bfc04 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.230474 8054 tablet_bootstrap.cc:492] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.231813 8054 ts_tablet_manager.cc:1403] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260505 20:13:23.232308 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 0138b762a0c74ecda3b43167dd5bfc04 (table default.Table_8f5799bc8b2b4f39b309936338cbe0fa [id=5a01343c41cf47d3b1fe5c49ff9d9660]) successfully deleted
I20260505 20:13:23.232623 8054 raft_consensus.cc:359] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.232813 8054 raft_consensus.cc:385] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.232903 8054 raft_consensus.cc:740] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.233152 8054 consensus_queue.cc:260] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.233832 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:23.234457 8054 ts_tablet_manager.cc:1434] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:23.235360 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.235735 8054 tablet_bootstrap.cc:492] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.236702 7914 tablet_service.cc:1511] Processing CreateTablet for tablet ee3543a2f89f43a8ab938e3585953953 (DEFAULT_TABLE table=default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.237195 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3543a2f89f43a8ab938e3585953953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.245245 8054 tablet_bootstrap.cc:654] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.247617 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.249168 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b0d6b6035154e01850e7a158ad22dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.252398 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_526e839bfa8844e2a50dd64a809897ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.253190 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_526e839bfa8844e2a50dd64a809897ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.247882 8050 tablet_replica.cc:333] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.253942 8050 raft_consensus.cc:2243] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.254145 8050 raft_consensus.cc:2272] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.255864 8050 ts_tablet_manager.cc:1916] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.259503 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:23.260700 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.261258 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.261483 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ab400210c54e99bc396674f7ba8235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.262018 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:23.262154 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 725cb481751048c29695726011c80c08 consensus state has no leader
W20260505 20:13:23.262723 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2841214f07b4ae6b8cd7e97493b69d6 has no consensus state
I20260505 20:13:23.262842 7780 tablet_service.cc:1511] Processing CreateTablet for tablet ee3543a2f89f43a8ab938e3585953953 (DEFAULT_TABLE table=default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.263273 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3543a2f89f43a8ab938e3585953953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.266151 7914 tablet_service.cc:1511] Processing CreateTablet for tablet e80a1674d26c42e5a4884da99ab7918c (DEFAULT_TABLE table=default.Table_d533f0e3c58043698845036dc6f256d4 [id=80b8d26bbec14e7c8f1f108dc281077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.266642 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80a1674d26c42e5a4884da99ab7918c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.271135 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_aecb05072dc5457dab50f3e96887c93e" } new_table_name: "default.Table_36c89c315bed4e668607a8f215ce43bb" modify_external_catalogs: true
I20260505 20:13:23.274048 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_777277a81f294f5ca73544b582368deb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.274712 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_777277a81f294f5ca73544b582368deb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.275660 8054 tablet_bootstrap.cc:492] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.275826 8054 ts_tablet_manager.cc:1403] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.001s
I20260505 20:13:23.275944 8052 raft_consensus.cc:2243] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:23.276614 8052 pending_rounds.cc:70] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:23.276690 8052 pending_rounds.cc:77] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737164771090432 op_type: NO_OP noop_request { }
I20260505 20:13:23.276698 8054 raft_consensus.cc:359] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.276822 8052 raft_consensus.cc:2889] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:23.276887 8054 raft_consensus.cc:385] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.276922 8052 raft_consensus.cc:2272] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.276960 8054 raft_consensus.cc:740] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.277220 8054 consensus_queue.cc:260] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.278347 8054 ts_tablet_manager.cc:1434] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:23.279047 8054 tablet_bootstrap.cc:492] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.279350 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 43052ededdae41878a6190334d5a965e with delete_type TABLET_DATA_DELETED (replaced by tablet 9e8d5190032443d4bf6fdb83a34fabd8) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.280920 8054 tablet_bootstrap.cc:654] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.281277 8052 ts_tablet_manager.cc:1916] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.281791 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0e377ae2a3924b33ada3c0ce8495101d" } new_table_name: "default.Table_4cd74c87bda6442d8819f619e386bd93" modify_external_catalogs: true
I20260505 20:13:23.288717 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ab400210c54e99bc396674f7ba8235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:23.288959 7596 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:23.289163 7596 leader_election.cc:304] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:23.289444 8079 raft_consensus.cc:2749] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:23.289873 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 62109.1us
I20260505 20:13:23.290079 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet acd0f0fba5284283b472d6ddd1fcd69c from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.290601 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.290684 8052 ts_tablet_manager.cc:1929] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:23.290903 8052 log.cc:1199] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8af906f570a04b668c8696817739a412
I20260505 20:13:23.291141 7634 tablet_service.cc:1511] Processing CreateTablet for tablet ee3543a2f89f43a8ab938e3585953953 (DEFAULT_TABLE table=default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.291399 8050 ts_tablet_manager.cc:1929] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.291436 8052 ts_tablet_manager.cc:1950] T 8af906f570a04b668c8696817739a412 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.291529 8050 log.cc:1199] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/be214aeb495244a6b58f761c01b7faa5
I20260505 20:13:23.291548 7333 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
I20260505 20:13:23.291936 8050 ts_tablet_manager.cc:1950] T be214aeb495244a6b58f761c01b7faa5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.292147 8052 tablet_replica.cc:333] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.293035 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet be214aeb495244a6b58f761c01b7faa5 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]) successfully deleted
I20260505 20:13:23.293412 8050 tablet_replica.cc:333] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.292773 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:23.293557 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e32780089f084e57ab07a222e1353eff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32780089f084e57ab07a222e1353eff already in progress: creating tablet
I20260505 20:13:23.293674 8050 raft_consensus.cc:2243] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.293849 8050 raft_consensus.cc:2272] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.294122 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.294647 8050 ts_tablet_manager.cc:1916] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.294720 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.295282 7643 tablet_service.cc:1511] Processing CreateTablet for tablet e80a1674d26c42e5a4884da99ab7918c (DEFAULT_TABLE table=default.Table_d533f0e3c58043698845036dc6f256d4 [id=80b8d26bbec14e7c8f1f108dc281077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.296203 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c104bd9c39af48449718b0c7f327f6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.298384 8054 tablet_bootstrap.cc:492] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.298530 8054 ts_tablet_manager.cc:1403] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.003s
I20260505 20:13:23.299316 8054 raft_consensus.cc:359] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.299490 8054 raft_consensus.cc:385] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.299582 8054 raft_consensus.cc:740] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.299832 8054 consensus_queue.cc:260] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.301041 8054 ts_tablet_manager.cc:1434] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:23.301065 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b0d6b6035154e01850e7a158ad22dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.301487 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3543a2f89f43a8ab938e3585953953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.305295 8054 tablet_bootstrap.cc:492] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.311769 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80a1674d26c42e5a4884da99ab7918c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.313189 8050 ts_tablet_manager.cc:1929] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.314548 8054 tablet_bootstrap.cc:654] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.316174 8051 ts_tablet_manager.cc:1929] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.316370 8051 log.cc:1199] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/be214aeb495244a6b58f761c01b7faa5
I20260505 20:13:23.316768 8051 ts_tablet_manager.cc:1950] T be214aeb495244a6b58f761c01b7faa5 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.318890 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet be214aeb495244a6b58f761c01b7faa5 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]) successfully deleted
I20260505 20:13:23.319643 8058 tablet_bootstrap.cc:492] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.319842 8058 ts_tablet_manager.cc:1403] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.317s user 0.022s sys 0.037s
I20260505 20:13:23.321635 8050 log.cc:1199] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/96a4a2fef35c4b9bb68edca0fb2dd127
I20260505 20:13:23.322190 8050 ts_tablet_manager.cc:1950] T 96a4a2fef35c4b9bb68edca0fb2dd127 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.323740 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.324381 8050 tablet_replica.cc:333] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.324380 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b0d6b6035154e01850e7a158ad22dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.324563 8050 raft_consensus.cc:2243] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.324730 8050 raft_consensus.cc:2272] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.326076 8050 ts_tablet_manager.cc:1916] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.330425 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 96a4a2fef35c4b9bb68edca0fb2dd127 (table default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:23.331694 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 56b775db329949bcbab3fd81c75e951d (table default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]) successfully deleted
W20260505 20:13:23.332314 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet a9719876757e409b991b21410983e3bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9719876757e409b991b21410983e3bf already in progress: creating tablet
I20260505 20:13:23.332911 8089 raft_consensus.cc:697] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:23.333386 8089 consensus_queue.cc:237] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:23.335513 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 43f656c47c5f46fe811ff64c58972e76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43f656c47c5f46fe811ff64c58972e76 already in progress: creating tablet
I20260505 20:13:23.335397 7780 tablet_service.cc:1511] Processing CreateTablet for tablet e80a1674d26c42e5a4884da99ab7918c (DEFAULT_TABLE table=default.Table_d533f0e3c58043698845036dc6f256d4 [id=80b8d26bbec14e7c8f1f108dc281077a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:23.335861 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 46a5d46461b746be9fc29431e972b7b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46a5d46461b746be9fc29431e972b7b7 already in progress: creating tablet
I20260505 20:13:23.336299 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 8af906f570a04b668c8696817739a412 (table default.Table_6d0efc4c31774452a20d42a0135965e0 [id=087098008f924e61874b6d84181048bf]) successfully deleted
I20260505 20:13:23.336519 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80a1674d26c42e5a4884da99ab7918c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.336568 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 245c8328c49347bf8b15d58cb5380fe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 245c8328c49347bf8b15d58cb5380fe0 already in progress: creating tablet
I20260505 20:13:23.337657 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.349364 8050 ts_tablet_manager.cc:1929] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:23.349958 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 245c8328c49347bf8b15d58cb5380fe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 245c8328c49347bf8b15d58cb5380fe0 already in progress: creating tablet
I20260505 20:13:23.351065 8050 log.cc:1199] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8824bed6d2e9411d86651dfcffa77718
I20260505 20:13:23.351666 8050 ts_tablet_manager.cc:1950] T 8824bed6d2e9411d86651dfcffa77718 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.353215 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 8824bed6d2e9411d86651dfcffa77718 (table default.Table_7f774c4256454a39904f5517cbcd9d9f [id=f615586594f3465e9ee9f554048cce6c]) successfully deleted
I20260505 20:13:23.354689 8050 tablet_replica.cc:333] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.355916 8052 raft_consensus.cc:2243] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:23.356389 8052 pending_rounds.cc:70] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:23.356488 8052 pending_rounds.cc:77] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737165658406912 op_type: NO_OP noop_request { }
I20260505 20:13:23.356629 8052 raft_consensus.cc:2889] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:23.356747 8052 raft_consensus.cc:2272] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.361420 8050 raft_consensus.cc:2243] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.362001 8050 raft_consensus.cc:2272] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.362761 8051 tablet_replica.cc:333] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:23.363457 8050 ts_tablet_manager.cc:1916] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.363579 8052 ts_tablet_manager.cc:1916] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.364125 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 15e64ed9bb7c44219dac4a36bfbec24f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.364691 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 3e77ec84858a4e46a993c579d9990f1b from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.366258 8054 tablet_bootstrap.cc:492] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.366357 8051 raft_consensus.cc:2243] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.366436 8054 ts_tablet_manager.cc:1403] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.012s
I20260505 20:13:23.366580 8051 raft_consensus.cc:2272] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.367252 8054 raft_consensus.cc:359] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.367458 8054 raft_consensus.cc:385] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.367537 8054 raft_consensus.cc:740] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.367835 8054 consensus_queue.cc:260] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.368547 8051 ts_tablet_manager.cc:1916] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.370200 8054 ts_tablet_manager.cc:1434] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:23.370908 8054 tablet_bootstrap.cc:492] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.371836 8052 ts_tablet_manager.cc:1929] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:23.372020 8052 log.cc:1199] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/0138b762a0c74ecda3b43167dd5bfc04
I20260505 20:13:23.372442 8052 ts_tablet_manager.cc:1950] T 0138b762a0c74ecda3b43167dd5bfc04 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.372707 8054 tablet_bootstrap.cc:654] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.373566 8052 tablet_replica.cc:333] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.373777 8052 raft_consensus.cc:2243] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.373961 8052 raft_consensus.cc:2272] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.374706 8052 ts_tablet_manager.cc:1916] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.377460 8058 raft_consensus.cc:359] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.377722 8058 raft_consensus.cc:385] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.377839 8058 raft_consensus.cc:740] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.377947 8050 ts_tablet_manager.cc:1929] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.378101 8050 log.cc:1199] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/40dfb8da73284065a3d97df18a738dc4
I20260505 20:13:23.378167 8058 consensus_queue.cc:260] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.378858 8058 ts_tablet_manager.cc:1434] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.050s user 0.000s sys 0.002s
I20260505 20:13:23.379293 8058 tablet_bootstrap.cc:492] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.386060 8052 ts_tablet_manager.cc:1929] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.386227 8052 log.cc:1199] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/78edaee6c4e946b1a7c7302d20aa5d7d
I20260505 20:13:23.386622 8052 ts_tablet_manager.cc:1950] T 78edaee6c4e946b1a7c7302d20aa5d7d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.378491 8050 ts_tablet_manager.cc:1950] T 40dfb8da73284065a3d97df18a738dc4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.387920 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 40dfb8da73284065a3d97df18a738dc4 (table default.Table_87d54561ed754d9b83ec983b110c6899 [id=066d18dc94b24dc48ded2961f4b4f567]) successfully deleted
I20260505 20:13:23.388824 8050 tablet_replica.cc:333] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.388940 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 0138b762a0c74ecda3b43167dd5bfc04 (table default.Table_8f5799bc8b2b4f39b309936338cbe0fa [id=5a01343c41cf47d3b1fe5c49ff9d9660]) successfully deleted
I20260505 20:13:23.389074 8050 raft_consensus.cc:2243] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.389273 8050 raft_consensus.cc:2272] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.389866 8050 ts_tablet_manager.cc:1916] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.390563 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 78edaee6c4e946b1a7c7302d20aa5d7d (table default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]) successfully deleted
I20260505 20:13:23.393179 8058 tablet_bootstrap.cc:654] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:23.394932 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 89f6ba8e4cba410daad729576d876329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f6ba8e4cba410daad729576d876329 already in progress: creating tablet
I20260505 20:13:23.395550 8053 ts_tablet_manager.cc:1434] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.244s user 0.043s sys 0.098s
I20260505 20:13:23.395670 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 725cb481751048c29695726011c80c08 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.396060 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c95cba502b064583a50fb85ba7dea1b5
I20260505 20:13:23.396845 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_813570fe84494402989524e1939f8ae7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.397461 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_813570fe84494402989524e1939f8ae7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.397565 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.397975 8053 tablet_bootstrap.cc:492] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.399072 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet 47de1578fdd74a198c48606aec33880a from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.399708 8053 tablet_bootstrap.cc:654] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:23.399736 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 611bba6267194d058cd08a27cdd2af49 consensus state has no leader
W20260505 20:13:23.400148 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e8d5190032443d4bf6fdb83a34fabd8 consensus state has no leader
I20260505 20:13:23.401971 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:23.403751 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 99ab400210c54e99bc396674f7ba8235 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ab400210c54e99bc396674f7ba8235 already in progress: creating tablet
W20260505 20:13:23.404407 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 3e77ec84858a4e46a993c579d9990f1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e77ec84858a4e46a993c579d9990f1b already in progress: creating tablet
I20260505 20:13:23.404633 8051 ts_tablet_manager.cc:1929] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.404767 8051 log.cc:1199] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/43052ededdae41878a6190334d5a965e
I20260505 20:13:23.405011 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.405139 8051 ts_tablet_manager.cc:1950] T 43052ededdae41878a6190334d5a965e P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.407874 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_82f9420427cd4cfab319a2d4d8f4b34d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.408975 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_96d86a6e49174181adfbd3401006cb3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.409438 8079 raft_consensus.cc:493] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.409584 8079 raft_consensus.cc:515] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.409952 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_381e5521f71b4d388d6643fb24a3bc27" } modify_external_catalogs: true
I20260505 20:13:23.410157 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_381e5521f71b4d388d6643fb24a3bc27" } modify_external_catalogs: true
I20260505 20:13:23.410295 8079 leader_election.cc:290] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:23.405000 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c104bd9c39af48449718b0c7f327f6ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c104bd9c39af48449718b0c7f327f6ec already in progress: creating tablet
W20260505 20:13:23.411288 7598 leader_election.cc:343] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c187c7931645429b9c89b92b890c8bba
W20260505 20:13:23.411439 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96d86a6e49174181adfbd3401006cb3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:23.411618 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c95cba502b064583a50fb85ba7dea1b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c95cba502b064583a50fb85ba7dea1b5 already in progress: creating tablet
W20260505 20:13:23.412559 7596 leader_election.cc:343] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: c187c7931645429b9c89b92b890c8bba
I20260505 20:13:23.412693 7596 leader_election.cc:304] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:23.412914 8050 ts_tablet_manager.cc:1929] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.413053 8050 log.cc:1199] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/de9b7c48be9042a19958c09941c2e429
I20260505 20:13:23.413079 8079 raft_consensus.cc:2749] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:23.413436 8050 ts_tablet_manager.cc:1950] T de9b7c48be9042a19958c09941c2e429 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.414721 8054 tablet_bootstrap.cc:492] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.414860 8054 ts_tablet_manager.cc:1403] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.006s
I20260505 20:13:23.414790 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_acfe8795c2434306851f082e414eedda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.415658 8054 raft_consensus.cc:359] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.415831 8054 raft_consensus.cc:385] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.415918 8054 raft_consensus.cc:740] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.416160 8054 consensus_queue.cc:260] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:23.416664 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82f9420427cd4cfab319a2d4d8f4b34d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.418341 8054 ts_tablet_manager.cc:1434] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:23.420449 8054 tablet_bootstrap.cc:492] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.422361 8054 tablet_bootstrap.cc:654] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:23.423708 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acfe8795c2434306851f082e414eedda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.424021 8058 tablet_bootstrap.cc:492] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.424173 8058 ts_tablet_manager.cc:1403] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.003s
I20260505 20:13:23.425028 8058 raft_consensus.cc:359] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.425230 8058 raft_consensus.cc:385] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.425308 8058 raft_consensus.cc:740] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.425536 8058 consensus_queue.cc:260] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.417690 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 43052ededdae41878a6190334d5a965e (table default.Table_4cd74c87bda6442d8819f619e386bd93 [id=74178f7425164618bd69a1653b75e5d1]) successfully deleted
I20260505 20:13:23.427090 8058 ts_tablet_manager.cc:1434] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:23.428434 8058 tablet_bootstrap.cc:492] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.430505 8058 tablet_bootstrap.cc:654] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.432861 7662 raft_consensus.cc:3060] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.437201 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet c187c7931645429b9c89b92b890c8bba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.437594 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8f812ed4658e43018df5551d9bbe2e2d" } modify_external_catalogs: true
I20260505 20:13:23.438005 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8f812ed4658e43018df5551d9bbe2e2d" } modify_external_catalogs: true
W20260505 20:13:23.438659 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 99ab400210c54e99bc396674f7ba8235 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ab400210c54e99bc396674f7ba8235 already in progress: creating tablet
I20260505 20:13:23.440407 8053 tablet_bootstrap.cc:492] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.440598 8053 ts_tablet_manager.cc:1403] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.018s
I20260505 20:13:23.438796 7336 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1e875cacdf694c338cf2535c52a332f4" } new_table_name: "default.Table_61a206162d5748ceb746d958b0f9ae76" modify_external_catalogs: true
W20260505 20:13:23.441002 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 3e77ec84858a4e46a993c579d9990f1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e77ec84858a4e46a993c579d9990f1b already in progress: creating tablet
I20260505 20:13:23.441421 8053 raft_consensus.cc:359] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.441632 8053 raft_consensus.cc:385] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.441716 8053 raft_consensus.cc:740] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.442060 8053 consensus_queue.cc:260] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.442451 8050 tablet_replica.cc:333] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.442669 8050 raft_consensus.cc:2243] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.442749 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet de9b7c48be9042a19958c09941c2e429 (table default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]) successfully deleted
I20260505 20:13:23.442844 8050 raft_consensus.cc:2272] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.443442 8050 ts_tablet_manager.cc:1916] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.443470 8058 tablet_bootstrap.cc:492] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.443635 8058 ts_tablet_manager.cc:1403] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260505 20:13:23.444418 8058 raft_consensus.cc:359] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:23.444509 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 89f6ba8e4cba410daad729576d876329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f6ba8e4cba410daad729576d876329 already in progress: creating tablet
I20260505 20:13:23.444625 8058 raft_consensus.cc:385] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.444702 8058 raft_consensus.cc:740] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:23.444937 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet c104bd9c39af48449718b0c7f327f6ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c104bd9c39af48449718b0c7f327f6ec already in progress: creating tablet
I20260505 20:13:23.444949 8058 consensus_queue.cc:260] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.445312 8053 ts_tablet_manager.cc:1434] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260505 20:13:23.445474 8058 ts_tablet_manager.cc:1434] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:23.445850 8058 tablet_bootstrap.cc:492] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:23.446211 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet c95cba502b064583a50fb85ba7dea1b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c95cba502b064583a50fb85ba7dea1b5 already in progress: creating tablet
I20260505 20:13:23.447103 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet d7e47c72827941cca40d20725e0100de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.447453 8051 tablet_replica.cc:333] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:23.447885 8053 tablet_bootstrap.cc:492] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.448371 8054 tablet_bootstrap.cc:492] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.448549 8054 ts_tablet_manager.cc:1403] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260505 20:13:23.449364 8054 raft_consensus.cc:359] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.449574 8054 raft_consensus.cc:385] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.449659 8054 raft_consensus.cc:740] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.449997 8054 consensus_queue.cc:260] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.451623 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6168f9d927844aadaca4cf743d95c088" } modify_external_catalogs: true
I20260505 20:13:23.451800 8051 raft_consensus.cc:2243] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.451822 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6168f9d927844aadaca4cf743d95c088" } modify_external_catalogs: true
I20260505 20:13:23.452271 8051 raft_consensus.cc:2272] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.452492 8054 ts_tablet_manager.cc:1434] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:23.453042 8053 tablet_bootstrap.cc:654] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.455562 8054 tablet_bootstrap.cc:492] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.457254 8054 tablet_bootstrap.cc:654] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.458884 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 923ed274fe454cc4a625516769e6b5f3 (DEFAULT_TABLE table=default.Table_b8dc23a61d1044d387ba34de22f570cb [id=580de9a798e54694a39a898d5fe4ab1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.459412 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 972b5c40369d41739d8c7a5bca22f04e (DEFAULT_TABLE table=default.Table_dac15532a6214097912a12004f5f2bef [id=478a9f35ab9d462c9c46020a04784934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.460148 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972b5c40369d41739d8c7a5bca22f04e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.462045 7336 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef996218e8b14e3b80eeab3397edec57 consensus state has no leader
I20260505 20:13:23.462208 8053 tablet_bootstrap.cc:492] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.462370 8053 ts_tablet_manager.cc:1403] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.004s
I20260505 20:13:23.462716 7338 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
I20260505 20:13:23.462878 7637 tablet_service.cc:1511] Processing CreateTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a (DEFAULT_TABLE table=default.Table_2aab7fb908ab42e88832482b231fe6f8 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.463246 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6589a0f15d4f31acc2e49e6c071e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.463745 8053 raft_consensus.cc:359] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.463980 8053 raft_consensus.cc:385] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.464076 8053 raft_consensus.cc:740] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.464325 8053 consensus_queue.cc:260] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.466058 7639 tablet_service.cc:1511] Processing CreateTablet for tablet e17b17089792450bbc4dba372076af9a (DEFAULT_TABLE table=default.Table_8f662bf9642940d19389e4fe4f0a5e18 [id=a950b5c2d6ae401ca441ec76000e8084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.466415 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17b17089792450bbc4dba372076af9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.466408 8053 ts_tablet_manager.cc:1434] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:23.466697 8053 tablet_bootstrap.cc:492] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.468487 8050 ts_tablet_manager.cc:1929] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.468577 8053 tablet_bootstrap.cc:654] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.468621 8050 log.cc:1199] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/9146142e112e43a7a6ce0369122d5a46
I20260505 20:13:23.468969 8050 ts_tablet_manager.cc:1950] T 9146142e112e43a7a6ce0369122d5a46 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.470672 7342 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
I20260505 20:13:23.470690 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 923ed274fe454cc4a625516769e6b5f3 (DEFAULT_TABLE table=default.Table_b8dc23a61d1044d387ba34de22f570cb [id=580de9a798e54694a39a898d5fe4ab1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.471037 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923ed274fe454cc4a625516769e6b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.472178 7775 tablet_service.cc:1511] Processing CreateTablet for tablet e17b17089792450bbc4dba372076af9a (DEFAULT_TABLE table=default.Table_8f662bf9642940d19389e4fe4f0a5e18 [id=a950b5c2d6ae401ca441ec76000e8084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.474002 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c (DEFAULT_TABLE table=default.Table_3f93bb9d891e4ac6b582689068819e21 [id=def2b4e333d84128b44c8d912afef0a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.474313 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7591290e4ddf4bcc9d4676a2618a346c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.474697 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c (DEFAULT_TABLE table=default.Table_3f93bb9d891e4ac6b582689068819e21 [id=def2b4e333d84128b44c8d912afef0a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.475407 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 923ed274fe454cc4a625516769e6b5f3 (DEFAULT_TABLE table=default.Table_b8dc23a61d1044d387ba34de22f570cb [id=580de9a798e54694a39a898d5fe4ab1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.475745 7776 tablet_service.cc:1511] Processing CreateTablet for tablet a1f5bfa086f9422ebda96b2485ad986b (DEFAULT_TABLE table=default.Table_381e5521f71b4d388d6643fb24a3bc27 [id=6606be420f5c424f93d731dfa574a5e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.476078 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17b17089792450bbc4dba372076af9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.478004 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 972b5c40369d41739d8c7a5bca22f04e (DEFAULT_TABLE table=default.Table_dac15532a6214097912a12004f5f2bef [id=478a9f35ab9d462c9c46020a04784934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.478308 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972b5c40369d41739d8c7a5bca22f04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.480391 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 972b5c40369d41739d8c7a5bca22f04e (DEFAULT_TABLE table=default.Table_dac15532a6214097912a12004f5f2bef [id=478a9f35ab9d462c9c46020a04784934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.480767 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972b5c40369d41739d8c7a5bca22f04e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.482046 7909 tablet_service.cc:1511] Processing CreateTablet for tablet a1f5bfa086f9422ebda96b2485ad986b (DEFAULT_TABLE table=default.Table_381e5521f71b4d388d6643fb24a3bc27 [id=6606be420f5c424f93d731dfa574a5e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.482362 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f5bfa086f9422ebda96b2485ad986b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.483966 7635 tablet_service.cc:1511] Processing CreateTablet for tablet a1f5bfa086f9422ebda96b2485ad986b (DEFAULT_TABLE table=default.Table_381e5521f71b4d388d6643fb24a3bc27 [id=6606be420f5c424f93d731dfa574a5e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.484375 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f5bfa086f9422ebda96b2485ad986b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.484396 7342 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 02eafc72ff7d4055b424322e01dc0c84 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]). Expected version 1 got 0
I20260505 20:13:23.480414 7774 tablet_service.cc:1511] Processing CreateTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a (DEFAULT_TABLE table=default.Table_2aab7fb908ab42e88832482b231fe6f8 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.485345 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6589a0f15d4f31acc2e49e6c071e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.485839 7908 tablet_service.cc:1511] Processing CreateTablet for tablet e17b17089792450bbc4dba372076af9a (DEFAULT_TABLE table=default.Table_8f662bf9642940d19389e4fe4f0a5e18 [id=a950b5c2d6ae401ca441ec76000e8084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.486197 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17b17089792450bbc4dba372076af9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.486305 7342 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 02eafc72ff7d4055b424322e01dc0c84 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 02eafc72ff7d4055b424322e01dc0c84 consensus state has no leader
I20260505 20:13:23.459738 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c (DEFAULT_TABLE table=default.Table_3f93bb9d891e4ac6b582689068819e21 [id=def2b4e333d84128b44c8d912afef0a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.486862 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7591290e4ddf4bcc9d4676a2618a346c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.487026 8058 tablet_bootstrap.cc:654] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.489876 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f5bfa086f9422ebda96b2485ad986b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.490049 7917 tablet_service.cc:1511] Processing CreateTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a (DEFAULT_TABLE table=default.Table_2aab7fb908ab42e88832482b231fe6f8 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.490418 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6589a0f15d4f31acc2e49e6c071e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.490763 7915 tablet_service.cc:1511] Processing CreateTablet for tablet f32d3ec040604ce7b384c4b6a202707f (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.491123 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32d3ec040604ce7b384c4b6a202707f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.492029 7916 tablet_service.cc:1511] Processing CreateTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 (DEFAULT_TABLE table=default.Table_f31fbcf5dec94763b83bd970260efb87 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.492411 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2841214f07b4ae6b8cd7e97493b69d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.494135 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 8824bed6d2e9411d86651dfcffa77718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.494608 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7591290e4ddf4bcc9d4676a2618a346c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.495200 7644 tablet_service.cc:1511] Processing CreateTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 (DEFAULT_TABLE table=default.Table_f31fbcf5dec94763b83bd970260efb87 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.495595 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2841214f07b4ae6b8cd7e97493b69d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.498199 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923ed274fe454cc4a625516769e6b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.503121 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6da3130e724445b0d1f3c20e4e3d02 (DEFAULT_TABLE table=default.Table_bd78ac7f2b9041e1b06f223b4585712d [id=af669dc2fb6848f0ba9899d2dd7344f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.503494 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6da3130e724445b0d1f3c20e4e3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.503830 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 8824bed6d2e9411d86651dfcffa77718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.504385 7782 tablet_service.cc:1511] Processing CreateTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 (DEFAULT_TABLE table=default.Table_f31fbcf5dec94763b83bd970260efb87 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.504808 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2841214f07b4ae6b8cd7e97493b69d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.506059 7771 tablet_service.cc:1511] Processing CreateTablet for tablet f32d3ec040604ce7b384c4b6a202707f (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.506292 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.506449 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32d3ec040604ce7b384c4b6a202707f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.510128 7779 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6da3130e724445b0d1f3c20e4e3d02 (DEFAULT_TABLE table=default.Table_bd78ac7f2b9041e1b06f223b4585712d [id=af669dc2fb6848f0ba9899d2dd7344f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.510589 7779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6da3130e724445b0d1f3c20e4e3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.511041 7630 tablet_service.cc:1511] Processing CreateTablet for tablet ef996218e8b14e3b80eeab3397edec57 (DEFAULT_TABLE table=default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.511689 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 983ad31892394f67a7a9a727dc2bef1b (DEFAULT_TABLE table=default.Table_e2f7ff55dbf84a6caa6a53aabeb2acb1 [id=a3200160268d450dbc28b0097c29eea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.514086 7772 tablet_service.cc:1511] Processing CreateTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f (DEFAULT_TABLE table=default.Table_99c224cd93784af1a21c3c3260971518 [id=e0008576d3f44c03b0244b28e61ccdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.514618 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef996218e8b14e3b80eeab3397edec57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.514643 7772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f86a888c5e4fb3acbd78f68c81576f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.518059 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923ed274fe454cc4a625516769e6b5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.518061 7773 tablet_service.cc:1511] Processing CreateTablet for tablet ef996218e8b14e3b80eeab3397edec57 (DEFAULT_TABLE table=default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.518519 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef996218e8b14e3b80eeab3397edec57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.522158 7769 tablet_service.cc:1511] Processing CreateTablet for tablet 983ad31892394f67a7a9a727dc2bef1b (DEFAULT_TABLE table=default.Table_e2f7ff55dbf84a6caa6a53aabeb2acb1 [id=a3200160268d450dbc28b0097c29eea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.522668 7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983ad31892394f67a7a9a727dc2bef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.523965 7642 tablet_service.cc:1511] Processing CreateTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f (DEFAULT_TABLE table=default.Table_99c224cd93784af1a21c3c3260971518 [id=e0008576d3f44c03b0244b28e61ccdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.524274 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_82f9420427cd4cfab319a2d4d8f4b34d" } new_table_name: "default.Table_557af34712374a3e925b6b5308c0545c" modify_external_catalogs: true
I20260505 20:13:23.524343 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f86a888c5e4fb3acbd78f68c81576f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.525655 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e2f7ff55dbf84a6caa6a53aabeb2acb1" } new_table_name: "default.Table_9b5e553dfc45494b948a59ce6c8b11d0" modify_external_catalogs: true
I20260505 20:13:23.526845 8052 tablet_replica.cc:333] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.526855 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ee151aa3a641443babaff433f49444e7" } modify_external_catalogs: true
I20260505 20:13:23.527017 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ee151aa3a641443babaff433f49444e7" } modify_external_catalogs: true
I20260505 20:13:23.527070 8052 raft_consensus.cc:2243] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.527271 8052 raft_consensus.cc:2272] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.527575 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983ad31892394f67a7a9a727dc2bef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.527631 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7aa09788a9b54cab8303f80b2237ee4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.524847 7637 tablet_service.cc:1511] Processing CreateTablet for tablet f32d3ec040604ce7b384c4b6a202707f (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:23.528147 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7aa09788a9b54cab8303f80b2237ee4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.528251 8171 raft_consensus.cc:493] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.528342 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32d3ec040604ce7b384c4b6a202707f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.528388 8171 raft_consensus.cc:515] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.529170 8171 leader_election.cc:290] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.530114 8052 ts_tablet_manager.cc:1916] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.532122 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0f0fba5284283b472d6ddd1fcd69c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:23.532743 7736 leader_election.cc:343] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.536561 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet 5b0d6b6035154e01850e7a158ad22dfa from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.539747 8051 ts_tablet_manager.cc:1916] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.494100 7905 tablet_service.cc:1511] Processing CreateTablet for tablet ef996218e8b14e3b80eeab3397edec57 (DEFAULT_TABLE table=default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.546396 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef996218e8b14e3b80eeab3397edec57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.494081 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6da3130e724445b0d1f3c20e4e3d02 (DEFAULT_TABLE table=default.Table_bd78ac7f2b9041e1b06f223b4585712d [id=af669dc2fb6848f0ba9899d2dd7344f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.552345 8052 ts_tablet_manager.cc:1929] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.552816 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 47de1578fdd74a198c48606aec33880a
I20260505 20:13:23.553285 7337 catalog_manager.cc:6741] ReplaceTablet: tablet 47de1578fdd74a198c48606aec33880a deleted and replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c
I20260505 20:13:23.554134 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet 47de1578fdd74a198c48606aec33880a with delete_type TABLET_DATA_DELETED (replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.555517 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_54ae8ffe8e9a482daae20d9283315d37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.556039 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54ae8ffe8e9a482daae20d9283315d37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.556555 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 725cb481751048c29695726011c80c08
I20260505 20:13:23.556954 7341 catalog_manager.cc:6741] ReplaceTablet: tablet 725cb481751048c29695726011c80c08 deleted and replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:23.557266 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet a1f5bfa086f9422ebda96b2485ad986b
W20260505 20:13:23.557971 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b596f03adbea413b813c9037d4243fae has no consensus state
W20260505 20:13:23.558409 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 983ad31892394f67a7a9a727dc2bef1b consensus state has no leader
I20260505 20:13:23.558630 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet a1f5bfa086f9422ebda96b2485ad986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.559190 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.559266 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 13a4ddebda9447389c15be61aa60baaf
I20260505 20:13:23.559340 8051 ts_tablet_manager.cc:1929] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.559438 8051 log.cc:1199] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c187c7931645429b9c89b92b890c8bba
I20260505 20:13:23.559808 8051 ts_tablet_manager.cc:1950] T c187c7931645429b9c89b92b890c8bba P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.560190 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 with delete_type TABLET_DATA_DELETED (replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.560592 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a4ddebda9447389c15be61aa60baaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.564760 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 5b0d6b6035154e01850e7a158ad22dfa
I20260505 20:13:23.565274 7334 catalog_manager.cc:6741] ReplaceTablet: tablet 5b0d6b6035154e01850e7a158ad22dfa deleted and replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:23.578083 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 20eeb04e0a574132b247d5ce6d7add44
I20260505 20:13:23.583246 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c187c7931645429b9c89b92b890c8bba (table default.Table_d5b8d6121e234d70939c2432a603ff18 [id=5ba2ee85cb9147399567f608a97458ad]) successfully deleted
I20260505 20:13:23.583407 7902 tablet_service.cc:1558] Processing DeleteTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.583792 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 293ea58772bb4b479501d4bf3ead3ba0 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.583833 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.584014 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 24fc8fb89d614388969b5eff86ba31ca from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.584074 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa with delete_type TABLET_DATA_DELETED (replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.560402 7907 tablet_service.cc:1511] Processing CreateTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f (DEFAULT_TABLE table=default.Table_99c224cd93784af1a21c3c3260971518 [id=e0008576d3f44c03b0244b28e61ccdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.585837 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 47de1578fdd74a198c48606aec33880a with delete_type TABLET_DATA_DELETED (replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.585762 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f with delete_type TABLET_DATA_DELETED (replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.587188 7903 tablet_service.cc:1558] Processing DeleteTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d with delete_type TABLET_DATA_DELETED (replaced by tablet a9719876757e409b991b21410983e3bf) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.587952 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet a1f5bfa086f9422ebda96b2485ad986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.588048 8051 tablet_replica.cc:333] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:23.588558 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 9146142e112e43a7a6ce0369122d5a46 (table default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]) successfully deleted
W20260505 20:13:23.588845 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet a9719876757e409b991b21410983e3bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9719876757e409b991b21410983e3bf already in progress: creating tablet
I20260505 20:13:23.588488 7902 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.588363 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 983ad31892394f67a7a9a727dc2bef1b (DEFAULT_TABLE table=default.Table_e2f7ff55dbf84a6caa6a53aabeb2acb1 [id=a3200160268d450dbc28b0097c29eea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.585471 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0f0fba5284283b472d6ddd1fcd69c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:23.589676 8051 raft_consensus.cc:2243] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.590116 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a4ddebda9447389c15be61aa60baaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.590282 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa with delete_type TABLET_DATA_DELETED (replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.590436 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.590714 8051 raft_consensus.cc:2272] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.591020 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6da3130e724445b0d1f3c20e4e3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.591787 7936 raft_consensus.cc:2468] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:23.592139 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 983ad31892394f67a7a9a727dc2bef1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.592960 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f86a888c5e4fb3acbd78f68c81576f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.594578 8051 ts_tablet_manager.cc:1916] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.567239 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 with delete_type TABLET_DATA_DELETED (replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.567366 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.567512 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 47de1578fdd74a198c48606aec33880a with delete_type TABLET_DATA_DELETED (replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.567792 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.567945 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet a1f5bfa086f9422ebda96b2485ad986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.568385 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a4ddebda9447389c15be61aa60baaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.568475 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa with delete_type TABLET_DATA_DELETED (replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.579789 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.595613 7737 leader_election.cc:304] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.596877 8089 raft_consensus.cc:2804] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:23.596985 8089 raft_consensus.cc:493] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:23.597132 8089 raft_consensus.cc:3060] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.598598 8052 log.cc:1199] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8824bed6d2e9411d86651dfcffa77718
I20260505 20:13:23.599028 8052 ts_tablet_manager.cc:1950] T 8824bed6d2e9411d86651dfcffa77718 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.599803 8089 raft_consensus.cc:515] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.601023 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0f0fba5284283b472d6ddd1fcd69c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:23.601656 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 8824bed6d2e9411d86651dfcffa77718 (table default.Table_7f774c4256454a39904f5517cbcd9d9f [id=f615586594f3465e9ee9f554048cce6c]) successfully deleted
I20260505 20:13:23.601912 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 02eafc72ff7d4055b424322e01dc0c84
W20260505 20:13:23.602002 7736 leader_election.cc:343] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:23.602355 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 0138b762a0c74ecda3b43167dd5bfc04 because the tablet was not found. No further retry: Not found: Tablet not found: 0138b762a0c74ecda3b43167dd5bfc04
I20260505 20:13:23.602376 8089 leader_election.cc:290] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.603044 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.603101 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0f0fba5284283b472d6ddd1fcd69c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:23.603296 7936 raft_consensus.cc:3060] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:23.604060 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.604650 7773 tablet_service.cc:1511] Processing CreateTablet for tablet b596f03adbea413b813c9037d4243fae (DEFAULT_TABLE table=default.Table_557af34712374a3e925b6b5308c0545c [id=b4f5e0b1bf67487e86d6f9af9dc16088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.604825 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_60314b7c9136475184b40323c1985237"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.605060 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596f03adbea413b813c9037d4243fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.605011 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_179af68819324947a142bb734a25e38c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.605338 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60314b7c9136475184b40323c1985237 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.605324 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:23.605535 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_179af68819324947a142bb734a25e38c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.606606 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c0743365402b4252bd3c5c7a95a9e5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.607095 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0743365402b4252bd3c5c7a95a9e5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.608134 7637 tablet_service.cc:1511] Processing CreateTablet for tablet b596f03adbea413b813c9037d4243fae (DEFAULT_TABLE table=default.Table_557af34712374a3e925b6b5308c0545c [id=b4f5e0b1bf67487e86d6f9af9dc16088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.608206 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ff6f9b07cd9040f9b22cd78b16700030" } new_table_name: "default.Table_3e927ca3870e46dfac9020afe0c894e5" modify_external_catalogs: true
I20260505 20:13:23.609018 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596f03adbea413b813c9037d4243fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.609254 8052 tablet_replica.cc:333] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.609464 8052 raft_consensus.cc:2243] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.609434 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e7d09d8a7d5e40b29fcc715a1863c4ed" } new_table_name: "default.Table_d4acc8d2798141beab39776ab03434ea" modify_external_catalogs: true
I20260505 20:13:23.609668 8052 raft_consensus.cc:2272] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.610652 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d2de86e5a88b47d2a990951ede96f55f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.611148 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2de86e5a88b47d2a990951ede96f55f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.612371 7913 tablet_service.cc:1511] Processing CreateTablet for tablet b596f03adbea413b813c9037d4243fae (DEFAULT_TABLE table=default.Table_557af34712374a3e925b6b5308c0545c [id=b4f5e0b1bf67487e86d6f9af9dc16088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.612775 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596f03adbea413b813c9037d4243fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.613310 8052 ts_tablet_manager.cc:1916] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.614316 8190 tablet.cc:1724] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:23.616406 7341 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bbfb07ee69c44ed680d5e4709cd7ee63 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 3 got 0
I20260505 20:13:23.617434 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7" } modify_external_catalogs: true
I20260505 20:13:23.617610 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7" } modify_external_catalogs: true
I20260505 20:13:23.619590 7341 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bbfb07ee69c44ed680d5e4709cd7ee63 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 3 got 2
I20260505 20:13:23.619867 8127 raft_consensus.cc:493] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.620038 8127 raft_consensus.cc:515] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.621675 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 42f7886e6b054f458f1d0f02f3e555b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:23.622414 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 43f656c47c5f46fe811ff64c58972e76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43f656c47c5f46fe811ff64c58972e76 already in progress: creating tablet
I20260505 20:13:23.624045 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:23.624542 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 293ea58772bb4b479501d4bf3ead3ba0 deleted and replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:23.624872 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.625376 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:23.625636 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 46a5d46461b746be9fc29431e972b7b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46a5d46461b746be9fc29431e972b7b7 already in progress: creating tablet
W20260505 20:13:23.626037 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 245c8328c49347bf8b15d58cb5380fe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 245c8328c49347bf8b15d58cb5380fe0 already in progress: creating tablet
I20260505 20:13:23.626289 8050 tablet_replica.cc:333] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.626482 8050 raft_consensus.cc:2243] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.626667 8050 raft_consensus.cc:2272] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.627223 8050 ts_tablet_manager.cc:1916] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.628476 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.628710 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8b4013ec119f4c35aef190778e2fa5c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.628895 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_21e350c2f410430db36b12553e5e7829"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.629330 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b4013ec119f4c35aef190778e2fa5c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:23.629849 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21e350c2f410430db36b12553e5e7829 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.638298 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee (DEFAULT_TABLE table=default.Table_acfe8795c2434306851f082e414eedda [id=39135661c6b246a0bc45ec344e9bdc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.638934 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cce2fd271641ad83c9b3e4beeb12ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.639348 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf77f6323af4263852853e10003faee (DEFAULT_TABLE table=default.Table_813570fe84494402989524e1939f8ae7 [id=a5182c95fa7443dbb6f5eeea64a90764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.639914 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf77f6323af4263852853e10003faee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.646378 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf77f6323af4263852853e10003faee (DEFAULT_TABLE table=default.Table_813570fe84494402989524e1939f8ae7 [id=a5182c95fa7443dbb6f5eeea64a90764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.646973 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf77f6323af4263852853e10003faee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.651388 8051 ts_tablet_manager.cc:1929] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.652822 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1037f771740d1a094a622d5e49082 (DEFAULT_TABLE table=default.Table_96d86a6e49174181adfbd3401006cb3b [id=c946f532ba074386ac47a7bacd2feeea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.653060 8051 log.cc:1199] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/d7e47c72827941cca40d20725e0100de
I20260505 20:13:23.653326 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1037f771740d1a094a622d5e49082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.653680 7766 tablet_service.cc:1511] Processing CreateTablet for tablet ff4ea5fcb558489097e518a28ad967dd (DEFAULT_TABLE table=default.Table_e7d09d8a7d5e40b29fcc715a1863c4ed [id=d524216fa30845d8b34c5cbb859603b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.654034 8051 ts_tablet_manager.cc:1950] T d7e47c72827941cca40d20725e0100de P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.654287 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4ea5fcb558489097e518a28ad967dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.652642 8190 tablet.cc:1724] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:23.658543 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1037f771740d1a094a622d5e49082 (DEFAULT_TABLE table=default.Table_96d86a6e49174181adfbd3401006cb3b [id=c946f532ba074386ac47a7bacd2feeea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.659024 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1037f771740d1a094a622d5e49082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.666651 7917 tablet_service.cc:1511] Processing CreateTablet for tablet a026a8408ed9462b820b560a98dcabd1 (DEFAULT_TABLE table=default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.667263 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a026a8408ed9462b820b560a98dcabd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.667371 8051 tablet_replica.cc:333] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:23.668016 8051 raft_consensus.cc:2243] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.668941 8051 raft_consensus.cc:2272] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.669090 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 034852d91c26434f8a3c7fd8100c49ac (DEFAULT_TABLE table=default.Table_bc1096f82cec44098b552845e587e89e [id=1ed317cfce51417387701aaed2ebdc70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.669572 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034852d91c26434f8a3c7fd8100c49ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.670605 8051 ts_tablet_manager.cc:1916] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.670583 7777 tablet_service.cc:1511] Processing CreateTablet for tablet a026a8408ed9462b820b560a98dcabd1 (DEFAULT_TABLE table=default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.670998 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a026a8408ed9462b820b560a98dcabd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.675777 7908 tablet_service.cc:1511] Processing CreateTablet for tablet ff4ea5fcb558489097e518a28ad967dd (DEFAULT_TABLE table=default.Table_e7d09d8a7d5e40b29fcc715a1863c4ed [id=d524216fa30845d8b34c5cbb859603b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.676014 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 01e800dfb0354beab9c835cbed9dceb4 (DEFAULT_TABLE table=default.Table_777277a81f294f5ca73544b582368deb [id=fcfe44f6abce4d00b4290752ab326b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.676337 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4ea5fcb558489097e518a28ad967dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.677495 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e800dfb0354beab9c835cbed9dceb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.678316 7909 tablet_service.cc:1511] Processing CreateTablet for tablet beb404fa927641f48f28c6bdaa297db3 (DEFAULT_TABLE table=default.Table_c6fb56a940914efea745a3928384c125 [id=88907f7bed654b0a9e35b82d3667bc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.678493 7766 tablet_service.cc:1511] Processing CreateTablet for tablet beb404fa927641f48f28c6bdaa297db3 (DEFAULT_TABLE table=default.Table_c6fb56a940914efea745a3928384c125 [id=88907f7bed654b0a9e35b82d3667bc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.678792 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb404fa927641f48f28c6bdaa297db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.678907 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb404fa927641f48f28c6bdaa297db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.681818 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 034852d91c26434f8a3c7fd8100c49ac (DEFAULT_TABLE table=default.Table_bc1096f82cec44098b552845e587e89e [id=1ed317cfce51417387701aaed2ebdc70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.682045 7767 tablet_service.cc:1511] Processing CreateTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb (DEFAULT_TABLE table=default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 [id=e51e3514b22840c391a0e2f929547557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.682334 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034852d91c26434f8a3c7fd8100c49ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.682405 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.690224 7914 tablet_service.cc:1511] Processing CreateTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb (DEFAULT_TABLE table=default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 [id=e51e3514b22840c391a0e2f929547557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.690805 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.690375 8194 raft_consensus.cc:493] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.691501 8194 raft_consensus.cc:515] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.693629 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce59c1f3b64b518e244e32ac85b216" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:23.694219 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee (DEFAULT_TABLE table=default.Table_acfe8795c2434306851f082e414eedda [id=39135661c6b246a0bc45ec344e9bdc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.694145 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 01e800dfb0354beab9c835cbed9dceb4 (DEFAULT_TABLE table=default.Table_777277a81f294f5ca73544b582368deb [id=fcfe44f6abce4d00b4290752ab326b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.694723 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cce2fd271641ad83c9b3e4beeb12ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.694809 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e800dfb0354beab9c835cbed9dceb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.694340 7870 leader_election.cc:343] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.696307 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce59c1f3b64b518e244e32ac85b216" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:23.696521 8194 leader_election.cc:290] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:23.696555 7802 raft_consensus.cc:2468] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:23.696983 7869 leader_election.cc:304] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.697932 8194 raft_consensus.cc:2804] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:23.699308 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1037f771740d1a094a622d5e49082 (DEFAULT_TABLE table=default.Table_96d86a6e49174181adfbd3401006cb3b [id=c946f532ba074386ac47a7bacd2feeea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.699589 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee (DEFAULT_TABLE table=default.Table_acfe8795c2434306851f082e414eedda [id=39135661c6b246a0bc45ec344e9bdc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.699738 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1037f771740d1a094a622d5e49082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.699949 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cce2fd271641ad83c9b3e4beeb12ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.700290 7644 tablet_service.cc:1511] Processing CreateTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb (DEFAULT_TABLE table=default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 [id=e51e3514b22840c391a0e2f929547557]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.700649 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.702040 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf77f6323af4263852853e10003faee (DEFAULT_TABLE table=default.Table_813570fe84494402989524e1939f8ae7 [id=a5182c95fa7443dbb6f5eeea64a90764]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.702438 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf77f6323af4263852853e10003faee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.706085 7639 tablet_service.cc:1511] Processing CreateTablet for tablet a026a8408ed9462b820b560a98dcabd1 (DEFAULT_TABLE table=default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.706322 7630 tablet_service.cc:1511] Processing CreateTablet for tablet beb404fa927641f48f28c6bdaa297db3 (DEFAULT_TABLE table=default.Table_c6fb56a940914efea745a3928384c125 [id=88907f7bed654b0a9e35b82d3667bc11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.706487 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a026a8408ed9462b820b560a98dcabd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.706825 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 01e800dfb0354beab9c835cbed9dceb4 (DEFAULT_TABLE table=default.Table_777277a81f294f5ca73544b582368deb [id=fcfe44f6abce4d00b4290752ab326b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.707168 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e800dfb0354beab9c835cbed9dceb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.710364 7631 tablet_service.cc:1511] Processing CreateTablet for tablet ff4ea5fcb558489097e518a28ad967dd (DEFAULT_TABLE table=default.Table_e7d09d8a7d5e40b29fcc715a1863c4ed [id=d524216fa30845d8b34c5cbb859603b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.710781 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4ea5fcb558489097e518a28ad967dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.713886 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 034852d91c26434f8a3c7fd8100c49ac (DEFAULT_TABLE table=default.Table_bc1096f82cec44098b552845e587e89e [id=1ed317cfce51417387701aaed2ebdc70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.714323 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034852d91c26434f8a3c7fd8100c49ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.721200 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb404fa927641f48f28c6bdaa297db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.721474 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet d7e47c72827941cca40d20725e0100de (table default.Table_2329990d33d941799ae7ae7cbb3c3493 [id=9016406a2de74726b20ec5215d2d94d3]) successfully deleted
W20260505 20:13:23.721791 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 47de1578fdd74a198c48606aec33880a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47de1578fdd74a198c48606aec33880a already in progress: creating tablet
W20260505 20:13:23.722030 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet a1f5bfa086f9422ebda96b2485ad986b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1f5bfa086f9422ebda96b2485ad986b already in progress: creating tablet
W20260505 20:13:23.722246 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 725cb481751048c29695726011c80c08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 725cb481751048c29695726011c80c08 already in progress: creating tablet
W20260505 20:13:23.722419 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 13a4ddebda9447389c15be61aa60baaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13a4ddebda9447389c15be61aa60baaf already in progress: creating tablet
W20260505 20:13:23.722596 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 20eeb04e0a574132b247d5ce6d7add44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20eeb04e0a574132b247d5ce6d7add44 already in progress: creating tablet
W20260505 20:13:23.722760 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 5b0d6b6035154e01850e7a158ad22dfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b0d6b6035154e01850e7a158ad22dfa already in progress: creating tablet
W20260505 20:13:23.722956 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 02eafc72ff7d4055b424322e01dc0c84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02eafc72ff7d4055b424322e01dc0c84 already in progress: creating tablet
I20260505 20:13:23.724169 8052 ts_tablet_manager.cc:1929] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.724290 8052 log.cc:1199] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/96a4a2fef35c4b9bb68edca0fb2dd127
I20260505 20:13:23.724630 8052 ts_tablet_manager.cc:1950] T 96a4a2fef35c4b9bb68edca0fb2dd127 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.725844 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 96a4a2fef35c4b9bb68edca0fb2dd127 (table default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:23.726182 8052 tablet_replica.cc:333] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.726572 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2461ad6b3ec94233b9dd7f60cbad4639" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:23.727021 8052 raft_consensus.cc:2243] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.727272 8052 raft_consensus.cc:2272] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.728336 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2461ad6b3ec94233b9dd7f60cbad4639" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:23.728822 8058 tablet_bootstrap.cc:492] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.728981 8058 ts_tablet_manager.cc:1403] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.283s user 0.018s sys 0.022s
I20260505 20:13:23.730792 8052 ts_tablet_manager.cc:1916] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.737883 8058 raft_consensus.cc:359] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.738512 8058 raft_consensus.cc:385] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.738821 8058 raft_consensus.cc:740] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.739333 8058 consensus_queue.cc:260] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.741663 8058 ts_tablet_manager.cc:1434] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:23.743320 8058 tablet_bootstrap.cc:492] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.744410 8053 tablet_bootstrap.cc:492] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.744590 8053 ts_tablet_manager.cc:1403] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.278s user 0.002s sys 0.002s
I20260505 20:13:23.745365 8053 raft_consensus.cc:359] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.745947 8053 raft_consensus.cc:385] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.746105 8053 raft_consensus.cc:740] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.746402 8053 consensus_queue.cc:260] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.748229 8052 ts_tablet_manager.cc:1929] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.748440 8052 log.cc:1199] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/acd0f0fba5284283b472d6ddd1fcd69c
I20260505 20:13:23.748883 8052 ts_tablet_manager.cc:1950] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.749675 8053 ts_tablet_manager.cc:1434] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:23.749657 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet acd0f0fba5284283b472d6ddd1fcd69c (table default.Table_206e9638b58b41f892b4b9f29c7b7e3e [id=2d1a1f685c25435d84db53ec232bea74]) successfully deleted
W20260505 20:13:23.750428 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 47de1578fdd74a198c48606aec33880a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47de1578fdd74a198c48606aec33880a already in progress: creating tablet
I20260505 20:13:23.751108 8053 tablet_bootstrap.cc:492] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:23.751102 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 725cb481751048c29695726011c80c08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 725cb481751048c29695726011c80c08 already in progress: creating tablet
W20260505 20:13:23.751727 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet a1f5bfa086f9422ebda96b2485ad986b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1f5bfa086f9422ebda96b2485ad986b already in progress: creating tablet
I20260505 20:13:23.752512 7336 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bbfb07ee69c44ed680d5e4709cd7ee63 [id=db04ad55e6964d88bb71e0eab4cc4f65]). Expected version 3 got 2
W20260505 20:13:23.752708 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 13a4ddebda9447389c15be61aa60baaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13a4ddebda9447389c15be61aa60baaf already in progress: creating tablet
I20260505 20:13:23.752890 8053 tablet_bootstrap.cc:654] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:23.753268 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 5b0d6b6035154e01850e7a158ad22dfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b0d6b6035154e01850e7a158ad22dfa already in progress: creating tablet
I20260505 20:13:23.754225 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_71c89ce7dcda42769625f9694e5923e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.754760 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71c89ce7dcda42769625f9694e5923e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.754791 8194 raft_consensus.cc:493] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:23.754905 8194 raft_consensus.cc:3060] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:23.756161 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 20eeb04e0a574132b247d5ce6d7add44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20eeb04e0a574132b247d5ce6d7add44 already in progress: creating tablet
W20260505 20:13:23.756716 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 02eafc72ff7d4055b424322e01dc0c84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02eafc72ff7d4055b424322e01dc0c84 already in progress: creating tablet
W20260505 20:13:23.757318 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 293ea58772bb4b479501d4bf3ead3ba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 293ea58772bb4b479501d4bf3ead3ba0 already in progress: creating tablet
I20260505 20:13:23.757679 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3ebd6a4281b1477dbc833a9f7bde8612" } new_table_name: "default.Table_cc9499abee5f46aa9bc36f8f562decc2" modify_external_catalogs: true
W20260505 20:13:23.758921 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9b375a4bbec4527af704aa6cd08acec consensus state has no leader
W20260505 20:13:23.759327 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff4ea5fcb558489097e518a28ad967dd consensus state has no leader
I20260505 20:13:23.760857 8051 ts_tablet_manager.cc:1929] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.761965 8194 raft_consensus.cc:515] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.764904 8194 leader_election.cc:290] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:23.764091 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fc05b2d65594e16abee960ad3c7721a with delete_type TABLET_DATA_DELETED (replaced by tablet 5a809fab787b48e29ff5901791fd3e0d) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.767161 8051 log.cc:1199] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/42f7886e6b054f458f1d0f02f3e555b0
I20260505 20:13:23.767964 8051 ts_tablet_manager.cc:1950] T 42f7886e6b054f458f1d0f02f3e555b0 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.769412 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:23.770021 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 42f7886e6b054f458f1d0f02f3e555b0 (table default.Table_dbd33bbe5ad9434fab311cf8991dd607 [id=e3793cfcbb3b4d21935d71682a3834b8]) successfully deleted
I20260505 20:13:23.770223 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.770182 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f31fbcf5dec94763b83bd970260efb87" } new_table_name: "default.Table_4bd6d8fe45184075935e942894062d87" modify_external_catalogs: true
I20260505 20:13:23.770537 8183 mvcc.cc:204] Tried to move back new op lower bound from 7282737163609546752 to 7282737161203396608. Current Snapshot: MvccSnapshot[applied={T|T < 7282737163609546752}]
I20260505 20:13:23.771121 8051 tablet_replica.cc:333] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
W20260505 20:13:23.771276 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 293ea58772bb4b479501d4bf3ead3ba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 293ea58772bb4b479501d4bf3ead3ba0 already in progress: creating tablet
I20260505 20:13:23.771320 8051 raft_consensus.cc:2243] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.771629 8051 raft_consensus.cc:2272] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.771766 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_264d0b6fcd884b629f0fb38091195668" } modify_external_catalogs: true
I20260505 20:13:23.771930 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_264d0b6fcd884b629f0fb38091195668" } modify_external_catalogs: true
I20260505 20:13:23.772348 8051 ts_tablet_manager.cc:1916] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.773147 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bbfb07ee69c44ed680d5e4709cd7ee63" } new_table_name: "default.Table_bf624872acc84e63b23fe61fd237af86" modify_external_catalogs: true
I20260505 20:13:23.776479 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f4773b76a3564290a6bc4a8870c4e836" } modify_external_catalogs: true
I20260505 20:13:23.776660 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f4773b76a3564290a6bc4a8870c4e836" } modify_external_catalogs: true
I20260505 20:13:23.779994 8051 ts_tablet_manager.cc:1929] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.780225 8051 log.cc:1199] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/5fc05b2d65594e16abee960ad3c7721a
I20260505 20:13:23.780989 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.781280 8051 ts_tablet_manager.cc:1950] T 5fc05b2d65594e16abee960ad3c7721a P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.782676 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 5fc05b2d65594e16abee960ad3c7721a (table default.Table_c738b338e02745d989d767b3cf2954a8 [id=cf0b5ed94ed2455a9251be84a2ef204e]) successfully deleted
W20260505 20:13:23.784083 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb already in progress: creating tablet
I20260505 20:13:23.753643 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c1015d9a8a7a49cba428a699afd14df2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.785794 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:23.786235 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1015d9a8a7a49cba428a699afd14df2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:23.786633 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb already in progress: creating tablet
I20260505 20:13:23.720620 7936 raft_consensus.cc:2468] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:23.722102 8127 leader_election.cc:290] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:23.728938 7869 leader_election.cc:343] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:23.787983 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 59061.2us
W20260505 20:13:23.788558 7870 leader_election.cc:343] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.788873 7737 leader_election.cc:304] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.788869 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce59c1f3b64b518e244e32ac85b216" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:23.789091 7870 leader_election.cc:304] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.789230 7802 raft_consensus.cc:3060] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:23.789304 7737 raft_consensus.cc:2686] T acd0f0fba5284283b472d6ddd1fcd69c P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260505 20:13:23.789418 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 57245us
I20260505 20:13:23.789763 8194 raft_consensus.cc:493] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.789896 8194 raft_consensus.cc:515] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.790560 8194 leader_election.cc:290] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:23.790699 8194 raft_consensus.cc:2749] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:23.791371 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78edaee6c4e946b1a7c7302d20aa5d7d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:23.791313 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18ce59c1f3b64b518e244e32ac85b216" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:23.792193 7802 raft_consensus.cc:2468] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
W20260505 20:13:23.792385 7870 leader_election.cc:343] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:23.792649 7870 leader_election.cc:343] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.793058 7869 leader_election.cc:304] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.793386 8127 raft_consensus.cc:2804] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:23.793596 8127 raft_consensus.cc:697] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:23.793959 8127 consensus_queue.cc:237] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:23.796034 7869 leader_election.cc:343] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 78edaee6c4e946b1a7c7302d20aa5d7d
I20260505 20:13:23.796159 7869 leader_election.cc:304] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:23.796695 8194 raft_consensus.cc:2749] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:23.737321 8050 ts_tablet_manager.cc:1929] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.806033 8050 log.cc:1199] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/56b775db329949bcbab3fd81c75e951d
I20260505 20:13:23.754658 8054 tablet_bootstrap.cc:492] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.806398 8054 ts_tablet_manager.cc:1403] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.351s user 0.006s sys 0.025s
I20260505 20:13:23.807309 8054 raft_consensus.cc:359] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.807498 8054 raft_consensus.cc:385] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.807595 8054 raft_consensus.cc:740] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.807832 8054 consensus_queue.cc:260] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.808396 8054 ts_tablet_manager.cc:1434] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:23.808816 8054 tablet_bootstrap.cc:492] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.813416 8054 tablet_bootstrap.cc:654] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.811964 8050 ts_tablet_manager.cc:1950] T 56b775db329949bcbab3fd81c75e951d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.823182 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 56b775db329949bcbab3fd81c75e951d (table default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]) successfully deleted
I20260505 20:13:23.823588 8058 tablet_bootstrap.cc:654] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.825498 8050 tablet_replica.cc:333] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.825877 8054 tablet_bootstrap.cc:492] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.826118 8054 ts_tablet_manager.cc:1403] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s
I20260505 20:13:23.827164 8054 raft_consensus.cc:359] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.827453 8054 raft_consensus.cc:385] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.827917 8054 raft_consensus.cc:740] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.825968 8050 raft_consensus.cc:2243] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.828310 8054 consensus_queue.cc:260] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.828657 8050 raft_consensus.cc:2272] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.829526 8050 ts_tablet_manager.cc:1916] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.829984 8058 tablet_bootstrap.cc:492] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.830291 8058 ts_tablet_manager.cc:1403] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.003s
I20260505 20:13:23.831461 8058 raft_consensus.cc:359] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.831831 8058 raft_consensus.cc:385] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.831988 8058 raft_consensus.cc:740] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.833045 8058 consensus_queue.cc:260] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.834039 8058 ts_tablet_manager.cc:1434] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:23.835414 8058 tablet_bootstrap.cc:492] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.839737 8058 tablet_bootstrap.cc:654] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.841557 8054 ts_tablet_manager.cc:1434] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260505 20:13:23.845118 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet e32780089f084e57ab07a222e1353eff from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.846590 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f with delete_type TABLET_DATA_DELETED (replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.846894 8052 tablet_replica.cc:333] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.847090 8052 raft_consensus.cc:2243] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.847288 8052 raft_consensus.cc:2272] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.847707 8058 tablet_bootstrap.cc:492] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.847905 8058 ts_tablet_manager.cc:1403] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260505 20:13:23.848253 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 24fc8fb89d614388969b5eff86ba31ca
I20260505 20:13:23.848765 7340 catalog_manager.cc:6741] ReplaceTablet: tablet 24fc8fb89d614388969b5eff86ba31ca deleted and replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f
I20260505 20:13:23.849372 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b4f05cad2989475fa0305e98f562037b
I20260505 20:13:23.849869 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 24fc8fb89d614388969b5eff86ba31ca with delete_type TABLET_DATA_DELETED (replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.850111 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7c4d921cc7404bab95415fb55b417bc8" } modify_external_catalogs: true
I20260505 20:13:23.850284 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7c4d921cc7404bab95415fb55b417bc8" } modify_external_catalogs: true
I20260505 20:13:23.850425 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet ae94d54b26b24d99b0b382fba9f5a542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.850742 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 24fc8fb89d614388969b5eff86ba31ca with delete_type TABLET_DATA_DELETED (replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.850997 7333 master_service.cc:954] ReplaceTablet: received request to replace tablet 1f3466dbbf1d42d2b6310a6e44f95f9d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.851778 8051 tablet_replica.cc:333] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:23.851763 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bb972a845ed442d89889f9575da5c006"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.852037 8051 raft_consensus.cc:2243] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.852258 8051 raft_consensus.cc:2272] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:23.852365 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb972a845ed442d89889f9575da5c006 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.852824 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f05cad2989475fa0305e98f562037b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.853607 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f05cad2989475fa0305e98f562037b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.853636 8051 ts_tablet_manager.cc:1916] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.853780 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d2de86e5a88b47d2a990951ede96f55f" } modify_external_catalogs: true
I20260505 20:13:23.853942 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d2de86e5a88b47d2a990951ede96f55f" } modify_external_catalogs: true
I20260505 20:13:23.854410 8052 ts_tablet_manager.cc:1916] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.855926 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 4cbb29bc765d476cb4634178f2806c10
I20260505 20:13:23.856462 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet c1884e1306ae4aac9d599a93775c5d8d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.858088 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.858134 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet a026a8408ed9462b820b560a98dcabd1 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:23.859241 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:23.860221 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2841214f07b4ae6b8cd7e97493b69d6 consensus state has no leader
W20260505 20:13:23.861027 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f41cf3b6cf3a4ef6b7c077f78b793283 consensus state has no leader
I20260505 20:13:23.860996 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f9e3face23974d6ba5012aaa1d677869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.861588 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9e3face23974d6ba5012aaa1d677869 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.864056 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 24fc8fb89d614388969b5eff86ba31ca with delete_type TABLET_DATA_DELETED (replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.864326 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f05cad2989475fa0305e98f562037b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.864521 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.866103 8051 ts_tablet_manager.cc:1929] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.866343 8051 log.cc:1199] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/ae94d54b26b24d99b0b382fba9f5a542
I20260505 20:13:23.866909 8051 ts_tablet_manager.cc:1950] T ae94d54b26b24d99b0b382fba9f5a542 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.868638 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet ae94d54b26b24d99b0b382fba9f5a542 (table default.Table_7aa01cf42bad4323b9ac63a7e130b521 [id=885260685ed345f8a157266967b6606f]) successfully deleted
W20260505 20:13:23.869333 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 24fc8fb89d614388969b5eff86ba31ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24fc8fb89d614388969b5eff86ba31ca already in progress: creating tablet
W20260505 20:13:23.869973 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b4f05cad2989475fa0305e98f562037b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f05cad2989475fa0305e98f562037b already in progress: creating tablet
W20260505 20:13:23.870656 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 4cbb29bc765d476cb4634178f2806c10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cbb29bc765d476cb4634178f2806c10 already in progress: creating tablet
I20260505 20:13:23.871207 8058 raft_consensus.cc:359] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.871827 8058 raft_consensus.cc:385] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.872123 8058 raft_consensus.cc:740] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.872673 8058 consensus_queue.cc:260] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.874346 8058 ts_tablet_manager.cc:1434] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20260505 20:13:23.875326 8058 tablet_bootstrap.cc:492] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.879824 8052 ts_tablet_manager.cc:1929] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.879997 8052 log.cc:1199] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/15e64ed9bb7c44219dac4a36bfbec24f
I20260505 20:13:23.880443 8052 ts_tablet_manager.cc:1950] T 15e64ed9bb7c44219dac4a36bfbec24f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:23.880879 8058 tablet_bootstrap.cc:654] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.881175 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 15e64ed9bb7c44219dac4a36bfbec24f (table default.Table_c538874d901d449d9490a324fdc484a3 [id=3c74b3f7e0944d40857db619bc1058e4]) successfully deleted
W20260505 20:13:23.883538 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 24fc8fb89d614388969b5eff86ba31ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24fc8fb89d614388969b5eff86ba31ca already in progress: creating tablet
W20260505 20:13:23.885078 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet b4f05cad2989475fa0305e98f562037b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f05cad2989475fa0305e98f562037b already in progress: creating tablet
W20260505 20:13:23.886235 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 4cbb29bc765d476cb4634178f2806c10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cbb29bc765d476cb4634178f2806c10 already in progress: creating tablet
I20260505 20:13:23.887391 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c1884e1306ae4aac9d599a93775c5d8d
I20260505 20:13:23.887961 7338 catalog_manager.cc:6741] ReplaceTablet: tablet c1884e1306ae4aac9d599a93775c5d8d deleted and replaced by tablet 949fecb197084426b5a6adb959f5c886
I20260505 20:13:23.888329 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet c1884e1306ae4aac9d599a93775c5d8d with delete_type TABLET_DATA_DELETED (replaced by tablet 949fecb197084426b5a6adb959f5c886) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.888839 8052 tablet_replica.cc:333] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:23.888890 7342 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet e1249ecb8a1b4f29bb11168ba649347c
I20260505 20:13:23.889214 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet c1884e1306ae4aac9d599a93775c5d8d with delete_type TABLET_DATA_DELETED (replaced by tablet 949fecb197084426b5a6adb959f5c886) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.889500 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet a026a8408ed9462b820b560a98dcabd1
I20260505 20:13:23.889506 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet c1884e1306ae4aac9d599a93775c5d8d with delete_type TABLET_DATA_DELETED (replaced by tablet 949fecb197084426b5a6adb959f5c886) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.889999 8051 tablet_replica.cc:333] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:23.890056 7334 catalog_manager.cc:6741] ReplaceTablet: tablet a026a8408ed9462b820b560a98dcabd1 deleted and replaced by tablet ea726cff03664c3d81b5e541ef738d4a
I20260505 20:13:23.890269 8051 raft_consensus.cc:2243] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.891019 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet a026a8408ed9462b820b560a98dcabd1 with delete_type TABLET_DATA_DELETED (replaced by tablet ea726cff03664c3d81b5e541ef738d4a) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:23.890413 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet a026a8408ed9462b820b560a98dcabd1 with delete_type TABLET_DATA_DELETED (replaced by tablet ea726cff03664c3d81b5e541ef738d4a) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.891376 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet a026a8408ed9462b820b560a98dcabd1 with delete_type TABLET_DATA_DELETED (replaced by tablet ea726cff03664c3d81b5e541ef738d4a) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.889153 8052 raft_consensus.cc:2243] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:23.891819 8052 raft_consensus.cc:2272] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.891816 8051 raft_consensus.cc:2272] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.893210 8051 ts_tablet_manager.cc:1916] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.893456 8054 tablet_bootstrap.cc:492] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.895638 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 9146142e112e43a7a6ce0369122d5a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.900825 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 862e865d406c4d95b97b579e9fe07df0
I20260505 20:13:23.901995 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.902153 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.903190 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:23.903712 8202 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42664: Illegal state: RaftConsensus is not running: State = Stopped
I20260505 20:13:23.904536 8058 tablet_bootstrap.cc:492] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.905078 8054 tablet_bootstrap.cc:654] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.905529 8058 ts_tablet_manager.cc:1403] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.002s
I20260505 20:13:23.909674 8058 raft_consensus.cc:359] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.910876 8058 raft_consensus.cc:385] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.911185 8058 raft_consensus.cc:740] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.911742 8058 consensus_queue.cc:260] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.907388 8051 ts_tablet_manager.cc:1929] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260505 20:13:23.912660 8050 ts_tablet_manager.cc:1929] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.912725 8051 log.cc:1199] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c1884e1306ae4aac9d599a93775c5d8d
I20260505 20:13:23.913376 8051 ts_tablet_manager.cc:1950] T c1884e1306ae4aac9d599a93775c5d8d P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:23.914723 8053 tablet_bootstrap.cc:492] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.914918 8053 ts_tablet_manager.cc:1403] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.164s user 0.051s sys 0.080s
I20260505 20:13:23.915148 8058 ts_tablet_manager.cc:1434] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
W20260505 20:13:23.915182 7326 catalog_manager.cc:5081] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): alter failed for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]): Illegal state: RaftConsensus is not running: State = Stopped
I20260505 20:13:23.916082 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]) successfully deleted
I20260505 20:13:23.916270 8058 tablet_bootstrap.cc:492] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.915786 8053 raft_consensus.cc:359] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.916580 8053 raft_consensus.cc:385] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.916718 8053 raft_consensus.cc:740] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.917433 8053 consensus_queue.cc:260] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.917997 8053 ts_tablet_manager.cc:1434] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:23.918265 8053 tablet_bootstrap.cc:492] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.919479 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet de9b7c48be9042a19958c09941c2e429 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:23.919545 8052 ts_tablet_manager.cc:1916] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.922291 8053 tablet_bootstrap.cc:654] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.922564 8051 tablet_replica.cc:333] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
W20260505 20:13:23.922899 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet a026a8408ed9462b820b560a98dcabd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a026a8408ed9462b820b560a98dcabd1 already in progress: creating tablet
I20260505 20:13:23.923597 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:23.925572 7764 tablet_service.cc:1511] Processing CreateTablet for tablet d2676078f47c4bc19391227d9643c15f (DEFAULT_TABLE table=default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.926086 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2676078f47c4bc19391227d9643c15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.926914 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 98af33c2cdb24937858efdc7b638418f (DEFAULT_TABLE table=default.Table_7aa09788a9b54cab8303f80b2237ee4e [id=e8647104c97e4b258208aedab9f5f35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.927313 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98af33c2cdb24937858efdc7b638418f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.928961 7336 catalog_manager.cc:5671] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:23.928196 7630 tablet_service.cc:1511] Processing CreateTablet for tablet d2676078f47c4bc19391227d9643c15f (DEFAULT_TABLE table=default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.929383 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
I20260505 20:13:23.929524 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2676078f47c4bc19391227d9643c15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.932228 8053 tablet_bootstrap.cc:492] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:23.932404 8053 ts_tablet_manager.cc:1403] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20260505 20:13:23.932653 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 (DEFAULT_TABLE table=default.Table_4d8c7cb46fb847a9976a0337b0c7f7fa [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.933113 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944aad58d3c14577a0c66edd95fdf5e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.928521 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 98af33c2cdb24937858efdc7b638418f (DEFAULT_TABLE table=default.Table_7aa09788a9b54cab8303f80b2237ee4e [id=e8647104c97e4b258208aedab9f5f35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.933331 8053 raft_consensus.cc:359] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.933535 8053 raft_consensus.cc:385] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.933568 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98af33c2cdb24937858efdc7b638418f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.933629 8053 raft_consensus.cc:740] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.933969 8053 consensus_queue.cc:260] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.934028 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.934414 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84fb3dcea55d4b348cbf92c3c4581dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.934466 8053 ts_tablet_manager.cc:1434] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:23.936189 8053 tablet_bootstrap.cc:492] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:23.929046 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 (DEFAULT_TABLE table=default.Table_4d8c7cb46fb847a9976a0337b0c7f7fa [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.939260 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944aad58d3c14577a0c66edd95fdf5e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.941663 8079 raft_consensus.cc:493] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.941833 8079 raft_consensus.cc:515] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.941862 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd (DEFAULT_TABLE table=default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.942332 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4939dab5a4d54a08a75424bcaabbb8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.942386 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.942505 8079 leader_election.cc:290] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:23.942749 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84fb3dcea55d4b348cbf92c3c4581dda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.944280 7326 catalog_manager.cc:5075] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): alter failed for tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]),no further retry: Illegal state: Tablet not RUNNING: STOPPED
I20260505 20:13:23.945884 8053 tablet_bootstrap.cc:654] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:23.946969 8101 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:23.947382 8101 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:23.947502 8101 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260505 20:13:23.949848 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd (DEFAULT_TABLE table=default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.950239 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4939dab5a4d54a08a75424bcaabbb8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.927805 7908 tablet_service.cc:1511] Processing CreateTablet for tablet d2676078f47c4bc19391227d9643c15f (DEFAULT_TABLE table=default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.950775 8050 log.cc:1199] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8af906f570a04b668c8696817739a412
I20260505 20:13:23.951040 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2676078f47c4bc19391227d9643c15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.951223 8050 ts_tablet_manager.cc:1950] T 8af906f570a04b668c8696817739a412 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:23.952775 8050 tablet_replica.cc:333] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:23.952925 8050 raft_consensus.cc:2243] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.953066 8050 raft_consensus.cc:2272] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.953433 8050 ts_tablet_manager.cc:1916] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.954046 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c (DEFAULT_TABLE table=default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.954420 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c12a95b0ed445c7b598db136f6ac05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.928176 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 98af33c2cdb24937858efdc7b638418f (DEFAULT_TABLE table=default.Table_7aa09788a9b54cab8303f80b2237ee4e [id=e8647104c97e4b258208aedab9f5f35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.958205 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98af33c2cdb24937858efdc7b638418f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.959580 8194 raft_consensus.cc:493] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.959774 8194 raft_consensus.cc:515] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.960511 8194 leader_election.cc:290] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:23.961966 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 8af906f570a04b668c8696817739a412 (table default.Table_6d0efc4c31774452a20d42a0135965e0 [id=087098008f924e61874b6d84181048bf]) successfully deleted
I20260505 20:13:23.962064 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c (DEFAULT_TABLE table=default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.962131 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e64ed9bb7c44219dac4a36bfbec24f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:23.962265 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 89f6ba8e4cba410daad729576d876329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f6ba8e4cba410daad729576d876329 already in progress: creating tablet
I20260505 20:13:23.962455 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c12a95b0ed445c7b598db136f6ac05c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.962469 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 99ab400210c54e99bc396674f7ba8235 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99ab400210c54e99bc396674f7ba8235 already in progress: creating tablet
W20260505 20:13:23.962641 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 3e77ec84858a4e46a993c579d9990f1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e77ec84858a4e46a993c579d9990f1b already in progress: creating tablet
W20260505 20:13:23.962867 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c104bd9c39af48449718b0c7f327f6ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c104bd9c39af48449718b0c7f327f6ec already in progress: creating tablet
W20260505 20:13:23.962980 7870 leader_election.cc:343] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:23.963068 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c95cba502b064583a50fb85ba7dea1b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c95cba502b064583a50fb85ba7dea1b5 already in progress: creating tablet
W20260505 20:13:23.963238 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8824bed6d2e9411d86651dfcffa77718 because the tablet was not found. No further retry: Not found: Tablet not found: 8824bed6d2e9411d86651dfcffa77718
W20260505 20:13:23.963416 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 because the tablet was not found. No further retry: Not found: Tablet not found: 96a4a2fef35c4b9bb68edca0fb2dd127
W20260505 20:13:23.965919 7598 leader_election.cc:343] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: de9b7c48be9042a19958c09941c2e429
I20260505 20:13:23.938076 8127 raft_consensus.cc:493] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:23.968463 8127 raft_consensus.cc:515] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.969189 8127 leader_election.cc:290] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:23.938809 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 (DEFAULT_TABLE table=default.Table_4d8c7cb46fb847a9976a0337b0c7f7fa [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.969588 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944aad58d3c14577a0c66edd95fdf5e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:23.970937 8101 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260505 20:13:23.971086 8101 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:23.971225 8101 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260505 20:13:23.971323 8101 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260505 20:13:23.971266 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32780089f084e57ab07a222e1353eff" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:23.972023 7870 leader_election.cc:343] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:23.939217 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.950623 8054 tablet_bootstrap.cc:492] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:23.973958 8054 ts_tablet_manager.cc:1403] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.002s
I20260505 20:13:23.974062 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84fb3dcea55d4b348cbf92c3c4581dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.957603 8050 ts_tablet_manager.cc:1929] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:23.975474 8054 raft_consensus.cc:359] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.975663 8054 raft_consensus.cc:385] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.976017 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_0f5f9bf433a14811882fb1e5a2f93aba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.975977 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_74b14c0104de480d8de826c45ff1cf37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:23.976343 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bb26086f0d304240b95bbc9c075b996f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.976653 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f5f9bf433a14811882fb1e5a2f93aba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:23.976824 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb26086f0d304240b95bbc9c075b996f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.978018 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d4acc8d2798141beab39776ab03434ea" } new_table_name: "default.Table_ffa875058cee4e55be4b729695429088" modify_external_catalogs: true
W20260505 20:13:23.976665 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74b14c0104de480d8de826c45ff1cf37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.979282 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_21e350c2f410430db36b12553e5e7829" } new_table_name: "default.Table_4f484e9071f845ac974813427f3f0b8d" modify_external_catalogs: true
I20260505 20:13:23.980468 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b677360578864cf6b251512952987f68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:23.980986 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b677360578864cf6b251512952987f68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:23.982141 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_976061a8cd004c20a33f68445f330d0e" } modify_external_catalogs: true
I20260505 20:13:23.922966 8051 raft_consensus.cc:2243] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:23.982316 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_976061a8cd004c20a33f68445f330d0e" } modify_external_catalogs: true
I20260505 20:13:23.982380 8054 raft_consensus.cc:740] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.982810 8054 consensus_queue.cc:260] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:23.983701 8054 ts_tablet_manager.cc:1434] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260505 20:13:23.984037 8050 log.cc:1199] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/acd0f0fba5284283b472d6ddd1fcd69c
I20260505 20:13:23.984475 8051 raft_consensus.cc:2272] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:23.985314 8051 ts_tablet_manager.cc:1916] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:23.985859 8058 tablet_bootstrap.cc:654] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:23.991145 8058 tablet_bootstrap.cc:492] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:23.991312 8058 ts_tablet_manager.cc:1403] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.004s
I20260505 20:13:23.992118 8058 raft_consensus.cc:359] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.992311 8058 raft_consensus.cc:385] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:23.992391 8058 raft_consensus.cc:740] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:23.992601 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd (DEFAULT_TABLE table=default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:23.992667 8058 consensus_queue.cc:260] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:23.994129 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4939dab5a4d54a08a75424bcaabbb8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:23.995513 8054 tablet_bootstrap.cc:492] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:23.995765 8058 ts_tablet_manager.cc:1434] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:23.996291 8058 tablet_bootstrap.cc:492] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:23.999650 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 1f3466dbbf1d42d2b6310a6e44f95f9d
I20260505 20:13:24.000104 7333 catalog_manager.cc:6741] ReplaceTablet: tablet 1f3466dbbf1d42d2b6310a6e44f95f9d deleted and replaced by tablet bd01314146a34257b444a622829b2fe4
I20260505 20:13:24.001384 8058 tablet_bootstrap.cc:654] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.002496 8051 ts_tablet_manager.cc:1929] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.002743 8051 log.cc:1199] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/9146142e112e43a7a6ce0369122d5a46
I20260505 20:13:24.002975 8101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.252:42521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.33.252
--webserver_port=39007
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
I20260505 20:13:24.003420 8051 ts_tablet_manager.cc:1950] T 9146142e112e43a7a6ce0369122d5a46 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.004825 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d with delete_type TABLET_DATA_DELETED (replaced by tablet bd01314146a34257b444a622829b2fe4) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.005400 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 9146142e112e43a7a6ce0369122d5a46 (table default.Table_ccc54b09fe5c46f2ba83a103140c2ad7 [id=6640ef1039bc44dfb8e16f6fdff9e8a8]) successfully deleted
I20260505 20:13:24.006891 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d with delete_type TABLET_DATA_DELETED (replaced by tablet bd01314146a34257b444a622829b2fe4) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.007098 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c (DEFAULT_TABLE table=default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.007378 8101 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:24.008241 8089 raft_consensus.cc:493] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.009608 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 0138b762a0c74ecda3b43167dd5bfc04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.009896 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d with delete_type TABLET_DATA_DELETED (replaced by tablet bd01314146a34257b444a622829b2fe4) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.009986 8101 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260505 20:13:24.010138 8050 ts_tablet_manager.cc:1950] T acd0f0fba5284283b472d6ddd1fcd69c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.011147 8089 raft_consensus.cc:515] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:24.011430 7869 leader_election.cc:343] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 15e64ed9bb7c44219dac4a36bfbec24f
I20260505 20:13:24.011581 7869 leader_election.cc:304] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.011751 8089 leader_election.cc:290] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.012072 8127 raft_consensus.cc:2749] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:24.012494 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2461ad6b3ec94233b9dd7f60cbad4639" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.012823 8051 tablet_replica.cc:333] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.013010 8051 raft_consensus.cc:2243] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.013172 8051 raft_consensus.cc:2272] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.013824 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c12a95b0ed445c7b598db136f6ac05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.013954 8051 ts_tablet_manager.cc:1916] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.015187 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32780089f084e57ab07a222e1353eff" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:24.015767 7736 leader_election.cc:343] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:24.016229 7596 leader_election.cc:343] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: de9b7c48be9042a19958c09941c2e429
I20260505 20:13:24.016361 7596 leader_election.cc:304] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:24.016541 7596 raft_consensus.cc:2686] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:24.017531 8050 tablet_replica.cc:333] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.019210 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet acd0f0fba5284283b472d6ddd1fcd69c (table default.Table_206e9638b58b41f892b4b9f29c7b7e3e [id=2d1a1f685c25435d84db53ec232bea74]) successfully deleted
W20260505 20:13:24.019937 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 862e865d406c4d95b97b579e9fe07df0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 862e865d406c4d95b97b579e9fe07df0 already in progress: creating tablet
I20260505 20:13:24.023411 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2461ad6b3ec94233b9dd7f60cbad4639" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:24.023653 7936 raft_consensus.cc:2468] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:24.024592 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff4ea5fcb558489097e518a28ad967dd consensus state has no leader
I20260505 20:13:24.025988 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet ee3543a2f89f43a8ab938e3585953953
I20260505 20:13:24.028475 8050 raft_consensus.cc:2243] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.028757 8050 raft_consensus.cc:2272] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.029170 8054 tablet_bootstrap.cc:654] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.030360 8051 ts_tablet_manager.cc:1929] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.033313 8050 ts_tablet_manager.cc:1916] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.033413 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.036358 8052 ts_tablet_manager.cc:1929] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20260505 20:13:24.037082 7869 leader_election.cc:343] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.037654 7869 leader_election.cc:304] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.038550 8127 raft_consensus.cc:2749] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:24.039595 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.038594 7737 leader_election.cc:304] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.042249 8051 log.cc:1199] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/de9b7c48be9042a19958c09941c2e429
I20260505 20:13:24.042600 8089 raft_consensus.cc:2804] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.042699 8051 ts_tablet_manager.cc:1950] T de9b7c48be9042a19958c09941c2e429 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.042717 8089 raft_consensus.cc:493] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.042835 8089 raft_consensus.cc:3060] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.043882 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet de9b7c48be9042a19958c09941c2e429 (table default.Table_a44e5fe432f54a4585b4357ff357b81f [id=b15ea326ca9448f396e9f0e34c3e04f4]) successfully deleted
I20260505 20:13:24.044119 8051 tablet_replica.cc:333] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.044512 8051 raft_consensus.cc:2243] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.044718 8051 raft_consensus.cc:2272] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.045416 8089 raft_consensus.cc:515] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.046131 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.047227 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2461ad6b3ec94233b9dd7f60cbad4639" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:24.047746 7736 leader_election.cc:343] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.048084 8089 leader_election.cc:290] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.048743 8052 log.cc:1199] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c1884e1306ae4aac9d599a93775c5d8d
I20260505 20:13:24.049038 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2461ad6b3ec94233b9dd7f60cbad4639" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:24.049183 8052 ts_tablet_manager.cc:1950] T c1884e1306ae4aac9d599a93775c5d8d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.049224 7936 raft_consensus.cc:3060] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.049616 8050 ts_tablet_manager.cc:1929] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:24.050060 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6acad22190b402d892d06ff97bd9476 has no consensus state
I20260505 20:13:24.050413 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]) successfully deleted
I20260505 20:13:24.051254 8050 log.cc:1199] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/47de1578fdd74a198c48606aec33880a
W20260505 20:13:24.052022 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet a026a8408ed9462b820b560a98dcabd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a026a8408ed9462b820b560a98dcabd1 already in progress: creating tablet
W20260505 20:13:24.052901 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 862e865d406c4d95b97b579e9fe07df0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 862e865d406c4d95b97b579e9fe07df0 already in progress: creating tablet
I20260505 20:13:24.053439 8052 tablet_replica.cc:333] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.053841 8052 raft_consensus.cc:2243] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.053857 7936 raft_consensus.cc:2468] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:24.054284 7737 leader_election.cc:304] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.054970 8089 raft_consensus.cc:2804] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:24.055305 8089 raft_consensus.cc:697] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:24.055611 8089 consensus_queue.cc:237] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.056829 8050 ts_tablet_manager.cc:1950] T 47de1578fdd74a198c48606aec33880a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.062915 8050 tablet_replica.cc:333] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.062875 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 47de1578fdd74a198c48606aec33880a (table default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]) successfully deleted
I20260505 20:13:24.063227 8050 raft_consensus.cc:2243] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.063843 8050 raft_consensus.cc:2272] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.067602 8127 raft_consensus.cc:493] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.067813 8127 raft_consensus.cc:515] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.068033 8050 ts_tablet_manager.cc:1916] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.068531 8127 leader_election.cc:290] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.069343 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02eafc72ff7d4055b424322e01dc0c84" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:24.069981 7870 leader_election.cc:343] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.071820 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02eafc72ff7d4055b424322e01dc0c84" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:24.073902 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.074604 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3bc5f620994f44e1b9c8ac44f7bd3618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.074851 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ee9c40896ce845dd9843cecf2a713762" } new_table_name: "default.Table_f8a78065267349b482f885d8be417dbf" modify_external_catalogs: true
W20260505 20:13:24.075189 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.076318 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_dac15532a6214097912a12004f5f2bef" } modify_external_catalogs: true
I20260505 20:13:24.076556 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_dac15532a6214097912a12004f5f2bef" } modify_external_catalogs: true
W20260505 20:13:24.074630 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.077139 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2aab7fb908ab42e88832482b231fe6f8" } new_table_name: "default.Table_648a436e7aa947bea4ebaff4d26c3357" modify_external_catalogs: true
I20260505 20:13:24.077993 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_96d86a6e49174181adfbd3401006cb3b" } new_table_name: "default.Table_4f52fc53fe804024afb6471c231bbe43" modify_external_catalogs: true
W20260505 20:13:24.078251 7869 leader_election.cc:343] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.078368 8052 raft_consensus.cc:2272] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.078404 7869 leader_election.cc:304] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.078878 8127 raft_consensus.cc:2749] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:24.079224 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1cd5f89bd70c4112b673b1a54ce5dc61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.079324 8052 ts_tablet_manager.cc:1916] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:24.079752 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cd5f89bd70c4112b673b1a54ce5dc61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.080842 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b8dc23a61d1044d387ba34de22f570cb" } modify_external_catalogs: true
I20260505 20:13:24.081023 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b8dc23a61d1044d387ba34de22f570cb" } modify_external_catalogs: true
I20260505 20:13:24.082026 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c6739319907248c5a2b1f0bc5c1afd77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.082580 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6739319907248c5a2b1f0bc5c1afd77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.083775 8058 tablet_bootstrap.cc:492] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.084002 8058 ts_tablet_manager.cc:1403] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.088s user 0.000s sys 0.008s
I20260505 20:13:24.085157 8051 ts_tablet_manager.cc:1916] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.090039 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet e32780089f084e57ab07a222e1353eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.091959 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 944bc61fe79c4f94bb280dae8e3cee59 (DEFAULT_TABLE table=default.Table_bb972a845ed442d89889f9575da5c006 [id=bad5400c5cdc48eea57213e792147647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.092404 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944bc61fe79c4f94bb280dae8e3cee59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.092435 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 47de1578fdd74a198c48606aec33880a with delete_type TABLET_DATA_DELETED (replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.092501 8051 ts_tablet_manager.cc:1929] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.092650 8051 log.cc:1199] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/0138b762a0c74ecda3b43167dd5bfc04
I20260505 20:13:24.093091 8051 ts_tablet_manager.cc:1950] T 0138b762a0c74ecda3b43167dd5bfc04 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.095351 7643 tablet_service.cc:1511] Processing CreateTablet for tablet c6acad22190b402d892d06ff97bd9476 (DEFAULT_TABLE table=default.Table_4f484e9071f845ac974813427f3f0b8d [id=4cd4fd352ad747f4b7fc43a0d7f15322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.095481 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 944bc61fe79c4f94bb280dae8e3cee59 (DEFAULT_TABLE table=default.Table_bb972a845ed442d89889f9575da5c006 [id=bad5400c5cdc48eea57213e792147647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.095818 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6acad22190b402d892d06ff97bd9476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.095852 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944bc61fe79c4f94bb280dae8e3cee59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.097325 7911 tablet_service.cc:1511] Processing CreateTablet for tablet c6acad22190b402d892d06ff97bd9476 (DEFAULT_TABLE table=default.Table_4f484e9071f845ac974813427f3f0b8d [id=4cd4fd352ad747f4b7fc43a0d7f15322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.097695 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6acad22190b402d892d06ff97bd9476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.098068 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 22a98da176254eeb896c680fbcb98caa (DEFAULT_TABLE table=default.Table_71c89ce7dcda42769625f9694e5923e2 [id=267a96cb67ed4025aff2c3d34f233da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.098423 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a98da176254eeb896c680fbcb98caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.102154 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 944bc61fe79c4f94bb280dae8e3cee59 (DEFAULT_TABLE table=default.Table_bb972a845ed442d89889f9575da5c006 [id=bad5400c5cdc48eea57213e792147647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.102500 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944bc61fe79c4f94bb280dae8e3cee59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.105686 8050 ts_tablet_manager.cc:1929] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.105899 8050 log.cc:1199] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/78edaee6c4e946b1a7c7302d20aa5d7d
I20260505 20:13:24.106295 8050 ts_tablet_manager.cc:1950] T 78edaee6c4e946b1a7c7302d20aa5d7d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.108191 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 22a98da176254eeb896c680fbcb98caa (DEFAULT_TABLE table=default.Table_71c89ce7dcda42769625f9694e5923e2 [id=267a96cb67ed4025aff2c3d34f233da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.109220 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a98da176254eeb896c680fbcb98caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.110749 7311 master_runner.cc:186] Error getting master registration for 127.7.33.252:42521: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111),
I20260505 20:13:24.110926 7311 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260505 20:13:24.111603 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8b4013ec119f4c35aef190778e2fa5c6" } modify_external_catalogs: true
I20260505 20:13:24.111786 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8b4013ec119f4c35aef190778e2fa5c6" } modify_external_catalogs: true
I20260505 20:13:24.114286 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c45aaeaeb65a4db4a5766fc43ade26ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.114858 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c45aaeaeb65a4db4a5766fc43ade26ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:24.115824 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ec1037f771740d1a094a622d5e49082 consensus state has no leader
I20260505 20:13:24.116209 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 78edaee6c4e946b1a7c7302d20aa5d7d (table default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]) successfully deleted
I20260505 20:13:24.116205 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c6fb56a940914efea745a3928384c125" } modify_external_catalogs: true
I20260505 20:13:24.116451 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c6fb56a940914efea745a3928384c125" } modify_external_catalogs: true
W20260505 20:13:24.117681 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2461ad6b3ec94233b9dd7f60cbad4639 consensus state has no leader
I20260505 20:13:24.115835 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_90124bd7f0774a3ab49bcd90a3ec3733"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.118446 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 22a98da176254eeb896c680fbcb98caa (DEFAULT_TABLE table=default.Table_71c89ce7dcda42769625f9694e5923e2 [id=267a96cb67ed4025aff2c3d34f233da1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:24.118553 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet a1f5bfa086f9422ebda96b2485ad986b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1f5bfa086f9422ebda96b2485ad986b already in progress: creating tablet
W20260505 20:13:24.118593 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90124bd7f0774a3ab49bcd90a3ec3733 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.118884 8050 tablet_replica.cc:333] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.118893 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a98da176254eeb896c680fbcb98caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.119563 8050 raft_consensus.cc:2243] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.119763 8050 raft_consensus.cc:2272] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.120642 8050 ts_tablet_manager.cc:1916] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.121680 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 0138b762a0c74ecda3b43167dd5bfc04 (table default.Table_8f5799bc8b2b4f39b309936338cbe0fa [id=5a01343c41cf47d3b1fe5c49ff9d9660]) successfully deleted
W20260505 20:13:24.121912 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3466dbbf1d42d2b6310a6e44f95f9d already in progress: creating tablet
W20260505 20:13:24.122184 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet ee3543a2f89f43a8ab938e3585953953 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee3543a2f89f43a8ab938e3585953953 already in progress: creating tablet
I20260505 20:13:24.122218 7764 tablet_service.cc:1511] Processing CreateTablet for tablet c6acad22190b402d892d06ff97bd9476 (DEFAULT_TABLE table=default.Table_4f484e9071f845ac974813427f3f0b8d [id=4cd4fd352ad747f4b7fc43a0d7f15322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.122700 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6acad22190b402d892d06ff97bd9476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.085161 8058 raft_consensus.cc:359] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.134070 8058 raft_consensus.cc:385] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.134204 8058 raft_consensus.cc:740] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.134601 8058 consensus_queue.cc:260] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.135560 8058 ts_tablet_manager.cc:1434] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.051s user 0.000s sys 0.002s
I20260505 20:13:24.135954 8058 tablet_bootstrap.cc:492] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.138015 8058 tablet_bootstrap.cc:654] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.141393 8053 tablet_bootstrap.cc:492] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.141561 8053 ts_tablet_manager.cc:1403] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.205s user 0.006s sys 0.008s
I20260505 20:13:24.143265 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 40dfb8da73284065a3d97df18a738dc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.143502 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 3679480e55444d0d935f262217e44485 (DEFAULT_TABLE table=default.Table_c0743365402b4252bd3c5c7a95a9e5ee [id=5579cbeef0624d4a8cb8beeac55362e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.143929 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3679480e55444d0d935f262217e44485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.148119 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 3679480e55444d0d935f262217e44485 (DEFAULT_TABLE table=default.Table_c0743365402b4252bd3c5c7a95a9e5ee [id=5579cbeef0624d4a8cb8beeac55362e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:24.148531 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa6589a0f15d4f31acc2e49e6c071e6a consensus state has no leader
I20260505 20:13:24.148610 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3679480e55444d0d935f262217e44485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.148737 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.149092 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.150813 8051 tablet_replica.cc:333] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.151014 8051 raft_consensus.cc:2243] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.151183 8051 raft_consensus.cc:2272] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.152514 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.152900 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.154649 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 50c1f63c849c48438abdaa965ab051f9 (DEFAULT_TABLE table=default.Table_f9e3face23974d6ba5012aaa1d677869 [id=bbe541cae6d84762803eb4314c63ac7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.155033 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c1f63c849c48438abdaa965ab051f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.155161 7335 catalog_manager.cc:5671] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:24.155664 7335 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:24.159788 8051 ts_tablet_manager.cc:1916] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.162046 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 50c1f63c849c48438abdaa965ab051f9 (DEFAULT_TABLE table=default.Table_f9e3face23974d6ba5012aaa1d677869 [id=bbe541cae6d84762803eb4314c63ac7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.162534 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c1f63c849c48438abdaa965ab051f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.163297 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet d2676078f47c4bc19391227d9643c15f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.164716 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 4cbb29bc765d476cb4634178f2806c10 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.165194 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 3e77ec84858a4e46a993c579d9990f1b from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.166141 8050 ts_tablet_manager.cc:1929] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.166332 8050 log.cc:1199] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/15e64ed9bb7c44219dac4a36bfbec24f
I20260505 20:13:24.166757 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 3679480e55444d0d935f262217e44485 (DEFAULT_TABLE table=default.Table_c0743365402b4252bd3c5c7a95a9e5ee [id=5579cbeef0624d4a8cb8beeac55362e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.169345 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet ee3543a2f89f43a8ab938e3585953953 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.171134 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 923ed274fe454cc4a625516769e6b5f3
I20260505 20:13:24.172112 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.166999 8050 ts_tablet_manager.cc:1950] T 15e64ed9bb7c44219dac4a36bfbec24f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.167196 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3679480e55444d0d935f262217e44485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.167272 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.173787 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.173863 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 15e64ed9bb7c44219dac4a36bfbec24f (table default.Table_c538874d901d449d9490a324fdc484a3 [id=3c74b3f7e0944d40857db619bc1058e4]) successfully deleted
I20260505 20:13:24.168465 8054 tablet_bootstrap.cc:492] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.172101 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.174192 8054 ts_tablet_manager.cc:1403] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.190s user 0.003s sys 0.011s
I20260505 20:13:24.175339 8054 raft_consensus.cc:359] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.175534 8052 ts_tablet_manager.cc:1929] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.175624 8054 raft_consensus.cc:385] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.175657 8052 log.cc:1199] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/02eafc72ff7d4055b424322e01dc0c84
I20260505 20:13:24.175716 8054 raft_consensus.cc:740] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.175768 8050 tablet_replica.cc:333] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.176025 8052 ts_tablet_manager.cc:1950] T 02eafc72ff7d4055b424322e01dc0c84 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.176004 8054 consensus_queue.cc:260] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.176262 8050 raft_consensus.cc:2243] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.142843 8053 raft_consensus.cc:359] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.177098 8053 raft_consensus.cc:385] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.177191 8053 raft_consensus.cc:740] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:24.177222 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 725cb481751048c29695726011c80c08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 725cb481751048c29695726011c80c08 already in progress: creating tablet
I20260505 20:13:24.177412 8053 consensus_queue.cc:260] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.177544 8050 raft_consensus.cc:2272] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:24.177520 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 13a4ddebda9447389c15be61aa60baaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13a4ddebda9447389c15be61aa60baaf already in progress: creating tablet
I20260505 20:13:24.177631 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 02eafc72ff7d4055b424322e01dc0c84 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]) successfully deleted
W20260505 20:13:24.177835 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 5b0d6b6035154e01850e7a158ad22dfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b0d6b6035154e01850e7a158ad22dfa already in progress: creating tablet
W20260505 20:13:24.178061 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 20eeb04e0a574132b247d5ce6d7add44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20eeb04e0a574132b247d5ce6d7add44 already in progress: creating tablet
I20260505 20:13:24.178097 8050 ts_tablet_manager.cc:1916] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.179176 8054 ts_tablet_manager.cc:1434] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:24.179541 8054 tablet_bootstrap.cc:492] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.180442 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.180887 8053 ts_tablet_manager.cc:1434] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.039s user 0.000s sys 0.003s
I20260505 20:13:24.181254 8053 tablet_bootstrap.cc:492] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.183214 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 50c1f63c849c48438abdaa965ab051f9 (DEFAULT_TABLE table=default.Table_f9e3face23974d6ba5012aaa1d677869 [id=bbe541cae6d84762803eb4314c63ac7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.183609 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c1f63c849c48438abdaa965ab051f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.183954 8054 tablet_bootstrap.cc:654] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.184190 8051 ts_tablet_manager.cc:1929] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.184315 8051 log.cc:1199] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/40dfb8da73284065a3d97df18a738dc4
I20260505 20:13:24.184677 8051 ts_tablet_manager.cc:1950] T 40dfb8da73284065a3d97df18a738dc4 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.186482 7764 tablet_service.cc:1511] Processing CreateTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 (DEFAULT_TABLE table=default.Table_8b4013ec119f4c35aef190778e2fa5c6 [id=8ac7668d8df2475098e86492dd431fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.186854 7905 tablet_service.cc:1511] Processing CreateTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 (DEFAULT_TABLE table=default.Table_8b4013ec119f4c35aef190778e2fa5c6 [id=8ac7668d8df2475098e86492dd431fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.187259 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a42f0b6dc74cbd8d72ae36410f9d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.187920 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 949fecb197084426b5a6adb959f5c886 (DEFAULT_TABLE table=default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.188264 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949fecb197084426b5a6adb959f5c886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.186883 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a42f0b6dc74cbd8d72ae36410f9d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.187368 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 949fecb197084426b5a6adb959f5c886 (DEFAULT_TABLE table=default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.188910 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949fecb197084426b5a6adb959f5c886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.190743 7339 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]). Expected version 1 got 0
I20260505 20:13:24.193758 7339 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]). Expected version 1 got 0
I20260505 20:13:24.194878 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 949fecb197084426b5a6adb959f5c886 (DEFAULT_TABLE table=default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.194861 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5ed062508b411eb0fa5a14637830ea (DEFAULT_TABLE table=default.Table_60314b7c9136475184b40323c1985237 [id=633565e251844b0aa66147472deee05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.195246 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ed062508b411eb0fa5a14637830ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.195264 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949fecb197084426b5a6adb959f5c886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.198083 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb (DEFAULT_TABLE table=default.Table_c1015d9a8a7a49cba428a699afd14df2 [id=4137f9cb4fb646c4b7cd33fae3e93ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.198448 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed44127b4c848bf9ed4a49ad8b106fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.202069 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5ed062508b411eb0fa5a14637830ea (DEFAULT_TABLE table=default.Table_60314b7c9136475184b40323c1985237 [id=633565e251844b0aa66147472deee05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.202436 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ed062508b411eb0fa5a14637830ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.188413 8053 tablet_bootstrap.cc:654] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.205853 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 972b5c40369d41739d8c7a5bca22f04e
I20260505 20:13:24.206640 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:24.207227 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:24.210443 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.210502 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3466dbbf1d42d2b6310a6e44f95f9d already in progress: creating tablet
I20260505 20:13:24.210688 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.210767 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet ee3543a2f89f43a8ab938e3585953953 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee3543a2f89f43a8ab938e3585953953 already in progress: creating tablet
W20260505 20:13:24.211017 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 923ed274fe454cc4a625516769e6b5f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 923ed274fe454cc4a625516769e6b5f3 already in progress: creating tablet
W20260505 20:13:24.211831 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 because the tablet was not found. No further retry: Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:24.211647 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb (DEFAULT_TABLE table=default.Table_c1015d9a8a7a49cba428a699afd14df2 [id=4137f9cb4fb646c4b7cd33fae3e93ebf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:24.212131 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet beb404fa927641f48f28c6bdaa297db3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb404fa927641f48f28c6bdaa297db3 already in progress: creating tablet
I20260505 20:13:24.212229 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed44127b4c848bf9ed4a49ad8b106fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.216642 7630 tablet_service.cc:1511] Processing CreateTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 (DEFAULT_TABLE table=default.Table_8b4013ec119f4c35aef190778e2fa5c6 [id=8ac7668d8df2475098e86492dd431fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.216759 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 40dfb8da73284065a3d97df18a738dc4 (table default.Table_87d54561ed754d9b83ec983b110c6899 [id=066d18dc94b24dc48ded2961f4b4f567]) successfully deleted
I20260505 20:13:24.216889 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.217087 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a42f0b6dc74cbd8d72ae36410f9d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.217120 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.217442 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 972b5c40369d41739d8c7a5bca22f04e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:24.217577 7326 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b5e553dfc45494b948a59ce6c8b11d0 [id=a3200160268d450dbc28b0097c29eea2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 983ad31892394f67a7a9a727dc2bef1b consensus state has no leader
I20260505 20:13:24.218595 8053 tablet_bootstrap.cc:492] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.218765 8053 ts_tablet_manager.cc:1403] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.001s
I20260505 20:13:24.219537 8053 raft_consensus.cc:359] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.219758 8053 raft_consensus.cc:385] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.219833 8053 raft_consensus.cc:740] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.220068 8053 consensus_queue.cc:260] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.220402 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 972b5c40369d41739d8c7a5bca22f04e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.220353 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb (DEFAULT_TABLE table=default.Table_c1015d9a8a7a49cba428a699afd14df2 [id=4137f9cb4fb646c4b7cd33fae3e93ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.220700 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.220822 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 0d5ed062508b411eb0fa5a14637830ea (DEFAULT_TABLE table=default.Table_60314b7c9136475184b40323c1985237 [id=633565e251844b0aa66147472deee05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.220919 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.221197 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5ed062508b411eb0fa5a14637830ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.221813 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed44127b4c848bf9ed4a49ad8b106fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.226361 8050 ts_tablet_manager.cc:1929] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.226719 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet aa6589a0f15d4f31acc2e49e6c071e6a from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:24.227845 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 923ed274fe454cc4a625516769e6b5f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 923ed274fe454cc4a625516769e6b5f3 already in progress: creating tablet
W20260505 20:13:24.228147 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 because the tablet was not found. No further retry: Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:24.228354 8050 log.cc:1199] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/02eafc72ff7d4055b424322e01dc0c84
W20260505 20:13:24.228375 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet beb404fa927641f48f28c6bdaa297db3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb404fa927641f48f28c6bdaa297db3 already in progress: creating tablet
W20260505 20:13:24.228622 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 972b5c40369d41739d8c7a5bca22f04e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 972b5c40369d41739d8c7a5bca22f04e already in progress: creating tablet
I20260505 20:13:24.229182 8050 ts_tablet_manager.cc:1950] T 02eafc72ff7d4055b424322e01dc0c84 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.233805 8050 tablet_replica.cc:333] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.234679 8053 ts_tablet_manager.cc:1434] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260505 20:13:24.235261 8050 raft_consensus.cc:2243] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.235813 8050 raft_consensus.cc:2272] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.235843 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 02eafc72ff7d4055b424322e01dc0c84 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]) successfully deleted
I20260505 20:13:24.236147 8053 tablet_bootstrap.cc:492] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:24.236182 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 293ea58772bb4b479501d4bf3ead3ba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 293ea58772bb4b479501d4bf3ead3ba0 already in progress: creating tablet
W20260505 20:13:24.236397 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb already in progress: creating tablet
W20260505 20:13:24.236680 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 24fc8fb89d614388969b5eff86ba31ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24fc8fb89d614388969b5eff86ba31ca already in progress: creating tablet
W20260505 20:13:24.236915 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b4f05cad2989475fa0305e98f562037b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4f05cad2989475fa0305e98f562037b already in progress: creating tablet
W20260505 20:13:24.237155 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 4cbb29bc765d476cb4634178f2806c10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cbb29bc765d476cb4634178f2806c10 already in progress: creating tablet
I20260505 20:13:24.237285 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 972b5c40369d41739d8c7a5bca22f04e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.237674 8050 ts_tablet_manager.cc:1916] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:24.238004 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 972b5c40369d41739d8c7a5bca22f04e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 972b5c40369d41739d8c7a5bca22f04e already in progress: creating tablet
I20260505 20:13:24.239886 8053 tablet_bootstrap.cc:654] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.241119 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1e6d72c57e42f09432a30295c47f1f (DEFAULT_TABLE table=default.Table_936302b13c514b96bd4a3f61995da46d [id=cc685c3c73114d9a8ec2533202346623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.241707 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1e6d72c57e42f09432a30295c47f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.248953 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1e6d72c57e42f09432a30295c47f1f (DEFAULT_TABLE table=default.Table_936302b13c514b96bd4a3f61995da46d [id=cc685c3c73114d9a8ec2533202346623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.249475 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1e6d72c57e42f09432a30295c47f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.249650 8053 tablet_bootstrap.cc:492] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.249832 8053 ts_tablet_manager.cc:1403] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.009s
I20260505 20:13:24.250667 8053 raft_consensus.cc:359] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.250859 8053 raft_consensus.cc:385] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.251315 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1e6d72c57e42f09432a30295c47f1f (DEFAULT_TABLE table=default.Table_936302b13c514b96bd4a3f61995da46d [id=cc685c3c73114d9a8ec2533202346623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.251715 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1e6d72c57e42f09432a30295c47f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.252504 8050 ts_tablet_manager.cc:1929] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260505 20:13:24.253461 8050 log.cc:1199] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c1884e1306ae4aac9d599a93775c5d8d
I20260505 20:13:24.254133 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_0f694abaae6f4ded97efb1bba5f767bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.254367 8058 tablet_bootstrap.cc:492] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.254518 8058 ts_tablet_manager.cc:1403] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.119s user 0.002s sys 0.001s
W20260505 20:13:24.254876 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f694abaae6f4ded97efb1bba5f767bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.255271 8050 ts_tablet_manager.cc:1950] T c1884e1306ae4aac9d599a93775c5d8d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.255378 8058 raft_consensus.cc:359] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.255554 8058 raft_consensus.cc:385] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.255645 8058 raft_consensus.cc:740] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.256359 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c45aaeaeb65a4db4a5766fc43ade26ea" } new_table_name: "default.Table_27d8b323d032484d91f6906c154d0191" modify_external_catalogs: true
I20260505 20:13:24.257850 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1ed5779651c64985885b1277795cd799"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.257941 8058 consensus_queue.cc:260] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.250958 8053 raft_consensus.cc:740] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:24.258337 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ed5779651c64985885b1277795cd799 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.258460 8053 consensus_queue.cc:260] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.260672 8050 tablet_replica.cc:333] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.260890 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c1884e1306ae4aac9d599a93775c5d8d (table default.Table_bf624872acc84e63b23fe61fd237af86 [id=db04ad55e6964d88bb71e0eab4cc4f65]) successfully deleted
I20260505 20:13:24.260915 8050 raft_consensus.cc:2243] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.261085 8050 raft_consensus.cc:2272] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:24.261251 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet a026a8408ed9462b820b560a98dcabd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a026a8408ed9462b820b560a98dcabd1 already in progress: creating tablet
I20260505 20:13:24.261269 8053 ts_tablet_manager.cc:1434] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
W20260505 20:13:24.261457 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 862e865d406c4d95b97b579e9fe07df0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 862e865d406c4d95b97b579e9fe07df0 already in progress: creating tablet
I20260505 20:13:24.261613 8050 ts_tablet_manager.cc:1916] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:24.261667 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f3466dbbf1d42d2b6310a6e44f95f9d already in progress: creating tablet
W20260505 20:13:24.261919 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet ee3543a2f89f43a8ab938e3585953953 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee3543a2f89f43a8ab938e3585953953 already in progress: creating tablet
I20260505 20:13:24.263481 8053 tablet_bootstrap.cc:492] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.263602 7335 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]). Expected version 1 got 0
I20260505 20:13:24.265215 8053 tablet_bootstrap.cc:654] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.267524 7914 tablet_service.cc:1511] Processing CreateTablet for tablet ea726cff03664c3d81b5e541ef738d4a (DEFAULT_TABLE table=default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.267935 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea726cff03664c3d81b5e541ef738d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.268882 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet e32780089f084e57ab07a222e1353eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.269109 8052 tablet_replica.cc:333] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.269308 8052 raft_consensus.cc:2243] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.269464 8052 raft_consensus.cc:2272] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.270048 7764 tablet_service.cc:1511] Processing CreateTablet for tablet ea726cff03664c3d81b5e541ef738d4a (DEFAULT_TABLE table=default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.270316 8058 ts_tablet_manager.cc:1434] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260505 20:13:24.270406 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea726cff03664c3d81b5e541ef738d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.274327 8058 tablet_bootstrap.cc:492] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.274577 8052 ts_tablet_manager.cc:1916] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:24.274902 8219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:24.275029 8054 tablet_bootstrap.cc:492] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.275156 8054 ts_tablet_manager.cc:1403] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.002s
I20260505 20:13:24.276058 8054 raft_consensus.cc:359] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.276247 8054 raft_consensus.cc:385] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.276350 8054 raft_consensus.cc:740] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.276648 8054 consensus_queue.cc:260] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:24.277114 8221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:24.277704 8058 tablet_bootstrap.cc:654] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.279305 8050 ts_tablet_manager.cc:1929] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.280249 8050 log.cc:1199] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e32780089f084e57ab07a222e1353eff
I20260505 20:13:24.280967 8050 ts_tablet_manager.cc:1950] T e32780089f084e57ab07a222e1353eff P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.282073 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f9e3face23974d6ba5012aaa1d677869" } modify_external_catalogs: true
I20260505 20:13:24.282297 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f9e3face23974d6ba5012aaa1d677869" } modify_external_catalogs: true
I20260505 20:13:24.281673 8054 ts_tablet_manager.cc:1434] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260505 20:13:24.283150 8054 tablet_bootstrap.cc:492] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.283577 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4f484e9071f845ac974813427f3f0b8d" } new_table_name: "default.Table_f3ed0fb723674f06869eefa958b4bf71" modify_external_catalogs: true
I20260505 20:13:24.284878 8058 tablet_bootstrap.cc:492] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.284940 8054 tablet_bootstrap.cc:654] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.285125 8058 ts_tablet_manager.cc:1403] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260505 20:13:24.286028 8058 raft_consensus.cc:359] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.286368 8058 raft_consensus.cc:385] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.286481 8058 raft_consensus.cc:740] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.286813 8058 consensus_queue.cc:260] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.287398 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_db181a51dd2c430ca2792b4bef5cd912"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.288061 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db181a51dd2c430ca2792b4bef5cd912 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.288372 8101 server_base.cc:1061] running on GCE node
I20260505 20:13:24.288517 8052 ts_tablet_manager.cc:1929] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.288672 8052 log.cc:1199] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e32780089f084e57ab07a222e1353eff
I20260505 20:13:24.289018 8052 ts_tablet_manager.cc:1950] T e32780089f084e57ab07a222e1353eff P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:24.289227 8224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:24.289261 8058 ts_tablet_manager.cc:1434] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:24.289356 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f1c1f40aa3044bdbbaa23ae22445214b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.289892 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1c1f40aa3044bdbbaa23ae22445214b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.290355 8058 tablet_bootstrap.cc:492] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.290391 8101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:24.291334 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e32780089f084e57ab07a222e1353eff (table default.Table_1e208cbf87594a0288a8c70a5d2e476e [id=6521a9dc88b746aebd36af503e674dea]) successfully deleted
I20260505 20:13:24.293550 8058 tablet_bootstrap.cc:654] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.295611 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e32780089f084e57ab07a222e1353eff (table default.Table_1e208cbf87594a0288a8c70a5d2e476e [id=6521a9dc88b746aebd36af503e674dea]) successfully deleted
I20260505 20:13:24.296123 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:24.296689 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 47de1578fdd74a198c48606aec33880a because the tablet was not found. No further retry: Not found: Tablet not found: 47de1578fdd74a198c48606aec33880a
W20260505 20:13:24.297132 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 923ed274fe454cc4a625516769e6b5f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 923ed274fe454cc4a625516769e6b5f3 already in progress: creating tablet
W20260505 20:13:24.297451 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 972b5c40369d41739d8c7a5bca22f04e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 972b5c40369d41739d8c7a5bca22f04e already in progress: creating tablet
I20260505 20:13:24.298199 8050 tablet_replica.cc:333] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
W20260505 20:13:24.298189 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4a42f0b6dc74cbd8d72ae36410f9d35 already in progress: creating tablet
W20260505 20:13:24.298465 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet beb404fa927641f48f28c6bdaa297db3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet beb404fa927641f48f28c6bdaa297db3 already in progress: creating tablet
I20260505 20:13:24.298892 8050 raft_consensus.cc:2243] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.299628 8053 tablet_bootstrap.cc:492] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.299854 8053 ts_tablet_manager.cc:1403] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20260505 20:13:24.299676 8050 raft_consensus.cc:2272] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.300971 8053 raft_consensus.cc:359] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.301337 8053 raft_consensus.cc:385] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.301371 8050 ts_tablet_manager.cc:1916] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.301501 8053 raft_consensus.cc:740] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.302111 8053 consensus_queue.cc:260] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.304572 8058 tablet_bootstrap.cc:492] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.304726 8058 ts_tablet_manager.cc:1403] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.008s
I20260505 20:13:24.305500 8058 raft_consensus.cc:359] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.305686 8058 raft_consensus.cc:385] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.305814 8058 raft_consensus.cc:740] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.306099 8058 consensus_queue.cc:260] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.306540 8101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260505 20:13:24.308138 7736 consensus_peers.cc:597] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:24.308903 7936 raft_consensus.cc:1275] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:24.309211 8058 ts_tablet_manager.cc:1434] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:24.309994 8101 hybrid_clock.cc:648] HybridClock initialized: now 1778012004309879 us; error 93 us; skew 500 ppm
I20260505 20:13:24.310297 8058 tablet_bootstrap.cc:492] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.310197 8089 consensus_queue.cc:1048] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:24.310537 8101 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260505 20:13:24.311031 7329 consensus_peers.cc:597] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 -> Peer 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521): Couldn't send request to peer 29603775b6d74153b21e0bbcc535ff98. Status: Network error: Client connection negotiation failed: client connection to 127.7.33.252:42521: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:24.313321 8058 tablet_bootstrap.cc:654] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.313721 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.316256 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 89f6ba8e4cba410daad729576d876329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f6ba8e4cba410daad729576d876329 already in progress: creating tablet
I20260505 20:13:24.317982 8053 ts_tablet_manager.cc:1434] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260505 20:13:24.320175 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet acd0f0fba5284283b472d6ddd1fcd69c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.320641 7630 tablet_service.cc:1511] Processing CreateTablet for tablet ea726cff03664c3d81b5e541ef738d4a (DEFAULT_TABLE table=default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.320784 8051 tablet_replica.cc:333] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.320955 8051 raft_consensus.cc:2243] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.321084 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea726cff03664c3d81b5e541ef738d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.321156 8051 raft_consensus.cc:2272] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.322392 8053 tablet_bootstrap.cc:492] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.323098 8050 ts_tablet_manager.cc:1929] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.323244 8050 log.cc:1199] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/89f6ba8e4cba410daad729576d876329
I20260505 20:13:24.325963 8053 tablet_bootstrap.cc:654] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.325924 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a4a2fef35c4b9bb68edca0fb2dd127 with delete_type TABLET_DATA_DELETED (replaced by tablet 293ea58772bb4b479501d4bf3ead3ba0) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.326176 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 8824bed6d2e9411d86651dfcffa77718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.326218 8101 webserver.cc:492] Webserver started at http://127.7.33.252:39007/ using document root <none> and password file <none>
I20260505 20:13:24.327032 8051 ts_tablet_manager.cc:1916] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.327375 8101 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:24.327521 8101 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:24.330053 8050 ts_tablet_manager.cc:1950] T 89f6ba8e4cba410daad729576d876329 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.331234 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 89f6ba8e4cba410daad729576d876329 (table default.Table_245e946b31e8475f805cdc16988071aa [id=69324a8030d643c68a8d1098bc282fcf]) successfully deleted
I20260505 20:13:24.334123 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet d2676078f47c4bc19391227d9643c15f
I20260505 20:13:24.334823 7341 catalog_manager.cc:6741] ReplaceTablet: tablet d2676078f47c4bc19391227d9643c15f deleted and replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:24.335304 8053 tablet_bootstrap.cc:492] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.335465 8053 ts_tablet_manager.cc:1403] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s
I20260505 20:13:24.335547 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet aa6589a0f15d4f31acc2e49e6c071e6a
I20260505 20:13:24.335963 7340 catalog_manager.cc:6741] ReplaceTablet: tablet aa6589a0f15d4f31acc2e49e6c071e6a deleted and replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9
I20260505 20:13:24.336362 8053 raft_consensus.cc:359] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.336611 8053 raft_consensus.cc:385] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.336720 8053 raft_consensus.cc:740] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.336961 8053 consensus_queue.cc:260] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.337273 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a with delete_type TABLET_DATA_DELETED (replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.337378 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet d2676078f47c4bc19391227d9643c15f with delete_type TABLET_DATA_DELETED (replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.337587 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a with delete_type TABLET_DATA_DELETED (replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.337945 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet aa6589a0f15d4f31acc2e49e6c071e6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa6589a0f15d4f31acc2e49e6c071e6a already in progress: creating tablet
I20260505 20:13:24.338239 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet d2676078f47c4bc19391227d9643c15f with delete_type TABLET_DATA_DELETED (replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:24.338722 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet d2676078f47c4bc19391227d9643c15f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2676078f47c4bc19391227d9643c15f already in progress: creating tablet
W20260505 20:13:24.338802 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet d2676078f47c4bc19391227d9643c15f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2676078f47c4bc19391227d9643c15f already in progress: creating tablet
I20260505 20:13:24.340018 8051 ts_tablet_manager.cc:1929] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.340149 8051 log.cc:1199] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/acd0f0fba5284283b472d6ddd1fcd69c
I20260505 20:13:24.340345 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bb972a845ed442d89889f9575da5c006" } new_table_name: "default.Table_02ead6059fbb492591198fcb073db9a5" modify_external_catalogs: true
I20260505 20:13:24.340551 8051 ts_tablet_manager.cc:1950] T acd0f0fba5284283b472d6ddd1fcd69c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.342355 8051 tablet_replica.cc:333] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.342563 8051 raft_consensus.cc:2243] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.342761 8051 raft_consensus.cc:2272] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.343576 8051 ts_tablet_manager.cc:1916] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.343947 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_4236c5f7709145e588050eb7b3d4ae44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.344955 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e453fdf9a424fe8974076fac3ad74bf has no consensus state
I20260505 20:13:24.344861 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_5eb1b00bd31442779cd50c207d3a2b1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.345355 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7e6c02c635da4beeac8892d580b67a93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.339025 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet aa6589a0f15d4f31acc2e49e6c071e6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa6589a0f15d4f31acc2e49e6c071e6a already in progress: creating tablet
W20260505 20:13:24.346668 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5eb1b00bd31442779cd50c207d3a2b1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.347833 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_65f1198f03024f6182354be70b9abe9f" } new_table_name: "default.Table_f32414ac94684234ab3a25f46213b70b" modify_external_catalogs: true
W20260505 20:13:24.348213 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e6c02c635da4beeac8892d580b67a93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:24.348404 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4236c5f7709145e588050eb7b3d4ae44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.348599 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.349092 8101 fs_manager.cc:714] Time spent opening directory manager: real 0.014s user 0.000s sys 0.005s
I20260505 20:13:24.349298 8052 tablet_replica.cc:333] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.349501 8052 raft_consensus.cc:2243] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.349712 8052 raft_consensus.cc:2272] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.349959 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a with delete_type TABLET_DATA_DELETED (replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.350797 8052 ts_tablet_manager.cc:1916] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.356009 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet d2676078f47c4bc19391227d9643c15f with delete_type TABLET_DATA_DELETED (replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.358130 8053 ts_tablet_manager.cc:1434] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.023s user 0.000s sys 0.002s
I20260505 20:13:24.359999 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet acd0f0fba5284283b472d6ddd1fcd69c (table default.Table_206e9638b58b41f892b4b9f29c7b7e3e [id=2d1a1f685c25435d84db53ec232bea74]) successfully deleted
I20260505 20:13:24.360276 8052 ts_tablet_manager.cc:1929] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.360491 8052 log.cc:1199] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/89f6ba8e4cba410daad729576d876329
I20260505 20:13:24.360574 8053 tablet_bootstrap.cc:492] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.360987 8052 ts_tablet_manager.cc:1950] T 89f6ba8e4cba410daad729576d876329 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.362061 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 89f6ba8e4cba410daad729576d876329 (table default.Table_245e946b31e8475f805cdc16988071aa [id=69324a8030d643c68a8d1098bc282fcf]) successfully deleted
I20260505 20:13:24.362924 8053 tablet_bootstrap.cc:654] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.363051 8054 tablet_bootstrap.cc:492] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.363233 8054 ts_tablet_manager.cc:1403] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.080s user 0.016s sys 0.011s
I20260505 20:13:24.364080 8054 raft_consensus.cc:359] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.364318 8054 raft_consensus.cc:385] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.364405 8054 raft_consensus.cc:740] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.364652 8054 consensus_queue.cc:260] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.365679 8054 ts_tablet_manager.cc:1434] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:24.366021 8054 tablet_bootstrap.cc:492] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.367509 8058 tablet_bootstrap.cc:492] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.367686 8058 ts_tablet_manager.cc:1403] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.006s
I20260505 20:13:24.368765 8058 raft_consensus.cc:359] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.368965 8058 raft_consensus.cc:385] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.369036 8058 raft_consensus.cc:740] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.369313 8058 consensus_queue.cc:260] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.369194 8237 mvcc.cc:204] Tried to move back new op lower bound from 7282737169637900288 to 7282737168614920192. Current Snapshot: MvccSnapshot[applied={T|T < 7282737169637900288}]
I20260505 20:13:24.372740 8054 tablet_bootstrap.cc:654] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.373076 8058 ts_tablet_manager.cc:1434] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:24.373889 8236 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:24.376690 8058 tablet_bootstrap.cc:492] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.377684 8101 fs_manager.cc:730] Time spent opening block manager: real 0.025s user 0.004s sys 0.002s
I20260505 20:13:24.377784 7800 raft_consensus.cc:1275] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Refusing update from remote peer 974ed93a43c54ccbb58e60bfdae7c546: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:24.378360 7662 raft_consensus.cc:3060] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.378443 8127 consensus_queue.cc:1048] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:24.377998 8101 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
uuid: "29603775b6d74153b21e0bbcc535ff98"
format_stamp: "Formatted at 2026-05-05 20:13:18 on dist-test-slave-1fq8"
I20260505 20:13:24.380508 8051 ts_tablet_manager.cc:1929] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.380646 8051 log.cc:1199] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/96a4a2fef35c4b9bb68edca0fb2dd127
I20260505 20:13:24.381031 8051 ts_tablet_manager.cc:1950] T 96a4a2fef35c4b9bb68edca0fb2dd127 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.381465 7662 raft_consensus.cc:1275] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Refusing update from remote peer 974ed93a43c54ccbb58e60bfdae7c546: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:24.382359 8127 consensus_queue.cc:1048] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:24.385634 8058 tablet_bootstrap.cc:654] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.387182 8051 tablet_replica.cc:333] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.387476 8051 raft_consensus.cc:2243] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.387734 8051 raft_consensus.cc:2272] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.388654 8051 ts_tablet_manager.cc:1916] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.388796 8240 tablet.cc:1724] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:24.380167 8101 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:24.393796 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 96a4a2fef35c4b9bb68edca0fb2dd127 (table default.Table_d07784067e0b40159e17122e8ddfb020 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:24.394690 8239 tablet.cc:1724] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:24.398780 7338 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:24.400122 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:24.400650 8058 tablet_bootstrap.cc:492] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.400807 8058 ts_tablet_manager.cc:1403] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260505 20:13:24.401150 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:24.401633 8058 raft_consensus.cc:359] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.401830 8058 raft_consensus.cc:385] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.402078 8058 raft_consensus.cc:740] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.402361 8058 consensus_queue.cc:260] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.403455 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_27d8b323d032484d91f6906c154d0191" } new_table_name: "default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f" modify_external_catalogs: true
I20260505 20:13:24.404322 8058 ts_tablet_manager.cc:1434] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:24.406930 7336 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
I20260505 20:13:24.407509 8058 tablet_bootstrap.cc:492] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.408473 7336 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:24.408679 7336 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
I20260505 20:13:24.408861 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c1f63c849c48438abdaa965ab051f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.408840 8053 tablet_bootstrap.cc:492] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.409174 8053 ts_tablet_manager.cc:1403] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.004s
I20260505 20:13:24.410151 8053 raft_consensus.cc:359] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.410367 8053 raft_consensus.cc:385] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.410447 8053 raft_consensus.cc:740] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:24.410475 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 50c1f63c849c48438abdaa965ab051f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50c1f63c849c48438abdaa965ab051f9 already in progress: creating tablet
I20260505 20:13:24.410728 8053 consensus_queue.cc:260] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.411738 8053 ts_tablet_manager.cc:1434] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:24.412052 8053 tablet_bootstrap.cc:492] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.413591 8239 tablet.cc:1724] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:24.415006 8058 tablet_bootstrap.cc:654] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.416399 8051 ts_tablet_manager.cc:1929] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.416523 8051 log.cc:1199] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/8824bed6d2e9411d86651dfcffa77718
I20260505 20:13:24.416889 8051 ts_tablet_manager.cc:1950] T 8824bed6d2e9411d86651dfcffa77718 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.418306 8053 tablet_bootstrap.cc:654] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.418825 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c1f63c849c48438abdaa965ab051f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:24.420040 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 50c1f63c849c48438abdaa965ab051f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50c1f63c849c48438abdaa965ab051f9 already in progress: creating tablet
I20260505 20:13:24.424136 8053 tablet_bootstrap.cc:492] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.424335 8053 ts_tablet_manager.cc:1403] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.003s
I20260505 20:13:24.425079 8246 tablet.cc:1724] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:24.425405 8053 raft_consensus.cc:359] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.425635 8053 raft_consensus.cc:385] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.425769 8053 raft_consensus.cc:740] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.426064 8053 consensus_queue.cc:260] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.426934 8053 ts_tablet_manager.cc:1434] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260505 20:13:24.426995 8054 tablet_bootstrap.cc:492] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.427134 8054 ts_tablet_manager.cc:1403] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.003s
I20260505 20:13:24.427220 8053 tablet_bootstrap.cc:492] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.428016 8054 raft_consensus.cc:359] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.428196 8054 raft_consensus.cc:385] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.428294 8054 raft_consensus.cc:740] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.428604 8054 consensus_queue.cc:260] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.429122 8054 ts_tablet_manager.cc:1434] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:24.429786 8053 tablet_bootstrap.cc:654] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.429965 8054 tablet_bootstrap.cc:492] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.431991 8054 tablet_bootstrap.cc:654] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.443429 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c1f63c849c48438abdaa965ab051f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.444525 8053 tablet_bootstrap.cc:492] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.444702 8053 ts_tablet_manager.cc:1403] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.005s
W20260505 20:13:24.445327 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6acad22190b402d892d06ff97bd9476 consensus state has no leader
I20260505 20:13:24.445499 8053 raft_consensus.cc:359] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.445684 8053 raft_consensus.cc:385] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.445781 8053 raft_consensus.cc:740] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.446039 8053 consensus_queue.cc:260] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.446133 8054 tablet_bootstrap.cc:492] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.446314 8054 ts_tablet_manager.cc:1403] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.002s
I20260505 20:13:24.447095 8054 raft_consensus.cc:359] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.447296 8054 raft_consensus.cc:385] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.447369 8054 raft_consensus.cc:740] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.447628 8054 consensus_queue.cc:260] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.448522 8089 raft_consensus.cc:493] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.448686 8089 raft_consensus.cc:515] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.449324 8089 leader_election.cc:290] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.449673 8058 tablet_bootstrap.cc:492] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.449501 8054 ts_tablet_manager.cc:1434] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:24.449882 8058 ts_tablet_manager.cc:1403] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.021s
I20260505 20:13:24.450337 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bba6267194d058cd08a27cdd2af49" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.450749 8058 raft_consensus.cc:359] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.450837 8054 tablet_bootstrap.cc:492] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.450955 8058 raft_consensus.cc:385] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:24.450928 7736 leader_election.cc:343] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.451030 8058 raft_consensus.cc:740] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.451282 8058 consensus_queue.cc:260] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.452566 8054 tablet_bootstrap.cc:654] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.453042 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bba6267194d058cd08a27cdd2af49" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:24.453272 7936 raft_consensus.cc:2468] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:24.453313 8058 ts_tablet_manager.cc:1434] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:24.453339 8053 ts_tablet_manager.cc:1434] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:24.454190 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 8824bed6d2e9411d86651dfcffa77718 (table default.Table_7f774c4256454a39904f5517cbcd9d9f [id=f615586594f3465e9ee9f554048cce6c]) successfully deleted
I20260505 20:13:24.454407 7737 leader_election.cc:304] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:24.454643 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet aa6589a0f15d4f31acc2e49e6c071e6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa6589a0f15d4f31acc2e49e6c071e6a already in progress: creating tablet
I20260505 20:13:24.454845 8089 raft_consensus.cc:2804] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.454941 8089 raft_consensus.cc:493] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.455053 8089 raft_consensus.cc:3060] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:24.454985 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet d2676078f47c4bc19391227d9643c15f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2676078f47c4bc19391227d9643c15f already in progress: creating tablet
W20260505 20:13:24.455395 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 50c1f63c849c48438abdaa965ab051f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50c1f63c849c48438abdaa965ab051f9 already in progress: creating tablet
I20260505 20:13:24.455531 8058 tablet_bootstrap.cc:492] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.457392 8058 tablet_bootstrap.cc:654] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.458607 8089 raft_consensus.cc:515] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.462060 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bba6267194d058cd08a27cdd2af49" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:24.463202 7736 leader_election.cc:343] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.466398 8089 leader_election.cc:290] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.467026 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bba6267194d058cd08a27cdd2af49" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:24.467331 7936 raft_consensus.cc:3060] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.467726 8058 tablet_bootstrap.cc:492] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.467935 8058 ts_tablet_manager.cc:1403] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260505 20:13:24.469048 8058 raft_consensus.cc:359] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.469262 8058 raft_consensus.cc:385] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.469355 8058 raft_consensus.cc:740] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.469627 8058 consensus_queue.cc:260] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.470558 8053 tablet_bootstrap.cc:492] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.471408 8058 ts_tablet_manager.cc:1434] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260505 20:13:24.472772 8058 tablet_bootstrap.cc:492] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.473407 8053 tablet_bootstrap.cc:654] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.474519 8058 tablet_bootstrap.cc:654] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.476539 8254 tablet.cc:1724] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:24.478016 8053 tablet_bootstrap.cc:492] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.478176 8053 ts_tablet_manager.cc:1403] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260505 20:13:24.479009 8053 raft_consensus.cc:359] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.479208 8053 raft_consensus.cc:385] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.479302 8053 raft_consensus.cc:740] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.479532 8053 consensus_queue.cc:260] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.481258 8053 ts_tablet_manager.cc:1434] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260505 20:13:24.482407 8053 tablet_bootstrap.cc:492] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.485210 8053 tablet_bootstrap.cc:654] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.490752 8058 tablet_bootstrap.cc:492] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.490963 8058 ts_tablet_manager.cc:1403] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260505 20:13:24.491618 8058 raft_consensus.cc:359] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.491834 8058 raft_consensus.cc:385] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.491943 8058 raft_consensus.cc:740] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.492202 8058 consensus_queue.cc:260] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.493405 8058 ts_tablet_manager.cc:1434] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:24.494357 8058 tablet_bootstrap.cc:492] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.494498 7936 raft_consensus.cc:2468] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:24.495211 7737 leader_election.cc:304] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.495723 8089 raft_consensus.cc:2804] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:24.495885 8089 raft_consensus.cc:697] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:24.496155 8058 tablet_bootstrap.cc:654] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.496155 8089 consensus_queue.cc:237] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.509305 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_85b92a55020a404f80a0290495181ab3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.510018 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85b92a55020a404f80a0290495181ab3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.511420 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_99c224cd93784af1a21c3c3260971518" } modify_external_catalogs: true
I20260505 20:13:24.511650 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_99c224cd93784af1a21c3c3260971518" } modify_external_catalogs: true
I20260505 20:13:24.512029 7333 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3]). Expected version 2 got 0
W20260505 20:13:24.512245 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 944bc61fe79c4f94bb280dae8e3cee59 consensus state has no leader
I20260505 20:13:24.512502 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 4cbb29bc765d476cb4634178f2806c10 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.513090 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3320012d7d2d474e8bb80df0f8f7ee59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.513249 7333 master_service.cc:954] ReplaceTablet: received request to replace tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:24.513633 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3320012d7d2d474e8bb80df0f8f7ee59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.517913 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 78edaee6c4e946b1a7c7302d20aa5d7d with delete_type TABLET_DATA_DELETED (replaced by tablet a9719876757e409b991b21410983e3bf) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.518236 8051 tablet_replica.cc:333] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.518500 8051 raft_consensus.cc:2243] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.518709 8051 raft_consensus.cc:2272] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.518994 8054 tablet_bootstrap.cc:492] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.519171 8054 ts_tablet_manager.cc:1403] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.068s user 0.017s sys 0.015s
I20260505 20:13:24.519560 8051 ts_tablet_manager.cc:1916] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.520059 8054 raft_consensus.cc:359] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.520253 8054 raft_consensus.cc:385] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.520365 8054 raft_consensus.cc:740] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.520612 8054 consensus_queue.cc:260] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.521123 8054 ts_tablet_manager.cc:1434] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:24.527086 8054 tablet_bootstrap.cc:492] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.527491 8051 ts_tablet_manager.cc:1929] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.527645 8051 log.cc:1199] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/78edaee6c4e946b1a7c7302d20aa5d7d
I20260505 20:13:24.528059 8051 ts_tablet_manager.cc:1950] T 78edaee6c4e946b1a7c7302d20aa5d7d P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.528859 8054 tablet_bootstrap.cc:654] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:24.529330 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e453fdf9a424fe8974076fac3ad74bf has no consensus state
I20260505 20:13:24.529851 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_61a206162d5748ceb746d958b0f9ae76" } modify_external_catalogs: true
I20260505 20:13:24.529927 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8f662bf9642940d19389e4fe4f0a5e18" } modify_external_catalogs: true
I20260505 20:13:24.530078 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_61a206162d5748ceb746d958b0f9ae76" } modify_external_catalogs: true
I20260505 20:13:24.530128 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8f662bf9642940d19389e4fe4f0a5e18" } modify_external_catalogs: true
I20260505 20:13:24.530622 7336 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0] alter complete (version 1)
W20260505 20:13:24.530779 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7766caea43904162a2c289b7b17405d4 consensus state has no leader
I20260505 20:13:24.531170 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f5f9bf433a14811882fb1e5a2f93aba" } modify_external_catalogs: true
I20260505 20:13:24.531337 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f5f9bf433a14811882fb1e5a2f93aba" } modify_external_catalogs: true
I20260505 20:13:24.531450 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet c6acad22190b402d892d06ff97bd9476 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.537376 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 78edaee6c4e946b1a7c7302d20aa5d7d (table default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]) successfully deleted
I20260505 20:13:24.546492 8054 tablet_bootstrap.cc:492] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.546713 8054 ts_tablet_manager.cc:1403] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20260505 20:13:24.547127 8053 tablet_bootstrap.cc:492] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.547297 8053 ts_tablet_manager.cc:1403] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.015s
I20260505 20:13:24.547582 8054 raft_consensus.cc:359] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.547793 8054 raft_consensus.cc:385] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.547881 8054 raft_consensus.cc:740] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.548125 8054 consensus_queue.cc:260] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.548532 8053 raft_consensus.cc:359] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.548735 8053 raft_consensus.cc:385] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.548810 8053 raft_consensus.cc:740] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.549064 8053 consensus_queue.cc:260] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.549265 8054 ts_tablet_manager.cc:1434] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:24.550947 8053 ts_tablet_manager.cc:1434] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:24.552101 8053 tablet_bootstrap.cc:492] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.553967 8053 tablet_bootstrap.cc:654] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.564003 8089 raft_consensus.cc:493] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.564198 8089 raft_consensus.cc:515] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.565017 8089 leader_election.cc:290] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.566429 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf3b6cf3a4ef6b7c077f78b793283" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:24.567191 7736 leader_election.cc:343] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.567689 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf3b6cf3a4ef6b7c077f78b793283" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:24.568017 7936 raft_consensus.cc:2468] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:24.568588 7737 leader_election.cc:304] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.569167 8089 raft_consensus.cc:2804] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.569309 8089 raft_consensus.cc:493] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.569422 8089 raft_consensus.cc:3060] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.573427 8054 tablet_bootstrap.cc:492] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.573860 8089 raft_consensus.cc:515] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.578303 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d991da0b0d3b445b918500a013593fe2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.578801 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 6166653cbc58470c8ba4926048ba1384 (DEFAULT_TABLE table=default.Table_c6739319907248c5a2b1f0bc5c1afd77 [id=5dea091296724ac28a69478051119890]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:24.578904 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d991da0b0d3b445b918500a013593fe2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.579206 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 (DEFAULT_TABLE table=default.Table_1cd5f89bd70c4112b673b1a54ce5dc61 [id=43496ef5c80a4178b227a11f10098926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.579967 7766 tablet_service.cc:1511] Processing CreateTablet for tablet e041ebc882b14484a51fe3a6589cddd6 (DEFAULT_TABLE table=default.Table_90124bd7f0774a3ab49bcd90a3ec3733 [id=d4a0d51cd26f49eab032102e2064e622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.580523 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e041ebc882b14484a51fe3a6589cddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.581948 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f (DEFAULT_TABLE table=default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 [id=53190afe0efc4b75a333dd189a53376c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.582152 7914 tablet_service.cc:1511] Processing CreateTablet for tablet e041ebc882b14484a51fe3a6589cddd6 (DEFAULT_TABLE table=default.Table_90124bd7f0774a3ab49bcd90a3ec3733 [id=d4a0d51cd26f49eab032102e2064e622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.584048 8054 tablet_bootstrap.cc:654] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.584194 7335 catalog_manager.cc:5671] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:24.584666 7335 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:24.586105 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 6166653cbc58470c8ba4926048ba1384 (DEFAULT_TABLE table=default.Table_c6739319907248c5a2b1f0bc5c1afd77 [id=5dea091296724ac28a69478051119890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.586742 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6166653cbc58470c8ba4926048ba1384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.590240 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f (DEFAULT_TABLE table=default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 [id=53190afe0efc4b75a333dd189a53376c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.591747 7630 tablet_service.cc:1511] Processing CreateTablet for tablet e041ebc882b14484a51fe3a6589cddd6 (DEFAULT_TABLE table=default.Table_90124bd7f0774a3ab49bcd90a3ec3733 [id=d4a0d51cd26f49eab032102e2064e622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.592224 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e041ebc882b14484a51fe3a6589cddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.592758 7909 tablet_service.cc:1511] Processing CreateTablet for tablet e98c0e648c98488e8c5509b296824bea (DEFAULT_TABLE table=default.Table_bb26086f0d304240b95bbc9c075b996f [id=a812e64a033a470eaf1861fb213b4ceb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.592801 7901 tablet_service.cc:1511] Processing CreateTablet for tablet f3b3c646af9843048382e77b138aea44 (DEFAULT_TABLE table=default.Table_74b14c0104de480d8de826c45ff1cf37 [id=7d374a42eb6149a183cce40f5c81326f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.593132 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 (DEFAULT_TABLE table=default.Table_0f5f9bf433a14811882fb1e5a2f93aba [id=6cdd177b6b79450ea461ad6a2ae78aa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.594028 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 79ce82aca20d44819f28785322e935ae (DEFAULT_TABLE table=default.Table_b677360578864cf6b251512952987f68 [id=967e469ababf4dcfb96366119fa360cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.593686 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 64a82a9d144746338b3fc6550aa35d3c (DEFAULT_TABLE table=default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 [id=48be793440d142f287ca28d23b4f996a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.579228 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6166653cbc58470c8ba4926048ba1384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.595216 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172cd9f38dd8491ea3ecf42b680d398f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.595520 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b3c646af9843048382e77b138aea44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.596798 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e041ebc882b14484a51fe3a6589cddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.597957 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e91e29eb2e6462a975adcf9a379c421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.601212 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98c0e648c98488e8c5509b296824bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.601904 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d74dbab83b840d9b2bd103e946d3032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.603096 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ce82aca20d44819f28785322e935ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.606022 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a82a9d144746338b3fc6550aa35d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.606961 8101 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:24.608129 8101 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:24.608872 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 6166653cbc58470c8ba4926048ba1384 (DEFAULT_TABLE table=default.Table_c6739319907248c5a2b1f0bc5c1afd77 [id=5dea091296724ac28a69478051119890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.609624 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6166653cbc58470c8ba4926048ba1384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.610775 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf (DEFAULT_TABLE table=default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f [id=ec71e6a4ae4d45d48362262a5d2bf526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.611536 7909 tablet_service.cc:1511] Processing CreateTablet for tablet bd01314146a34257b444a622829b2fe4 (DEFAULT_TABLE table=default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.611963 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e453fdf9a424fe8974076fac3ad74bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.612802 8101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260505 20:13:24.614512 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f (DEFAULT_TABLE table=default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 [id=53190afe0efc4b75a333dd189a53376c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.614943 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172cd9f38dd8491ea3ecf42b680d398f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.615888 7631 tablet_service.cc:1511] Processing CreateTablet for tablet f3b3c646af9843048382e77b138aea44 (DEFAULT_TABLE table=default.Table_74b14c0104de480d8de826c45ff1cf37 [id=7d374a42eb6149a183cce40f5c81326f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.616287 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 (DEFAULT_TABLE table=default.Table_0f5f9bf433a14811882fb1e5a2f93aba [id=6cdd177b6b79450ea461ad6a2ae78aa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.616611 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172cd9f38dd8491ea3ecf42b680d398f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.616288 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b3c646af9843048382e77b138aea44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.618050 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 (DEFAULT_TABLE table=default.Table_1cd5f89bd70c4112b673b1a54ce5dc61 [id=43496ef5c80a4178b227a11f10098926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.618463 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d74dbab83b840d9b2bd103e946d3032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.621435 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e91e29eb2e6462a975adcf9a379c421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.621882 7634 tablet_service.cc:1511] Processing CreateTablet for tablet e98c0e648c98488e8c5509b296824bea (DEFAULT_TABLE table=default.Table_bb26086f0d304240b95bbc9c075b996f [id=a812e64a033a470eaf1861fb213b4ceb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.622262 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98c0e648c98488e8c5509b296824bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.636493 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd01314146a34257b444a622829b2fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.638618 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 (DEFAULT_TABLE table=default.Table_1cd5f89bd70c4112b673b1a54ce5dc61 [id=43496ef5c80a4178b227a11f10098926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.639104 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d74dbab83b840d9b2bd103e946d3032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.639360 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf (DEFAULT_TABLE table=default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f [id=ec71e6a4ae4d45d48362262a5d2bf526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.639853 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e453fdf9a424fe8974076fac3ad74bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.641865 7767 tablet_service.cc:1511] Processing CreateTablet for tablet e98c0e648c98488e8c5509b296824bea (DEFAULT_TABLE table=default.Table_bb26086f0d304240b95bbc9c075b996f [id=a812e64a033a470eaf1861fb213b4ceb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.641351 8171 raft_consensus.cc:493] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.643081 8171 raft_consensus.cc:515] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.643795 8171 leader_election.cc:290] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.644966 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a5d46461b746be9fc29431e972b7b7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.646750 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98c0e648c98488e8c5509b296824bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.648734 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 79ce82aca20d44819f28785322e935ae (DEFAULT_TABLE table=default.Table_b677360578864cf6b251512952987f68 [id=967e469ababf4dcfb96366119fa360cd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:24.649350 7736 leader_election.cc:343] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.649595 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 64a82a9d144746338b3fc6550aa35d3c (DEFAULT_TABLE table=default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 [id=48be793440d142f287ca28d23b4f996a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.650661 7777 tablet_service.cc:1511] Processing CreateTablet for tablet f3b3c646af9843048382e77b138aea44 (DEFAULT_TABLE table=default.Table_74b14c0104de480d8de826c45ff1cf37 [id=7d374a42eb6149a183cce40f5c81326f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.651178 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b3c646af9843048382e77b138aea44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.651192 8058 tablet_bootstrap.cc:492] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.651352 8058 ts_tablet_manager.cc:1403] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.158s user 0.007s sys 0.020s
I20260505 20:13:24.652438 8058 raft_consensus.cc:359] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.652662 8058 raft_consensus.cc:385] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.652769 8058 raft_consensus.cc:740] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.653035 8058 consensus_queue.cc:260] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:24.653667 8058 ts_tablet_manager.cc:1434] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:24.654158 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ce82aca20d44819f28785322e935ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.657685 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 79ce82aca20d44819f28785322e935ae (DEFAULT_TABLE table=default.Table_b677360578864cf6b251512952987f68 [id=967e469ababf4dcfb96366119fa360cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.658268 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ce82aca20d44819f28785322e935ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.659279 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 (DEFAULT_TABLE table=default.Table_0f5f9bf433a14811882fb1e5a2f93aba [id=6cdd177b6b79450ea461ad6a2ae78aa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.659804 8058 tablet_bootstrap.cc:492] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.662937 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a5d46461b746be9fc29431e972b7b7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:24.663573 7936 raft_consensus.cc:2468] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:24.663684 8058 tablet_bootstrap.cc:654] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.664655 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 64a82a9d144746338b3fc6550aa35d3c (DEFAULT_TABLE table=default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 [id=48be793440d142f287ca28d23b4f996a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.664983 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a82a9d144746338b3fc6550aa35d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.666108 7775 tablet_service.cc:1511] Processing CreateTablet for tablet bd01314146a34257b444a622829b2fe4 (DEFAULT_TABLE table=default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.666560 7737 leader_election.cc:304] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.667624 8171 raft_consensus.cc:2804] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.667723 8171 raft_consensus.cc:493] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.670807 7637 tablet_service.cc:1511] Processing CreateTablet for tablet bd01314146a34257b444a622829b2fe4 (DEFAULT_TABLE table=default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.671391 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd01314146a34257b444a622829b2fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.671589 8171 raft_consensus.cc:3060] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.675911 8058 tablet_bootstrap.cc:492] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.676085 8058 ts_tablet_manager.cc:1403] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.003s
I20260505 20:13:24.676127 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e91e29eb2e6462a975adcf9a379c421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.676949 8058 raft_consensus.cc:359] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.677161 8058 raft_consensus.cc:385] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.677237 8058 raft_consensus.cc:740] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.677500 8058 consensus_queue.cc:260] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.678061 8058 ts_tablet_manager.cc:1434] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:24.678390 8058 tablet_bootstrap.cc:492] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.680323 8058 tablet_bootstrap.cc:654] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.680536 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf3b6cf3a4ef6b7c077f78b793283" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:24.680588 8194 raft_consensus.cc:493] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.680786 8194 raft_consensus.cc:515] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.681567 8194 leader_election.cc:290] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.681811 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf (DEFAULT_TABLE table=default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f [id=ec71e6a4ae4d45d48362262a5d2bf526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.682282 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a82a9d144746338b3fc6550aa35d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.683014 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3466dbbf1d42d2b6310a6e44f95f9d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:24.683555 7870 leader_election.cc:343] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.683941 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e453fdf9a424fe8974076fac3ad74bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.684273 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3466dbbf1d42d2b6310a6e44f95f9d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:24.684502 7800 raft_consensus.cc:2468] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:24.684953 7869 leader_election.cc:304] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.685316 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd01314146a34257b444a622829b2fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.685503 8194 raft_consensus.cc:2804] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.685621 8194 raft_consensus.cc:493] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.685729 8194 raft_consensus.cc:3060] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.688997 8194 raft_consensus.cc:515] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.690420 8194 leader_election.cc:290] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.690713 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3466dbbf1d42d2b6310a6e44f95f9d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:24.675943 8171 raft_consensus.cc:515] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:24.691288 7870 leader_election.cc:343] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.693303 7334 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_078e80255cc64422a110908c5afebd6d [id=864842f5805c4e8aa36af98c0a5425a3] alter complete (version 2)
I20260505 20:13:24.694972 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 56b775db329949bcbab3fd81c75e951d with delete_type TABLET_DATA_DELETED (replaced by tablet ee3543a2f89f43a8ab938e3585953953) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.694988 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f92fa7cbfb9c470fa562c941ef044c19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.695227 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e64ed9bb7c44219dac4a36bfbec24f with delete_type TABLET_DATA_DELETED (replaced by tablet c4400792ceb14f0c9f0f3c23a47b91c2) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.695489 8051 tablet_replica.cc:333] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.695574 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 8af906f570a04b668c8696817739a412 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8329b75b6946d08337c1cfbe49623b) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.695685 8051 raft_consensus.cc:2243] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:24.695757 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f92fa7cbfb9c470fa562c941ef044c19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.695909 8051 raft_consensus.cc:2272] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.696771 8051 ts_tablet_manager.cc:1916] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.703699 8051 ts_tablet_manager.cc:1929] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:24.703708 7736 leader_election.cc:343] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.703974 8051 log.cc:1199] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/56b775db329949bcbab3fd81c75e951d
I20260505 20:13:24.704501 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a5d46461b746be9fc29431e972b7b7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:24.706616 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f3466dbbf1d42d2b6310a6e44f95f9d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:24.706887 7800 raft_consensus.cc:3060] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:24.708743 7736 leader_election.cc:343] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.709095 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a5d46461b746be9fc29431e972b7b7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:24.709421 7936 raft_consensus.cc:3060] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.710852 8171 leader_election.cc:290] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.712774 7936 raft_consensus.cc:2468] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:24.713394 7737 leader_election.cc:304] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.714033 8171 raft_consensus.cc:2804] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:24.714421 8089 leader_election.cc:290] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.715574 8051 ts_tablet_manager.cc:1950] T 56b775db329949bcbab3fd81c75e951d P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.716850 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:24.717017 8051 tablet_replica.cc:333] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.717317 8051 raft_consensus.cc:2243] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.717442 7333 catalog_manager.cc:6741] ReplaceTablet: tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a deleted and replaced by tablet e083f131eca54d98852e5685e08ef46b
I20260505 20:13:24.717523 8051 raft_consensus.cc:2272] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.719477 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf3b6cf3a4ef6b7c077f78b793283" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:24.719693 7937 raft_consensus.cc:3060] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.723083 8051 ts_tablet_manager.cc:1916] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.723076 7937 raft_consensus.cc:2468] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:24.723699 7737 leader_election.cc:304] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.724087 8089 raft_consensus.cc:2804] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:24.724218 8089 raft_consensus.cc:697] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:24.724519 8089 consensus_queue.cc:237] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.725718 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.726486 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.726503 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a already in progress: creating tablet
W20260505 20:13:24.727269 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a already in progress: creating tablet
I20260505 20:13:24.727877 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.728775 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 56b775db329949bcbab3fd81c75e951d (table default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]) successfully deleted
I20260505 20:13:24.730851 8054 tablet_bootstrap.cc:492] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:24.731076 8054 ts_tablet_manager.cc:1403] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.158s user 0.018s sys 0.038s
I20260505 20:13:24.731050 8051 ts_tablet_manager.cc:1929] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.731238 8051 log.cc:1199] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/15e64ed9bb7c44219dac4a36bfbec24f
I20260505 20:13:24.734146 8054 raft_consensus.cc:359] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.734750 8054 raft_consensus.cc:385] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.735082 8054 raft_consensus.cc:740] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.736075 8054 consensus_queue.cc:260] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.736979 8051 ts_tablet_manager.cc:1950] T 15e64ed9bb7c44219dac4a36bfbec24f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.737457 8054 ts_tablet_manager.cc:1434] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:24.739429 8051 tablet_replica.cc:333] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.739843 8054 tablet_bootstrap.cc:492] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.739903 8051 raft_consensus.cc:2243] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.740365 8051 raft_consensus.cc:2272] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.741425 8051 ts_tablet_manager.cc:1916] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.742313 8054 tablet_bootstrap.cc:654] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.747684 8051 ts_tablet_manager.cc:1929] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.750389 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 15e64ed9bb7c44219dac4a36bfbec24f (table default.Table_c538874d901d449d9490a324fdc484a3 [id=3c74b3f7e0944d40857db619bc1058e4]) successfully deleted
I20260505 20:13:24.753679 8051 log.cc:1199] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/8af906f570a04b668c8696817739a412
I20260505 20:13:24.753584 8171 raft_consensus.cc:697] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:24.754338 8051 ts_tablet_manager.cc:1950] T 8af906f570a04b668c8696817739a412 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.759984 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:24.761227 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e17b17089792450bbc4dba372076af9a
I20260505 20:13:24.761868 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 84fb3dcea55d4b348cbf92c3c4581dda from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.762904 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet e17b17089792450bbc4dba372076af9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.763952 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet e17b17089792450bbc4dba372076af9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:24.764827 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e17b17089792450bbc4dba372076af9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e17b17089792450bbc4dba372076af9a already in progress: creating tablet
I20260505 20:13:24.765865 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.766180 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet e17b17089792450bbc4dba372076af9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:24.766533 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e17b17089792450bbc4dba372076af9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e17b17089792450bbc4dba372076af9a already in progress: creating tablet
I20260505 20:13:24.766952 8054 tablet_bootstrap.cc:492] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
W20260505 20:13:24.767032 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 4e91e29eb2e6462a975adcf9a379c421 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e91e29eb2e6462a975adcf9a379c421 already in progress: creating tablet
I20260505 20:13:24.767181 8054 ts_tablet_manager.cc:1403] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260505 20:13:24.768041 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 8af906f570a04b668c8696817739a412 (table default.Table_6d0efc4c31774452a20d42a0135965e0 [id=087098008f924e61874b6d84181048bf]) successfully deleted
W20260505 20:13:24.768337 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a already in progress: creating tablet
I20260505 20:13:24.768229 8054 raft_consensus.cc:359] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.768469 8054 raft_consensus.cc:385] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:24.768543 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e17b17089792450bbc4dba372076af9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e17b17089792450bbc4dba372076af9a already in progress: creating tablet
I20260505 20:13:24.768582 8054 raft_consensus.cc:740] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.768923 8054 consensus_queue.cc:260] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.769026 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.769798 8054 ts_tablet_manager.cc:1434] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:24.770171 8054 tablet_bootstrap.cc:492] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:24.771121 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.772328 8054 tablet_bootstrap.cc:654] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:24.773085 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 4e91e29eb2e6462a975adcf9a379c421 because the tablet was not found. No further retry: Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:24.775100 8058 tablet_bootstrap.cc:492] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.775262 8058 ts_tablet_manager.cc:1403] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.028s
I20260505 20:13:24.754415 8171 consensus_queue.cc:237] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.776041 8058 raft_consensus.cc:359] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:24.776146 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 4e91e29eb2e6462a975adcf9a379c421 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e91e29eb2e6462a975adcf9a379c421 already in progress: creating tablet
I20260505 20:13:24.776242 8058 raft_consensus.cc:385] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.776337 8058 raft_consensus.cc:740] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.776566 8058 consensus_queue.cc:260] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.777148 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d07784067e0b40159e17122e8ddfb020" } new_table_name: "default.Table_8a93780aa604483c859e40281c9ea802" modify_external_catalogs: true
I20260505 20:13:24.782055 8058 ts_tablet_manager.cc:1434] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:24.782460 8058 tablet_bootstrap.cc:492] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.784372 8058 tablet_bootstrap.cc:654] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.792099 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 50c1f63c849c48438abdaa965ab051f9 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.792522 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c6acad22190b402d892d06ff97bd9476
I20260505 20:13:24.792972 7336 catalog_manager.cc:6741] ReplaceTablet: tablet c6acad22190b402d892d06ff97bd9476 deleted and replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
I20260505 20:13:24.793962 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e0f86a888c5e4fb3acbd78f68c81576f
I20260505 20:13:24.793967 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.794001 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.794641 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c6acad22190b402d892d06ff97bd9476 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6acad22190b402d892d06ff97bd9476 already in progress: creating tablet
I20260505 20:13:24.795312 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.795315 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.796108 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.796808 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet ef996218e8b14e3b80eeab3397edec57
W20260505 20:13:24.797058 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet c6acad22190b402d892d06ff97bd9476 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6acad22190b402d892d06ff97bd9476 already in progress: creating tablet
W20260505 20:13:24.797365 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e0f86a888c5e4fb3acbd78f68c81576f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0f86a888c5e4fb3acbd78f68c81576f already in progress: creating tablet
I20260505 20:13:24.798089 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet ef996218e8b14e3b80eeab3397edec57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:24.799010 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet ef996218e8b14e3b80eeab3397edec57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef996218e8b14e3b80eeab3397edec57 already in progress: creating tablet
I20260505 20:13:24.800045 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ffa875058cee4e55be4b729695429088" } new_table_name: "default.Table_d940540a0f0347a396258cd69ee109ec" modify_external_catalogs: true
I20260505 20:13:24.802261 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_5ff2080bf4fe485eb6d9dd8ed4db9998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.802492 8058 tablet_bootstrap.cc:492] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.802742 8058 ts_tablet_manager.cc:1403] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.003s
W20260505 20:13:24.802826 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ff2080bf4fe485eb6d9dd8ed4db9998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.804204 7333 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:24.804041 8058 raft_consensus.cc:359] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.804513 8058 raft_consensus.cc:385] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.804610 8058 raft_consensus.cc:740] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.804884 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.804915 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 47de1578fdd74a198c48606aec33880a with delete_type TABLET_DATA_DELETED (replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.805116 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f656c47c5f46fe811ff64c58972e76 with delete_type TABLET_DATA_DELETED (replaced by tablet ef996218e8b14e3b80eeab3397edec57) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.805325 8052 tablet_replica.cc:333] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.805497 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8b63051c976146d3aff15ec0f7360e15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.805630 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 02eafc72ff7d4055b424322e01dc0c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.805608 8058 consensus_queue.cc:260] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.805894 8051 tablet_replica.cc:333] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.806120 8051 raft_consensus.cc:2243] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.806315 8051 raft_consensus.cc:2272] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.806558 8194 raft_consensus.cc:493] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.806735 8194 raft_consensus.cc:515] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.807157 8052 raft_consensus.cc:2243] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.807331 8052 raft_consensus.cc:2272] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.807430 8194 leader_election.cc:290] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.808317 8058 ts_tablet_manager.cc:1434] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260505 20:13:24.808894 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f656c47c5f46fe811ff64c58972e76" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.809201 8058 tablet_bootstrap.cc:492] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.809371 8051 ts_tablet_manager.cc:1916] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.809656 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet ef996218e8b14e3b80eeab3397edec57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:24.809856 7870 leader_election.cc:343] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.810115 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f656c47c5f46fe811ff64c58972e76" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:24.810634 7801 raft_consensus.cc:2468] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:24.811962 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d with delete_type TABLET_DATA_DELETED (replaced by tablet bd01314146a34257b444a622829b2fe4) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.809507 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.812397 8052 ts_tablet_manager.cc:1916] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.813001 8058 tablet_bootstrap.cc:654] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.813902 7869 leader_election.cc:304] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.817830 7800 raft_consensus.cc:2468] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:24.822891 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:24.823388 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 84fb3dcea55d4b348cbf92c3c4581dda deleted and replaced by tablet 56bd0f4254424c979f90da0400e0ec70
I20260505 20:13:24.823787 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_833aef6a6ffc466c8f56b9bee24bf1a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.823915 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:24.824366 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_833aef6a6ffc466c8f56b9bee24bf1a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:24.825650 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4939dab5a4d54a08a75424bcaabbb8dd consensus state has no leader
I20260505 20:13:24.825686 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:24.826030 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_02ead6059fbb492591198fcb073db9a5" } new_table_name: "default.Table_fd8e9fdcf5bc46618c60ae7d28d7a2d5" modify_external_catalogs: true
I20260505 20:13:24.830255 7869 leader_election.cc:304] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.830760 8127 raft_consensus.cc:2804] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.830885 8127 raft_consensus.cc:493] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.830981 8127 raft_consensus.cc:3060] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.834441 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_17eda505104c417ba34f71dbb19633f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.835050 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17eda505104c417ba34f71dbb19633f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.836009 8052 ts_tablet_manager.cc:1929] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.836509 8058 tablet_bootstrap.cc:492] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.836527 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c1015d9a8a7a49cba428a699afd14df2" } modify_external_catalogs: true
I20260505 20:13:24.836712 8058 ts_tablet_manager.cc:1403] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.006s
I20260505 20:13:24.836704 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c1015d9a8a7a49cba428a699afd14df2" } modify_external_catalogs: true
I20260505 20:13:24.836853 8052 log.cc:1199] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/245c8328c49347bf8b15d58cb5380fe0
I20260505 20:13:24.837148 8194 raft_consensus.cc:2804] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:24.837430 8052 ts_tablet_manager.cc:1950] T 245c8328c49347bf8b15d58cb5380fe0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.797685 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_078e80255cc64422a110908c5afebd6d" } new_table_name: "default.Table_833db141dc5a45e683fec596edc857b5" modify_external_catalogs: true
W20260505 20:13:24.838846 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b63051c976146d3aff15ec0f7360e15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.839514 8089 raft_consensus.cc:493] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.839432 8058 raft_consensus.cc:359] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.839546 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 245c8328c49347bf8b15d58cb5380fe0 (table default.Table_76b9386a48e94edcabaf5284ccf85588 [id=8c02c85d53eb4657a278fdc32a92d258]) successfully deleted
I20260505 20:13:24.839637 8058 raft_consensus.cc:385] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.839730 8058 raft_consensus.cc:740] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.839668 8089 raft_consensus.cc:515] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.839906 8052 tablet_replica.cc:333] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.840315 8052 raft_consensus.cc:2243] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:24.840330 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c6acad22190b402d892d06ff97bd9476 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6acad22190b402d892d06ff97bd9476 already in progress: creating tablet
I20260505 20:13:24.840512 8089 leader_election.cc:290] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:24.840561 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e0f86a888c5e4fb3acbd78f68c81576f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0f86a888c5e4fb3acbd78f68c81576f already in progress: creating tablet
I20260505 20:13:24.840761 8058 consensus_queue.cc:260] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.841118 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet ef996218e8b14e3b80eeab3397edec57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.841382 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.841594 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f656c47c5f46fe811ff64c58972e76 with delete_type TABLET_DATA_DELETED (replaced by tablet ef996218e8b14e3b80eeab3397edec57) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.842095 8050 tablet_replica.cc:333] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.842132 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47de1578fdd74a198c48606aec33880a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.841310 8127 raft_consensus.cc:515] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.842347 7662 raft_consensus.cc:2468] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:24.840535 8052 raft_consensus.cc:2272] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.842836 7736 leader_election.cc:304] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:24.843055 7736 raft_consensus.cc:2686] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:24.843420 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f656c47c5f46fe811ff64c58972e76" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:24.843959 7870 leader_election.cc:343] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.844112 8050 raft_consensus.cc:2243] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.844431 8050 raft_consensus.cc:2272] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.844740 8127 leader_election.cc:290] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.845319 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f656c47c5f46fe811ff64c58972e76" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:24.845723 7800 raft_consensus.cc:3060] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.846624 8050 ts_tablet_manager.cc:1916] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.846720 8058 ts_tablet_manager.cc:1434] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260505 20:13:24.847029 8058 tablet_bootstrap.cc:492] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.847337 8052 ts_tablet_manager.cc:1916] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:24.850169 7737 leader_election.cc:343] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 47de1578fdd74a198c48606aec33880a
I20260505 20:13:24.850198 8194 raft_consensus.cc:697] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:24.850489 8194 consensus_queue.cc:237] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.850968 8058 tablet_bootstrap.cc:654] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.852905 7800 raft_consensus.cc:2468] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:24.853473 7869 leader_election.cc:304] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:24.853788 7869 raft_consensus.cc:2686] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:24.857245 8127 raft_consensus.cc:493] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.857381 8127 raft_consensus.cc:515] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.857980 8127 leader_election.cc:290] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.859377 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dbde45980c4f2b8d6bee05416fa2c6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.859632 7662 raft_consensus.cc:2468] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:24.850054 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet ef996218e8b14e3b80eeab3397edec57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef996218e8b14e3b80eeab3397edec57 already in progress: creating tablet
W20260505 20:13:24.860348 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 84fb3dcea55d4b348cbf92c3c4581dda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84fb3dcea55d4b348cbf92c3c4581dda already in progress: creating tablet
I20260505 20:13:24.861091 7870 leader_election.cc:304] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:24.862900 7662 raft_consensus.cc:3060] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.863231 8052 ts_tablet_manager.cc:1929] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.863287 8194 raft_consensus.cc:2804] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:24.863379 8052 log.cc:1199] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/47de1578fdd74a198c48606aec33880a
I20260505 20:13:24.863374 8194 raft_consensus.cc:493] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:24.863464 8194 raft_consensus.cc:3060] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.863729 8052 ts_tablet_manager.cc:1950] T 47de1578fdd74a198c48606aec33880a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.864574 8052 tablet_replica.cc:333] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.864768 8052 raft_consensus.cc:2243] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.864921 8052 raft_consensus.cc:2272] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.865121 8051 ts_tablet_manager.cc:1929] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.865247 8051 log.cc:1199] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/02eafc72ff7d4055b424322e01dc0c84
I20260505 20:13:24.865581 8051 ts_tablet_manager.cc:1950] T 02eafc72ff7d4055b424322e01dc0c84 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:24.866158 8194 raft_consensus.cc:515] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.866952 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 02eafc72ff7d4055b424322e01dc0c84 (table default.Table_ee151aa3a641443babaff433f49444e7 [id=bec691f68e1c4e6bbfd4986e6dbbb36a]) successfully deleted
I20260505 20:13:24.867317 8194 leader_election.cc:290] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.868023 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dbde45980c4f2b8d6bee05416fa2c6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:24.868378 7661 raft_consensus.cc:3060] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.869172 8058 tablet_bootstrap.cc:492] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.869947 8058 ts_tablet_manager.cc:1403] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.003s
I20260505 20:13:24.871272 8052 ts_tablet_manager.cc:1916] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.871690 8050 ts_tablet_manager.cc:1929] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.871654 7661 raft_consensus.cc:2468] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:24.871799 8050 log.cc:1199] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/43f656c47c5f46fe811ff64c58972e76
I20260505 20:13:24.872179 8050 ts_tablet_manager.cc:1950] T 43f656c47c5f46fe811ff64c58972e76 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:24.872225 7870 leader_election.cc:304] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:24.872491 8127 raft_consensus.cc:493] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.872664 8127 raft_consensus.cc:515] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.873160 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 43f656c47c5f46fe811ff64c58972e76 (table default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]) successfully deleted
I20260505 20:13:24.873234 8127 leader_election.cc:290] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.873399 8127 raft_consensus.cc:2804] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:24.873535 8127 raft_consensus.cc:697] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:24.873852 8127 consensus_queue.cc:237] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.875401 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 47de1578fdd74a198c48606aec33880a (table default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]) successfully deleted
W20260505 20:13:24.875923 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 84fb3dcea55d4b348cbf92c3c4581dda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84fb3dcea55d4b348cbf92c3c4581dda already in progress: creating tablet
I20260505 20:13:24.875965 8171 raft_consensus.cc:493] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.876150 8171 raft_consensus.cc:515] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.876961 8171 leader_election.cc:290] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:24.877804 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dbde45980c4f2b8d6bee05416fa2c6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.878113 7664 raft_consensus.cc:2393] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:24.879662 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dbde45980c4f2b8d6bee05416fa2c6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:24.879879 7801 raft_consensus.cc:3060] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:24.879573 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f05cad2989475fa0305e98f562037b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:24.881248 7870 leader_election.cc:343] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:24.881671 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff4ea5fcb558489097e518a28ad967dd consensus state has no leader
I20260505 20:13:24.882642 7801 raft_consensus.cc:2468] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:24.884510 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f05cad2989475fa0305e98f562037b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:24.885059 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dbde45980c4f2b8d6bee05416fa2c6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:24.885324 7800 raft_consensus.cc:2376] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1. Re-sending same reply.
W20260505 20:13:24.886557 7869 leader_election.cc:343] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.886719 7869 leader_election.cc:304] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.887591 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00dbde45980c4f2b8d6bee05416fa2c6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:24.888334 8194 raft_consensus.cc:2749] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:24.888324 7737 leader_election.cc:304] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.888598 8171 raft_consensus.cc:2749] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:24.889684 8053 tablet_bootstrap.cc:492] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:24.890854 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 944bc61fe79c4f94bb280dae8e3cee59 consensus state has no leader
I20260505 20:13:24.891274 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_98748ee269264963be11b33de38e1d1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.891860 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98748ee269264963be11b33de38e1d1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.892381 8058 raft_consensus.cc:359] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.892619 8058 raft_consensus.cc:385] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.892685 8058 raft_consensus.cc:740] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.892225 8053 ts_tablet_manager.cc:1403] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.340s user 0.040s sys 0.093s
I20260505 20:13:24.892971 8058 consensus_queue.cc:260] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.893868 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6de073da4783421daab1910cc27d67f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:24.894312 8052 ts_tablet_manager.cc:1929] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:24.894416 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6de073da4783421daab1910cc27d67f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.894505 8052 log.cc:1199] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/43f656c47c5f46fe811ff64c58972e76
I20260505 20:13:24.894543 8127 raft_consensus.cc:493] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:24.894726 8127 raft_consensus.cc:515] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.894891 8052 ts_tablet_manager.cc:1950] T 43f656c47c5f46fe811ff64c58972e76 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.895143 8053 raft_consensus.cc:359] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.895493 8053 raft_consensus.cc:385] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.895594 8053 raft_consensus.cc:740] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.896067 8127 leader_election.cc:290] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:24.893514 8058 ts_tablet_manager.cc:1434] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.023s user 0.000s sys 0.001s
I20260505 20:13:24.895974 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c8328c49347bf8b15d58cb5380fe0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:24.896299 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_777277a81f294f5ca73544b582368deb" } new_table_name: "default.Table_d5ccdf283f4a497ba3f7f316f7b786ae" modify_external_catalogs: true
W20260505 20:13:24.896638 7869 leader_election.cc:343] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 245c8328c49347bf8b15d58cb5380fe0
W20260505 20:13:24.897785 7870 leader_election.cc:343] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:24.897912 7870 leader_election.cc:304] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:24.898219 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 43f656c47c5f46fe811ff64c58972e76 (table default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]) successfully deleted
I20260505 20:13:24.898361 8127 raft_consensus.cc:2749] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:24.898483 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e11454be890e45bc9d2ba2cd319f2c93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.898988 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e11454be890e45bc9d2ba2cd319f2c93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:24.902429 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet ef996218e8b14e3b80eeab3397edec57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef996218e8b14e3b80eeab3397edec57 already in progress: creating tablet
I20260505 20:13:24.902850 8052 tablet_replica.cc:333] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:24.902930 8058 tablet_bootstrap.cc:492] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.903137 8052 raft_consensus.cc:2243] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.903378 8052 raft_consensus.cc:2272] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.904479 8052 ts_tablet_manager.cc:1916] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.907325 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_4357617bff6a440898a3f318565ad4ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:24.907842 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4357617bff6a440898a3f318565ad4ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:24.909237 8053 consensus_queue.cc:260] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.914211 8052 ts_tablet_manager.cc:1929] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:24.914417 8052 log.cc:1199] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1f3466dbbf1d42d2b6310a6e44f95f9d
I20260505 20:13:24.914640 8058 tablet_bootstrap.cc:654] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.914959 8052 ts_tablet_manager.cc:1950] T 1f3466dbbf1d42d2b6310a6e44f95f9d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:24.916077 8053 ts_tablet_manager.cc:1434] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260505 20:13:24.916752 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1f3466dbbf1d42d2b6310a6e44f95f9d (table default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]) successfully deleted
W20260505 20:13:24.918391 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e0f86a888c5e4fb3acbd78f68c81576f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0f86a888c5e4fb3acbd78f68c81576f already in progress: creating tablet
W20260505 20:13:24.919083 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 84fb3dcea55d4b348cbf92c3c4581dda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84fb3dcea55d4b348cbf92c3c4581dda already in progress: creating tablet
I20260505 20:13:24.919621 8053 tablet_bootstrap.cc:492] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:24.923884 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet ef996218e8b14e3b80eeab3397edec57 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:24.924058 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 47de1578fdd74a198c48606aec33880a with delete_type TABLET_DATA_DELETED (replaced by tablet 2c12a95b0ed445c7b598db136f6ac05c) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:24.924373 8051 tablet_replica.cc:333] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:24.924558 8051 raft_consensus.cc:2243] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.924734 8051 raft_consensus.cc:2272] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.925343 8254 tablet.cc:1724] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:24.926110 7334 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:24.930126 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a4ddebda9447389c15be61aa60baaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.930233 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f05cad2989475fa0305e98f562037b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.930408 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d with delete_type TABLET_DATA_DELETED (replaced by tablet bd01314146a34257b444a622829b2fe4) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.930634 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.930430 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a5d46461b746be9fc29431e972b7b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:24.932284 7335 catalog_manager.cc:5671] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:24.932904 7335 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]). Expected version 1 got 0
I20260505 20:13:24.933719 8050 tablet_replica.cc:333] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:24.934012 8050 raft_consensus.cc:2243] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:24.934257 8050 raft_consensus.cc:2272] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:24.933840 7340 catalog_manager.cc:5671] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:24.935941 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 34883b630a87480f953facb44615ef65 (DEFAULT_TABLE table=default.Table_85b92a55020a404f80a0290495181ab3 [id=33b67547f90545a99f9fedd756cbf001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.936295 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 34883b630a87480f953facb44615ef65 (DEFAULT_TABLE table=default.Table_85b92a55020a404f80a0290495181ab3 [id=33b67547f90545a99f9fedd756cbf001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.936420 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34883b630a87480f953facb44615ef65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.936700 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34883b630a87480f953facb44615ef65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.937629 8051 ts_tablet_manager.cc:1916] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.938810 8053 tablet_bootstrap.cc:654] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:24.939911 7778 tablet_service.cc:1511] Processing CreateTablet for tablet f4a8adf31bc94a33a61468adf2673681 (DEFAULT_TABLE table=default.Table_5eb1b00bd31442779cd50c207d3a2b1e [id=49103ea0eb57491fa5482997379eda9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.940340 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a8adf31bc94a33a61468adf2673681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.942224 7767 tablet_service.cc:1511] Processing CreateTablet for tablet bde33085759f4fd8a130d80878d1e564 (DEFAULT_TABLE table=default.Table_f1c1f40aa3044bdbbaa23ae22445214b [id=53e038ba0a4441ec9746e5dff6df39dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.942324 8058 tablet_bootstrap.cc:492] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:24.942468 8058 ts_tablet_manager.cc:1403] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260505 20:13:24.942585 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde33085759f4fd8a130d80878d1e564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.943679 7630 tablet_service.cc:1511] Processing CreateTablet for tablet b6895af5f55b4bc183065626417090a4 (DEFAULT_TABLE table=default.Table_db181a51dd2c430ca2792b4bef5cd912 [id=9c1ec1b20693456f9645c8f8f55af83f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.944056 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6895af5f55b4bc183065626417090a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.944401 7635 tablet_service.cc:1511] Processing CreateTablet for tablet b966b4bbaf9f4774af96051f857f02f7 (DEFAULT_TABLE table=default.Table_7e6c02c635da4beeac8892d580b67a93 [id=9ba85af1a1ee48e691f3b92e820c0500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.944811 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b966b4bbaf9f4774af96051f857f02f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.946066 7637 tablet_service.cc:1511] Processing CreateTablet for tablet bde33085759f4fd8a130d80878d1e564 (DEFAULT_TABLE table=default.Table_f1c1f40aa3044bdbbaa23ae22445214b [id=53e038ba0a4441ec9746e5dff6df39dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.946094 7765 tablet_service.cc:1511] Processing CreateTablet for tablet b6895af5f55b4bc183065626417090a4 (DEFAULT_TABLE table=default.Table_db181a51dd2c430ca2792b4bef5cd912 [id=9c1ec1b20693456f9645c8f8f55af83f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.946414 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde33085759f4fd8a130d80878d1e564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.946533 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6895af5f55b4bc183065626417090a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.950169 7642 tablet_service.cc:1511] Processing CreateTablet for tablet f4a8adf31bc94a33a61468adf2673681 (DEFAULT_TABLE table=default.Table_5eb1b00bd31442779cd50c207d3a2b1e [id=49103ea0eb57491fa5482997379eda9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.950584 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a8adf31bc94a33a61468adf2673681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.955626 8058 raft_consensus.cc:359] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.955852 8058 raft_consensus.cc:385] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.955821 7635 tablet_service.cc:1511] Processing CreateTablet for tablet f62626fb4f8445e3a6e2822277181762 (DEFAULT_TABLE table=default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.955955 8058 raft_consensus.cc:740] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.956245 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62626fb4f8445e3a6e2822277181762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.956200 8058 consensus_queue.cc:260] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.957258 7782 tablet_service.cc:1511] Processing CreateTablet for tablet b966b4bbaf9f4774af96051f857f02f7 (DEFAULT_TABLE table=default.Table_7e6c02c635da4beeac8892d580b67a93 [id=9ba85af1a1ee48e691f3b92e820c0500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.958020 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 34883b630a87480f953facb44615ef65 (DEFAULT_TABLE table=default.Table_85b92a55020a404f80a0290495181ab3 [id=33b67547f90545a99f9fedd756cbf001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.958158 7906 tablet_service.cc:1511] Processing CreateTablet for tablet bde33085759f4fd8a130d80878d1e564 (DEFAULT_TABLE table=default.Table_f1c1f40aa3044bdbbaa23ae22445214b [id=53e038ba0a4441ec9746e5dff6df39dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.958475 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34883b630a87480f953facb44615ef65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.958539 7908 tablet_service.cc:1511] Processing CreateTablet for tablet b6895af5f55b4bc183065626417090a4 (DEFAULT_TABLE table=default.Table_db181a51dd2c430ca2792b4bef5cd912 [id=9c1ec1b20693456f9645c8f8f55af83f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.958922 7901 tablet_service.cc:1511] Processing CreateTablet for tablet b966b4bbaf9f4774af96051f857f02f7 (DEFAULT_TABLE table=default.Table_7e6c02c635da4beeac8892d580b67a93 [id=9ba85af1a1ee48e691f3b92e820c0500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.961362 7780 tablet_service.cc:1511] Processing CreateTablet for tablet f62626fb4f8445e3a6e2822277181762 (DEFAULT_TABLE table=default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.961789 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62626fb4f8445e3a6e2822277181762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.961964 7905 tablet_service.cc:1511] Processing CreateTablet for tablet f62626fb4f8445e3a6e2822277181762 (DEFAULT_TABLE table=default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.962378 7913 tablet_service.cc:1511] Processing CreateTablet for tablet f4a8adf31bc94a33a61468adf2673681 (DEFAULT_TABLE table=default.Table_5eb1b00bd31442779cd50c207d3a2b1e [id=49103ea0eb57491fa5482997379eda9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.962437 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 (DEFAULT_TABLE table=default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.962792 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0112c04befa14c48bb5b2e7dfb60dac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.962801 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6895af5f55b4bc183065626417090a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.965998 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b966b4bbaf9f4774af96051f857f02f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.967311 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3320012d7d2d474e8bb80df0f8f7ee59" } modify_external_catalogs: true
I20260505 20:13:24.967553 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3320012d7d2d474e8bb80df0f8f7ee59" } modify_external_catalogs: true
I20260505 20:13:24.971490 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62626fb4f8445e3a6e2822277181762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.972546 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a8adf31bc94a33a61468adf2673681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.973109 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bde33085759f4fd8a130d80878d1e564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.976146 8053 tablet_bootstrap.cc:492] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:24.979013 8058 ts_tablet_manager.cc:1434] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.036s user 0.000s sys 0.003s
I20260505 20:13:24.980412 8053 ts_tablet_manager.cc:1403] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260505 20:13:24.980783 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b966b4bbaf9f4774af96051f857f02f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.981437 8053 raft_consensus.cc:359] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:24.982589 8058 tablet_bootstrap.cc:492] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:24.984716 7643 tablet_service.cc:1511] Processing CreateTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 (DEFAULT_TABLE table=default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.985282 8053 raft_consensus.cc:385] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:24.985390 8053 raft_consensus.cc:740] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:24.985193 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91ccd9761ee4386b9e80cb9c9cfa975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.994088 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 (DEFAULT_TABLE table=default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.994671 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0112c04befa14c48bb5b2e7dfb60dac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.998625 7642 tablet_service.cc:1511] Processing CreateTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 (DEFAULT_TABLE table=default.Table_648a436e7aa947bea4ebaff4d26c3357 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:24.998699 8050 ts_tablet_manager.cc:1916] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:24.999048 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdda1cc266cd47c993b5d1a0a78c7df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:24.999857 7637 tablet_service.cc:1511] Processing CreateTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 (DEFAULT_TABLE table=default.Table_3320012d7d2d474e8bb80df0f8f7ee59 [id=37a0fe2c6a244790a917bf66649e81ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.000181 8053 consensus_queue.cc:260] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.001024 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17da5cf513647d9b8e582a9b3b460a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.002506 7901 tablet_service.cc:1511] Processing CreateTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 (DEFAULT_TABLE table=default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.002787 7908 tablet_service.cc:1511] Processing CreateTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 (DEFAULT_TABLE table=default.Table_648a436e7aa947bea4ebaff4d26c3357 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.006410 7773 tablet_service.cc:1511] Processing CreateTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 (DEFAULT_TABLE table=default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.006881 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91ccd9761ee4386b9e80cb9c9cfa975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.007175 7767 tablet_service.cc:1511] Processing CreateTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 (DEFAULT_TABLE table=default.Table_3320012d7d2d474e8bb80df0f8f7ee59 [id=37a0fe2c6a244790a917bf66649e81ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.000131 8058 tablet_bootstrap.cc:654] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.008482 7766 tablet_service.cc:1511] Processing CreateTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 (DEFAULT_TABLE table=default.Table_648a436e7aa947bea4ebaff4d26c3357 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.008894 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 (DEFAULT_TABLE table=default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.009353 8171 raft_consensus.cc:493] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.009508 8171 raft_consensus.cc:515] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.009819 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91ccd9761ee4386b9e80cb9c9cfa975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.010725 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7aa09788a9b54cab8303f80b2237ee4e" } modify_external_catalogs: true
I20260505 20:13:25.010970 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7aa09788a9b54cab8303f80b2237ee4e" } modify_external_catalogs: true
I20260505 20:13:25.011133 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.011812 8171 leader_election.cc:290] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:25.012006 7736 leader_election.cc:343] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.013474 8053 ts_tablet_manager.cc:1434] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.033s user 0.002s sys 0.001s
I20260505 20:13:25.015164 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdda1cc266cd47c993b5d1a0a78c7df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.015784 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:25.016242 7737 leader_election.cc:343] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.016500 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdda1cc266cd47c993b5d1a0a78c7df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.016903 7737 leader_election.cc:304] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.019053 7905 tablet_service.cc:1511] Processing CreateTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 (DEFAULT_TABLE table=default.Table_3320012d7d2d474e8bb80df0f8f7ee59 [id=37a0fe2c6a244790a917bf66649e81ee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:25.020715 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01e800dfb0354beab9c835cbed9dceb4 consensus state has no leader
I20260505 20:13:25.021051 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 2461ad6b3ec94233b9dd7f60cbad4639 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.021894 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0" } modify_external_catalogs: true
I20260505 20:13:25.021960 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2ce0810dc8c5449fb746e618b948f7a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:25.022114 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0" } modify_external_catalogs: true
W20260505 20:13:25.022559 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ce0810dc8c5449fb746e618b948f7a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.022667 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17da5cf513647d9b8e582a9b3b460a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.024381 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0112c04befa14c48bb5b2e7dfb60dac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.028147 7635 tablet_service.cc:1511] Processing CreateTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e (DEFAULT_TABLE table=default.Table_4236c5f7709145e588050eb7b3d4ae44 [id=4073d8bcda1046afb42e5be3af1a9acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.028403 8171 raft_consensus.cc:2749] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.028954 8053 tablet_bootstrap.cc:492] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.030483 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d50ceda0ff4bb6b49920c922dfee9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.031008 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17da5cf513647d9b8e582a9b3b460a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.032015 8079 raft_consensus.cc:493] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.032217 8079 raft_consensus.cc:515] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.032958 8079 leader_election.cc:290] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:25.034138 7598 leader_election.cc:343] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 89f6ba8e4cba410daad729576d876329
W20260505 20:13:25.035584 7596 leader_election.cc:343] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 89f6ba8e4cba410daad729576d876329
I20260505 20:13:25.035715 7596 leader_election.cc:304] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.036280 8079 raft_consensus.cc:2749] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.038374 7780 tablet_service.cc:1511] Processing CreateTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e (DEFAULT_TABLE table=default.Table_4236c5f7709145e588050eb7b3d4ae44 [id=4073d8bcda1046afb42e5be3af1a9acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.042043 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d50ceda0ff4bb6b49920c922dfee9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.043815 8051 ts_tablet_manager.cc:1929] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.044345 8053 tablet_bootstrap.cc:654] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.047501 8054 tablet_bootstrap.cc:492] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.049480 8051 log.cc:1199] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/47de1578fdd74a198c48606aec33880a
I20260505 20:13:25.056979 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3f93bb9d891e4ac6b582689068819e21" } modify_external_catalogs: true
I20260505 20:13:25.057193 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3f93bb9d891e4ac6b582689068819e21" } modify_external_catalogs: true
I20260505 20:13:25.057806 8054 ts_tablet_manager.cc:1403] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.278s user 0.007s sys 0.052s
I20260505 20:13:25.058930 8054 raft_consensus.cc:359] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.059163 8054 raft_consensus.cc:385] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.059273 8054 raft_consensus.cc:740] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.059523 8054 consensus_queue.cc:260] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.061645 8054 ts_tablet_manager.cc:1434] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:25.062011 8054 tablet_bootstrap.cc:492] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.064818 8054 tablet_bootstrap.cc:654] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.067313 8051 ts_tablet_manager.cc:1950] T 47de1578fdd74a198c48606aec33880a P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:25.068701 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 47de1578fdd74a198c48606aec33880a (table default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]) successfully deleted
I20260505 20:13:25.069242 8058 tablet_bootstrap.cc:492] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.069442 8058 ts_tablet_manager.cc:1403] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.007s
I20260505 20:13:25.070181 8058 raft_consensus.cc:359] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.070395 8058 raft_consensus.cc:385] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.070506 8058 raft_consensus.cc:740] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.070816 8058 consensus_queue.cc:260] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.077950 7908 tablet_service.cc:1511] Processing CreateTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e (DEFAULT_TABLE table=default.Table_4236c5f7709145e588050eb7b3d4ae44 [id=4073d8bcda1046afb42e5be3af1a9acf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.079154 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d50ceda0ff4bb6b49920c922dfee9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.079854 8254 tablet.cc:1724] T 18ce59c1f3b64b518e244e32ac85b216 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:25.092207 8058 ts_tablet_manager.cc:1434] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260505 20:13:25.093928 8303 tablet.cc:1724] T 18ce59c1f3b64b518e244e32ac85b216 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:25.098652 8054 tablet_bootstrap.cc:492] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.098943 8054 ts_tablet_manager.cc:1403] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.003s
I20260505 20:13:25.099960 8054 raft_consensus.cc:359] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.100841 8054 raft_consensus.cc:385] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.101017 8054 raft_consensus.cc:740] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.101430 8054 consensus_queue.cc:260] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.103422 8054 ts_tablet_manager.cc:1434] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:25.103788 8054 tablet_bootstrap.cc:492] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.105537 8054 tablet_bootstrap.cc:654] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.107115 8058 tablet_bootstrap.cc:492] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.110576 8050 ts_tablet_manager.cc:1929] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.110812 8050 log.cc:1199] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/13a4ddebda9447389c15be61aa60baaf
I20260505 20:13:25.116412 8050 ts_tablet_manager.cc:1950] T 13a4ddebda9447389c15be61aa60baaf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.118463 8058 tablet_bootstrap.cc:654] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.120841 8054 tablet_bootstrap.cc:492] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.121937 8054 ts_tablet_manager.cc:1403] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260505 20:13:25.122056 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 13a4ddebda9447389c15be61aa60baaf (table default.Table_6168f9d927844aadaca4cf743d95c088 [id=41e7773608d34ceb98c40adc9c782d6f]) successfully deleted
I20260505 20:13:25.126838 8054 raft_consensus.cc:359] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.121160 8050 tablet_replica.cc:333] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.127296 8054 raft_consensus.cc:385] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.127976 8054 raft_consensus.cc:740] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.127650 8050 raft_consensus.cc:2243] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.129336 8050 raft_consensus.cc:2272] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.131013 8050 ts_tablet_manager.cc:1916] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.131289 8058 tablet_bootstrap.cc:492] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.131458 8058 ts_tablet_manager.cc:1403] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260505 20:13:25.132239 8058 raft_consensus.cc:359] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.132727 8058 raft_consensus.cc:385] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.132833 8058 raft_consensus.cc:740] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.132622 8054 consensus_queue.cc:260] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.133097 8058 consensus_queue.cc:260] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.136088 8058 ts_tablet_manager.cc:1434] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:25.136451 8058 tablet_bootstrap.cc:492] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.138055 8054 ts_tablet_manager.cc:1434] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260505 20:13:25.138520 8054 tablet_bootstrap.cc:492] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.141475 8058 tablet_bootstrap.cc:654] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.148906 8058 tablet_bootstrap.cc:492] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.149092 8058 ts_tablet_manager.cc:1403] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.004s
I20260505 20:13:25.149936 8058 raft_consensus.cc:359] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.151896 8058 raft_consensus.cc:385] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.151994 8058 raft_consensus.cc:740] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.152801 8058 consensus_queue.cc:260] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.153471 8054 tablet_bootstrap.cc:654] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.155479 8058 ts_tablet_manager.cc:1434] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260505 20:13:25.155833 8058 tablet_bootstrap.cc:492] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.158905 8058 tablet_bootstrap.cc:654] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.169492 8058 tablet_bootstrap.cc:492] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.169677 8058 ts_tablet_manager.cc:1403] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260505 20:13:25.171257 8058 raft_consensus.cc:359] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.171468 8058 raft_consensus.cc:385] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.171561 8058 raft_consensus.cc:740] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.173076 8058 consensus_queue.cc:260] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.174943 8058 ts_tablet_manager.cc:1434] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:25.175770 8317 tablet.cc:1724] T 18ce59c1f3b64b518e244e32ac85b216 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:25.175282 8058 tablet_bootstrap.cc:492] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.180380 8058 tablet_bootstrap.cc:654] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.161716 8050 ts_tablet_manager.cc:1929] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.180749 8050 log.cc:1199] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b4f05cad2989475fa0305e98f562037b
I20260505 20:13:25.181288 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 1ed44127b4c848bf9ed4a49ad8b106fb
I20260505 20:13:25.182271 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_69552f9e9e534627b2cf35ce35cc8d3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.182881 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69552f9e9e534627b2cf35ce35cc8d3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.184417 8050 ts_tablet_manager.cc:1950] T b4f05cad2989475fa0305e98f562037b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.185415 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.186406 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:25.186522 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 1ed44127b4c848bf9ed4a49ad8b106fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed44127b4c848bf9ed4a49ad8b106fb already in progress: creating tablet
I20260505 20:13:25.186841 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.190775 8054 tablet_bootstrap.cc:492] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.190670 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c8694c481ad84d5099a1ba7bab8a7557" } new_table_name: "default.Table_75b399df34af49b78ee0de07fcdc0991" modify_external_catalogs: true
I20260505 20:13:25.191170 8054 ts_tablet_manager.cc:1403] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.004s
I20260505 20:13:25.192451 8054 raft_consensus.cc:359] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.192827 8054 raft_consensus.cc:385] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.192977 8054 raft_consensus.cc:740] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.193032 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 944aad58d3c14577a0c66edd95fdf5e0 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.193508 8054 consensus_queue.cc:260] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.194227 8054 ts_tablet_manager.cc:1434] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:25.194453 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b17da5cf513647d9b8e582a9b3b460a1
I20260505 20:13:25.194718 8054 tablet_bootstrap.cc:492] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.195188 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bb26086f0d304240b95bbc9c075b996f" } new_table_name: "default.Table_2fea05446c6145fc9065f0db527efe94" modify_external_catalogs: true
I20260505 20:13:25.195312 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:25.196318 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b17da5cf513647d9b8e582a9b3b460a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17da5cf513647d9b8e582a9b3b460a1 already in progress: creating tablet
I20260505 20:13:25.196511 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 98af33c2cdb24937858efdc7b638418f
I20260505 20:13:25.196633 8050 tablet_replica.cc:333] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.196902 8050 raft_consensus.cc:2243] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:25.197190 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_9b5e553dfc45494b948a59ce6c8b11d0" } new_table_name: "default.Table_9b91d467468d48768be1b29a593e41d5" modify_external_catalogs: true
I20260505 20:13:25.197371 8050 pending_rounds.cc:70] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:25.197470 8050 pending_rounds.cc:77] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737171870863360 op_type: NO_OP noop_request { }
I20260505 20:13:25.197517 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.197592 8050 raft_consensus.cc:2889] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:25.197724 8050 raft_consensus.cc:2272] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:25.198215 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 98af33c2cdb24937858efdc7b638418f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98af33c2cdb24937858efdc7b638418f already in progress: creating tablet
I20260505 20:13:25.198534 7338 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]). Expected version 1 got 0
I20260505 20:13:25.198724 7338 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:25.199906 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f6ba8e4cba410daad729576d876329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.200157 8051 tablet_replica.cc:333] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:25.200237 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c96f5f09a5b74277ac2f72a83729e57a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:25.200412 8051 raft_consensus.cc:2243] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.200603 8051 raft_consensus.cc:2272] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:25.200873 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c96f5f09a5b74277ac2f72a83729e57a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.201663 8051 ts_tablet_manager.cc:1916] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.205679 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a5d46461b746be9fc29431e972b7b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.206014 8052 tablet_replica.cc:333] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
W20260505 20:13:25.206084 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 1ed44127b4c848bf9ed4a49ad8b106fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed44127b4c848bf9ed4a49ad8b106fb already in progress: creating tablet
I20260505 20:13:25.206256 8052 raft_consensus.cc:2243] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:25.206537 8052 pending_rounds.cc:70] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:25.206624 8052 pending_rounds.cc:77] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737171579465728 op_type: NO_OP noop_request { }
I20260505 20:13:25.206737 8052 raft_consensus.cc:2889] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:25.206864 8052 raft_consensus.cc:2272] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.207749 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.208061 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.210228 8052 ts_tablet_manager.cc:1916] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.212754 8051 ts_tablet_manager.cc:1929] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.212944 8051 log.cc:1199] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/89f6ba8e4cba410daad729576d876329
I20260505 20:13:25.213439 8051 ts_tablet_manager.cc:1950] T 89f6ba8e4cba410daad729576d876329 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:25.214478 8050 ts_tablet_manager.cc:1916] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.215570 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b4f05cad2989475fa0305e98f562037b (table default.Table_264d0b6fcd884b629f0fb38091195668 [id=f93e310a8d8049bfbeabf22d7fced243]) successfully deleted
I20260505 20:13:25.220919 8052 ts_tablet_manager.cc:1929] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:25.221897 8052 log.cc:1199] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/46a5d46461b746be9fc29431e972b7b7
I20260505 20:13:25.226197 8052 ts_tablet_manager.cc:1950] T 46a5d46461b746be9fc29431e972b7b7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.226866 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 46a5d46461b746be9fc29431e972b7b7 (table default.Table_3cdc5e88c3e742b5a633a8b309333e31 [id=f6758da8ac8e49a5b06230e1dcb75c19]) successfully deleted
W20260505 20:13:25.227802 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet b17da5cf513647d9b8e582a9b3b460a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17da5cf513647d9b8e582a9b3b460a1 already in progress: creating tablet
W20260505 20:13:25.228576 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 98af33c2cdb24937858efdc7b638418f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98af33c2cdb24937858efdc7b638418f already in progress: creating tablet
I20260505 20:13:25.216120 8054 tablet_bootstrap.cc:654] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.216361 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.216526 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.232304 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 89f6ba8e4cba410daad729576d876329 (table default.Table_245e946b31e8475f805cdc16988071aa [id=69324a8030d643c68a8d1098bc282fcf]) successfully deleted
W20260505 20:13:25.236022 7326 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_fd8e9fdcf5bc46618c60ae7d28d7a2d5 [id=bad5400c5cdc48eea57213e792147647], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 944bc61fe79c4f94bb280dae8e3cee59 consensus state has no leader
I20260505 20:13:25.237579 8050 ts_tablet_manager.cc:1929] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:25.239357 8053 tablet_bootstrap.cc:492] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.239527 8053 ts_tablet_manager.cc:1403] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.223s user 0.026s sys 0.063s
I20260505 20:13:25.240352 8053 raft_consensus.cc:359] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.240553 8053 raft_consensus.cc:385] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.240648 8053 raft_consensus.cc:740] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.240919 8053 consensus_queue.cc:260] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.241580 8053 ts_tablet_manager.cc:1434] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:25.241979 8053 tablet_bootstrap.cc:492] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.238940 8054 tablet_bootstrap.cc:492] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.243100 8054 ts_tablet_manager.cc:1403] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.003s
I20260505 20:13:25.243808 8053 tablet_bootstrap.cc:654] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.244479 8079 raft_consensus.cc:493] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.244414 8054 raft_consensus.cc:359] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.244663 8054 raft_consensus.cc:385] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.244644 8079 raft_consensus.cc:515] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.244787 8054 raft_consensus.cc:740] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.245092 8054 consensus_queue.cc:260] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.245220 8079 leader_election.cc:290] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.245846 8054 ts_tablet_manager.cc:1434] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:25.246203 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bba6267194d058cd08a27cdd2af49" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:25.246206 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611bba6267194d058cd08a27cdd2af49" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:25.246456 7936 raft_consensus.cc:2393] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:25.247174 8054 tablet_bootstrap.cc:492] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.248495 7598 leader_election.cc:304] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.248996 8079 raft_consensus.cc:3060] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.251191 8054 tablet_bootstrap.cc:654] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.252725 8079 raft_consensus.cc:2749] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.253813 8050 log.cc:1199] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1f3466dbbf1d42d2b6310a6e44f95f9d
I20260505 20:13:25.254426 8050 ts_tablet_manager.cc:1950] T 1f3466dbbf1d42d2b6310a6e44f95f9d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.254614 8171 consensus_queue.cc:1048] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:25.262535 8050 tablet_replica.cc:333] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.262707 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1f3466dbbf1d42d2b6310a6e44f95f9d (table default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]) successfully deleted
I20260505 20:13:25.265172 8050 raft_consensus.cc:2243] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.265435 8050 raft_consensus.cc:2272] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.265911 7336 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet b9b375a4bbec4527af704aa6cd08acec (table default.Table_3e927ca3870e46dfac9020afe0c894e5 [id=7e050176e69345a8ba527b6fa0d49da3]). Expected version 2 got 0
I20260505 20:13:25.266202 8050 ts_tablet_manager.cc:1916] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.268942 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 172cd9f38dd8491ea3ecf42b680d398f
I20260505 20:13:25.269714 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.270015 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 7591290e4ddf4bcc9d4676a2618a346c
W20260505 20:13:25.270829 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 172cd9f38dd8491ea3ecf42b680d398f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 172cd9f38dd8491ea3ecf42b680d398f already in progress: creating tablet
I20260505 20:13:25.270960 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:25.271904 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 7591290e4ddf4bcc9d4676a2618a346c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7591290e4ddf4bcc9d4676a2618a346c already in progress: creating tablet
I20260505 20:13:25.275313 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.275573 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.276289 8054 tablet_bootstrap.cc:492] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.276495 8054 ts_tablet_manager.cc:1403] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20260505 20:13:25.277565 8054 raft_consensus.cc:359] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.277931 8054 raft_consensus.cc:385] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.278031 8054 raft_consensus.cc:740] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.278388 8054 consensus_queue.cc:260] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.279673 8054 ts_tablet_manager.cc:1434] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260505 20:13:25.280035 8054 tablet_bootstrap.cc:492] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.281635 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.281937 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:25.282351 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 7591290e4ddf4bcc9d4676a2618a346c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7591290e4ddf4bcc9d4676a2618a346c already in progress: creating tablet
I20260505 20:13:25.285210 8054 tablet_bootstrap.cc:654] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.287346 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b36ca8cad35d47ba80d17ed4bbed7818"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.287971 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b36ca8cad35d47ba80d17ed4bbed7818 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.289105 8058 tablet_bootstrap.cc:492] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.289320 8058 ts_tablet_manager.cc:1403] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.114s user 0.011s sys 0.024s
W20260505 20:13:25.290905 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74a5d442f25242ea8371fca8643f4ce6 consensus state has no leader
I20260505 20:13:25.291335 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1598c3fff8174cfe825ce07774d713da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.291829 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1598c3fff8174cfe825ce07774d713da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.292376 8058 raft_consensus.cc:359] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.292567 8058 raft_consensus.cc:385] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.292636 8058 raft_consensus.cc:740] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.292953 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:25.292927 8058 consensus_queue.cc:260] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.293438 7340 catalog_manager.cc:6741] ReplaceTablet: tablet 944aad58d3c14577a0c66edd95fdf5e0 deleted and replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:25.293829 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_52395f8e91e449d480c726f789bad840"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:25.294076 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:25.294325 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52395f8e91e449d480c726f789bad840 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:25.294797 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 944aad58d3c14577a0c66edd95fdf5e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944aad58d3c14577a0c66edd95fdf5e0 already in progress: creating tablet
I20260505 20:13:25.295434 8058 ts_tablet_manager.cc:1434] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:25.296238 8058 tablet_bootstrap.cc:492] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.298236 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.298378 8058 tablet_bootstrap.cc:654] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.299546 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.300087 8053 tablet_bootstrap.cc:492] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.300271 8053 ts_tablet_manager.cc:1403] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.004s
I20260505 20:13:25.301112 8053 raft_consensus.cc:359] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.301324 8053 raft_consensus.cc:385] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.301421 8053 raft_consensus.cc:740] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:25.302960 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 172cd9f38dd8491ea3ecf42b680d398f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 172cd9f38dd8491ea3ecf42b680d398f already in progress: creating tablet
I20260505 20:13:25.303217 8050 ts_tablet_manager.cc:1929] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.303352 8050 log.cc:1199] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/245c8328c49347bf8b15d58cb5380fe0
I20260505 20:13:25.303803 8050 ts_tablet_manager.cc:1950] T 245c8328c49347bf8b15d58cb5380fe0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.309121 8053 consensus_queue.cc:260] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.310516 8171 consensus_queue.cc:1048] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260505 20:13:25.311708 8053 ts_tablet_manager.cc:1434] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260505 20:13:25.312348 8053 tablet_bootstrap.cc:492] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:25.312928 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 944aad58d3c14577a0c66edd95fdf5e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944aad58d3c14577a0c66edd95fdf5e0 already in progress: creating tablet
W20260505 20:13:25.320860 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e98c0e648c98488e8c5509b296824bea consensus state has no leader
I20260505 20:13:25.321228 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet 972b5c40369d41739d8c7a5bca22f04e from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.321894 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4d8c7cb46fb847a9976a0337b0c7f7fa" } new_table_name: "default.Table_cfd1ed72bf61489999a9ce28da492f92" modify_external_catalogs: true
W20260505 20:13:25.325384 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 983ad31892394f67a7a9a727dc2bef1b consensus state has no leader
I20260505 20:13:25.325706 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 862e865d406c4d95b97b579e9fe07df0 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.327780 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet f32d3ec040604ce7b384c4b6a202707f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.329452 8079 raft_consensus.cc:493] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.329666 8079 raft_consensus.cc:515] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.330549 8079 leader_election.cc:290] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.331084 8053 tablet_bootstrap.cc:654] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:25.331409 7598 leader_election.cc:343] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e32780089f084e57ab07a222e1353eff
W20260505 20:13:25.331660 7596 leader_election.cc:343] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: e32780089f084e57ab07a222e1353eff
I20260505 20:13:25.331776 7596 leader_election.cc:304] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.332335 8079 raft_consensus.cc:2749] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.335616 8053 tablet_bootstrap.cc:492] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.335775 8053 ts_tablet_manager.cc:1403] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.005s
I20260505 20:13:25.336541 8053 raft_consensus.cc:359] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.336719 8053 raft_consensus.cc:385] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.336813 8053 raft_consensus.cc:740] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.337076 8053 consensus_queue.cc:260] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.337718 8053 ts_tablet_manager.cc:1434] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:25.338078 8053 tablet_bootstrap.cc:492] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.339946 8053 tablet_bootstrap.cc:654] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.346016 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 245c8328c49347bf8b15d58cb5380fe0 (table default.Table_76b9386a48e94edcabaf5284ccf85588 [id=8c02c85d53eb4657a278fdc32a92d258]) successfully deleted
I20260505 20:13:25.332990 8054 tablet_bootstrap.cc:492] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.344070 8194 raft_consensus.cc:493] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.349416 8054 ts_tablet_manager.cc:1403] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.008s
I20260505 20:13:25.349362 8194 raft_consensus.cc:515] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.350147 8194 leader_election.cc:290] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.350679 8050 tablet_replica.cc:333] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.351177 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:25.351867 7869 leader_election.cc:343] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.351893 8050 raft_consensus.cc:2243] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.352376 8050 raft_consensus.cc:2272] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.352665 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:25.353385 7870 leader_election.cc:343] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.353540 7870 leader_election.cc:304] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.354010 8194 raft_consensus.cc:2749] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.354117 8050 ts_tablet_manager.cc:1916] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.359115 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 2461ad6b3ec94233b9dd7f60cbad4639
I20260505 20:13:25.359722 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 2461ad6b3ec94233b9dd7f60cbad4639 deleted and replaced by tablet 20bdc29641404cee850f27e9c392fbc0
I20260505 20:13:25.360109 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9e0dd67f8b694d72a476c8bd63f3cdcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.360773 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e0dd67f8b694d72a476c8bd63f3cdcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.361140 8050 ts_tablet_manager.cc:1929] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.361280 8050 log.cc:1199] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/46a5d46461b746be9fc29431e972b7b7
I20260505 20:13:25.353046 8054 raft_consensus.cc:359] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.361788 8054 raft_consensus.cc:385] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.361935 8054 raft_consensus.cc:740] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.362368 8054 consensus_queue.cc:260] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.362710 7333 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:25.364444 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 with delete_type TABLET_DATA_DELETED (replaced by tablet 20bdc29641404cee850f27e9c392fbc0) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.364477 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 with delete_type TABLET_DATA_DELETED (replaced by tablet 20bdc29641404cee850f27e9c392fbc0) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.364799 8052 tablet_replica.cc:333] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.365000 8052 raft_consensus.cc:2243] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:25.365378 8052 raft_consensus.cc:2272] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.365595 8054 ts_tablet_manager.cc:1434] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260505 20:13:25.365958 8054 tablet_bootstrap.cc:492] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.366797 8052 ts_tablet_manager.cc:1916] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.367300 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_648a436e7aa947bea4ebaff4d26c3357" } new_table_name: "default.Table_5a45becc03e84424944683d29051a244" modify_external_catalogs: true
I20260505 20:13:25.369233 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 with delete_type TABLET_DATA_DELETED (replaced by tablet 20bdc29641404cee850f27e9c392fbc0) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.369505 8051 tablet_replica.cc:333] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:25.369665 8051 raft_consensus.cc:2243] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.369896 8051 raft_consensus.cc:2272] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.370172 8079 raft_consensus.cc:493] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.370339 8079 raft_consensus.cc:515] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.371027 8079 leader_election.cc:290] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.371328 8051 ts_tablet_manager.cc:1916] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.373235 8052 ts_tablet_manager.cc:1929] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:25.373379 8052 log.cc:1199] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/2461ad6b3ec94233b9dd7f60cbad4639
I20260505 20:13:25.373790 8052 ts_tablet_manager.cc:1950] T 2461ad6b3ec94233b9dd7f60cbad4639 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.374248 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a5d46461b746be9fc29431e972b7b7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:25.374702 7596 leader_election.cc:343] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 46a5d46461b746be9fc29431e972b7b7
W20260505 20:13:25.374963 7598 leader_election.cc:343] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: Tablet not RUNNING: STOPPED
I20260505 20:13:25.375101 7598 leader_election.cc:304] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.375586 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]) successfully deleted
I20260505 20:13:25.375983 8079 raft_consensus.cc:2749] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.382520 8054 tablet_bootstrap.cc:654] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.386627 8058 tablet_bootstrap.cc:492] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.387405 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c7cd453210984ec7989f00858cf2aba5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.388170 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7cd453210984ec7989f00858cf2aba5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.391353 8058 ts_tablet_manager.cc:1403] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.096s user 0.008s sys 0.011s
I20260505 20:13:25.392726 8058 raft_consensus.cc:359] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.394192 8050 ts_tablet_manager.cc:1950] T 46a5d46461b746be9fc29431e972b7b7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.394555 8053 tablet_bootstrap.cc:492] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.394738 8053 ts_tablet_manager.cc:1403] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.003s
I20260505 20:13:25.395478 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 46a5d46461b746be9fc29431e972b7b7 (table default.Table_3cdc5e88c3e742b5a633a8b309333e31 [id=f6758da8ac8e49a5b06230e1dcb75c19]) successfully deleted
I20260505 20:13:25.395603 8053 raft_consensus.cc:359] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.395799 8053 raft_consensus.cc:385] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.395875 8053 raft_consensus.cc:740] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.396157 8053 consensus_queue.cc:260] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.397177 8053 ts_tablet_manager.cc:1434] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:25.397377 8058 raft_consensus.cc:385] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.398054 8053 tablet_bootstrap.cc:492] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.400207 8053 tablet_bootstrap.cc:654] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.400106 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_4678f19979234d3bba292f510282993e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.400707 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4678f19979234d3bba292f510282993e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.390348 8051 ts_tablet_manager.cc:1929] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:25.404179 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2329ffef76eb4466bffb67019f9ad8ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.404841 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2329ffef76eb4466bffb67019f9ad8ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.402429 8051 log.cc:1199] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/2461ad6b3ec94233b9dd7f60cbad4639
I20260505 20:13:25.407392 8051 ts_tablet_manager.cc:1950] T 2461ad6b3ec94233b9dd7f60cbad4639 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:25.408869 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]) successfully deleted
I20260505 20:13:25.409808 8054 tablet_bootstrap.cc:492] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.410153 8054 ts_tablet_manager.cc:1403] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.004s
I20260505 20:13:25.411432 8054 raft_consensus.cc:359] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.411854 8054 raft_consensus.cc:385] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.412029 8054 raft_consensus.cc:740] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.412459 8054 consensus_queue.cc:260] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:25.412810 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 1ed44127b4c848bf9ed4a49ad8b106fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed44127b4c848bf9ed4a49ad8b106fb already in progress: creating tablet
I20260505 20:13:25.413105 8054 ts_tablet_manager.cc:1434] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:25.398196 8058 raft_consensus.cc:740] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.413528 8058 consensus_queue.cc:260] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.414566 8053 tablet_bootstrap.cc:492] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.414718 8053 ts_tablet_manager.cc:1403] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.003s
I20260505 20:13:25.415612 8053 raft_consensus.cc:359] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.415805 8053 raft_consensus.cc:385] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.415903 8053 raft_consensus.cc:740] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.416158 8053 consensus_queue.cc:260] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.416739 8053 ts_tablet_manager.cc:1434] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:25.417687 8053 tablet_bootstrap.cc:492] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.419889 8053 tablet_bootstrap.cc:654] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.424239 7642 tablet_service.cc:1511] Processing CreateTablet for tablet a46c981a27ac4527a40d49714356185e (DEFAULT_TABLE table=default.Table_8b63051c976146d3aff15ec0f7360e15 [id=a5fa8efcbe7e4be9b25d0396d732a97c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.424489 8050 tablet_replica.cc:333] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.424697 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46c981a27ac4527a40d49714356185e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.424716 8050 raft_consensus.cc:2243] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.424813 8194 raft_consensus.cc:493] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.424911 8050 raft_consensus.cc:2272] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.424933 7342 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9b375a4bbec4527af704aa6cd08acec (table default.Table_3e927ca3870e46dfac9020afe0c894e5 [id=7e050176e69345a8ba527b6fa0d49da3]). Expected version 2 got 0
I20260505 20:13:25.424968 8194 raft_consensus.cc:515] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.425247 8054 tablet_bootstrap.cc:492] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.425660 8194 leader_election.cc:290] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.426349 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725cb481751048c29695726011c80c08" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:25.426537 7800 raft_consensus.cc:2468] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:25.427040 7869 leader_election.cc:304] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
W20260505 20:13:25.427562 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b17da5cf513647d9b8e582a9b3b460a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b17da5cf513647d9b8e582a9b3b460a1 already in progress: creating tablet
W20260505 20:13:25.427842 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 98af33c2cdb24937858efdc7b638418f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98af33c2cdb24937858efdc7b638418f already in progress: creating tablet
I20260505 20:13:25.428071 8058 ts_tablet_manager.cc:1434] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
W20260505 20:13:25.428084 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 172cd9f38dd8491ea3ecf42b680d398f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 172cd9f38dd8491ea3ecf42b680d398f already in progress: creating tablet
W20260505 20:13:25.428288 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 7591290e4ddf4bcc9d4676a2618a346c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7591290e4ddf4bcc9d4676a2618a346c already in progress: creating tablet
I20260505 20:13:25.428380 8058 tablet_bootstrap.cc:492] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:25.428483 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 944aad58d3c14577a0c66edd95fdf5e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944aad58d3c14577a0c66edd95fdf5e0 already in progress: creating tablet
I20260505 20:13:25.428529 8127 raft_consensus.cc:2804] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:25.428490 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 17acb52d6cde4ced988506cee48eb040 (DEFAULT_TABLE table=default.Table_e11454be890e45bc9d2ba2cd319f2c93 [id=8dc245508fd34445bb94f647505e20d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.428632 8127 raft_consensus.cc:493] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:25.428711 8127 raft_consensus.cc:3060] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.428867 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17acb52d6cde4ced988506cee48eb040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.428889 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 17acb52d6cde4ced988506cee48eb040 (DEFAULT_TABLE table=default.Table_e11454be890e45bc9d2ba2cd319f2c93 [id=8dc245508fd34445bb94f647505e20d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.429312 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17acb52d6cde4ced988506cee48eb040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.430243 8058 tablet_bootstrap.cc:654] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.431533 8127 raft_consensus.cc:515] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.431967 8054 tablet_bootstrap.cc:654] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.432719 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725cb481751048c29695726011c80c08" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:25.432843 7766 tablet_service.cc:1511] Processing CreateTablet for tablet a46c981a27ac4527a40d49714356185e (DEFAULT_TABLE table=default.Table_8b63051c976146d3aff15ec0f7360e15 [id=a5fa8efcbe7e4be9b25d0396d732a97c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.432914 7800 raft_consensus.cc:3060] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.433128 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 947a4d496d994b799d1688cc258a181d (DEFAULT_TABLE table=default.Table_833aef6a6ffc466c8f56b9bee24bf1a2 [id=3734c4511d224584aeed0efd6bac453d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.433243 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46c981a27ac4527a40d49714356185e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.433549 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947a4d496d994b799d1688cc258a181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.434638 7336 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_833db141dc5a45e683fec596edc857b5 [id=864842f5805c4e8aa36af98c0a5425a3] alter complete (version 3)
I20260505 20:13:25.435923 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725cb481751048c29695726011c80c08" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.436169 7800 raft_consensus.cc:2468] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:25.436882 8050 ts_tablet_manager.cc:1916] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.439281 7869 leader_election.cc:304] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:25.439463 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f05cad2989475fa0305e98f562037b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.439749 8052 tablet_replica.cc:333] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.439951 8052 raft_consensus.cc:2243] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.440166 8052 raft_consensus.cc:2272] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.440467 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 2461ad6b3ec94233b9dd7f60cbad4639 with delete_type TABLET_DATA_DELETED (replaced by tablet 20bdc29641404cee850f27e9c392fbc0) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.440552 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 947a4d496d994b799d1688cc258a181d (DEFAULT_TABLE table=default.Table_833aef6a6ffc466c8f56b9bee24bf1a2 [id=3734c4511d224584aeed0efd6bac453d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.440750 8052 ts_tablet_manager.cc:1916] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.440980 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947a4d496d994b799d1688cc258a181d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:25.441073 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 2461ad6b3ec94233b9dd7f60cbad4639 because the tablet was not found. No further retry: Not found: Tablet not found: 2461ad6b3ec94233b9dd7f60cbad4639
I20260505 20:13:25.442039 8194 raft_consensus.cc:2804] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:25.443472 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 17acb52d6cde4ced988506cee48eb040 (DEFAULT_TABLE table=default.Table_e11454be890e45bc9d2ba2cd319f2c93 [id=8dc245508fd34445bb94f647505e20d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.443877 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17acb52d6cde4ced988506cee48eb040. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:25.444554 7870 leader_election.cc:343] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.444523 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 47720452d3f44e18b16a06ae296b4c51 (DEFAULT_TABLE table=default.Table_5ff2080bf4fe485eb6d9dd8ed4db9998 [id=e7cb019ada204b03bb293a8367c06c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.444885 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47720452d3f44e18b16a06ae296b4c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.445122 8127 leader_election.cc:290] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.446025 7917 tablet_service.cc:1511] Processing CreateTablet for tablet a46c981a27ac4527a40d49714356185e (DEFAULT_TABLE table=default.Table_8b63051c976146d3aff15ec0f7360e15 [id=a5fa8efcbe7e4be9b25d0396d732a97c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.446403 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46c981a27ac4527a40d49714356185e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.447175 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 46a5d46461b746be9fc29431e972b7b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.447976 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet e32780089f084e57ab07a222e1353eff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.448848 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f3466dbbf1d42d2b6310a6e44f95f9d with delete_type TABLET_DATA_DELETED (replaced by tablet bd01314146a34257b444a622829b2fe4) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.448978 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 43f656c47c5f46fe811ff64c58972e76 with delete_type TABLET_DATA_DELETED (replaced by tablet ef996218e8b14e3b80eeab3397edec57) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.449086 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725cb481751048c29695726011c80c08" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:25.449606 7909 tablet_service.cc:1511] Processing CreateTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 (DEFAULT_TABLE table=default.Table_d991da0b0d3b445b918500a013593fe2 [id=600d612bf56b43cab35d268b714affa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.450023 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 947a4d496d994b799d1688cc258a181d (DEFAULT_TABLE table=default.Table_833aef6a6ffc466c8f56b9bee24bf1a2 [id=3734c4511d224584aeed0efd6bac453d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:25.450150 7870 leader_election.cc:343] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.450403 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947a4d496d994b799d1688cc258a181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.450744 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 47720452d3f44e18b16a06ae296b4c51 (DEFAULT_TABLE table=default.Table_5ff2080bf4fe485eb6d9dd8ed4db9998 [id=e7cb019ada204b03bb293a8367c06c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.450892 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 47720452d3f44e18b16a06ae296b4c51 (DEFAULT_TABLE table=default.Table_5ff2080bf4fe485eb6d9dd8ed4db9998 [id=e7cb019ada204b03bb293a8367c06c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.451134 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47720452d3f44e18b16a06ae296b4c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.451180 8051 tablet_replica.cc:333] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:25.451246 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47720452d3f44e18b16a06ae296b4c51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:25.452260 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 096ca710e3564d4b8db50f29dd56a5d4 has no consensus state
W20260505 20:13:25.453141 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdda1cc266cd47c993b5d1a0a78c7df9 consensus state has no leader
I20260505 20:13:25.454013 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.454196 7630 tablet_service.cc:1511] Processing CreateTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 (DEFAULT_TABLE table=default.Table_d991da0b0d3b445b918500a013593fe2 [id=600d612bf56b43cab35d268b714affa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.454455 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a1437fdc2e924e39b8a96205ee5adc40" } modify_external_catalogs: true
I20260505 20:13:25.454641 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_a1437fdc2e924e39b8a96205ee5adc40" } modify_external_catalogs: true
I20260505 20:13:25.454754 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 (DEFAULT_TABLE table=default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.456816 7334 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:25.458352 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f3ed0fb723674f06869eefa958b4bf71" } modify_external_catalogs: true
I20260505 20:13:25.458521 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f3ed0fb723674f06869eefa958b4bf71" } modify_external_catalogs: true
I20260505 20:13:25.462174 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2fea05446c6145fc9065f0db527efe94" } modify_external_catalogs: true
I20260505 20:13:25.462380 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2fea05446c6145fc9065f0db527efe94" } modify_external_catalogs: true
I20260505 20:13:25.465034 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet a9719876757e409b991b21410983e3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.465286 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.465484 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.465503 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 (DEFAULT_TABLE table=default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.465955 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.472761 7342 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:25.475447 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_53010b8cbf5e426590b4f82d68e96660"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.476266 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53010b8cbf5e426590b4f82d68e96660 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.480878 8051 raft_consensus.cc:2243] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.481405 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.482789 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a4ddebda9447389c15be61aa60baaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.483392 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.483469 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.483848 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.484807 8050 ts_tablet_manager.cc:1929] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:25.485015 8050 log.cc:1199] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/2461ad6b3ec94233b9dd7f60cbad4639
I20260505 20:13:25.485283 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d533f0e3c58043698845036dc6f256d4" } modify_external_catalogs: true
I20260505 20:13:25.485571 8050 ts_tablet_manager.cc:1950] T 2461ad6b3ec94233b9dd7f60cbad4639 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.485777 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d533f0e3c58043698845036dc6f256d4" } modify_external_catalogs: true
I20260505 20:13:25.486974 8052 ts_tablet_manager.cc:1929] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.488968 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 (DEFAULT_TABLE table=default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.489568 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.490327 8052 log.cc:1199] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b4f05cad2989475fa0305e98f562037b
I20260505 20:13:25.490901 8052 ts_tablet_manager.cc:1950] T b4f05cad2989475fa0305e98f562037b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.488039 7780 tablet_service.cc:1511] Processing CreateTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 (DEFAULT_TABLE table=default.Table_d991da0b0d3b445b918500a013593fe2 [id=600d612bf56b43cab35d268b714affa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.492574 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.492578 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b4f05cad2989475fa0305e98f562037b (table default.Table_264d0b6fcd884b629f0fb38091195668 [id=f93e310a8d8049bfbeabf22d7fced243]) successfully deleted
I20260505 20:13:25.490062 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 4628e33d204c452ab12acf76f754f2ad (DEFAULT_TABLE table=default.Table_6de073da4783421daab1910cc27d67f7 [id=607b2027efa648778bfe22e03371919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.494099 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4628e33d204c452ab12acf76f754f2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.496536 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet a9719876757e409b991b21410983e3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.499033 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 4628e33d204c452ab12acf76f754f2ad (DEFAULT_TABLE table=default.Table_6de073da4783421daab1910cc27d67f7 [id=607b2027efa648778bfe22e03371919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.499198 8054 tablet_bootstrap.cc:492] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.499362 8054 ts_tablet_manager.cc:1403] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.001s
I20260505 20:13:25.499625 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4628e33d204c452ab12acf76f754f2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.499547 7773 tablet_service.cc:1511] Processing CreateTablet for tablet e083f131eca54d98852e5685e08ef46b (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.500329 8054 raft_consensus.cc:359] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.500573 8054 raft_consensus.cc:385] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.500684 8054 raft_consensus.cc:740] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.501195 7905 tablet_service.cc:1511] Processing CreateTablet for tablet e083f131eca54d98852e5685e08ef46b (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.501608 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e083f131eca54d98852e5685e08ef46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.501686 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 56bd0f4254424c979f90da0400e0ec70 (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.502200 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bd0f4254424c979f90da0400e0ec70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.502200 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 883ec65f15604346813e5f87d55802fc (DEFAULT_TABLE table=default.Table_17eda505104c417ba34f71dbb19633f5 [id=373b40a3cc5a425f8e0609881bd0029f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.502803 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 56bd0f4254424c979f90da0400e0ec70 (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.503551 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 0677740c3f77442895361e22d616a9ba (DEFAULT_TABLE table=default.Table_f92fa7cbfb9c470fa562c941ef044c19 [id=89e7a33609724be8b189af017488a9c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.504056 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e083f131eca54d98852e5685e08ef46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.504487 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0677740c3f77442895361e22d616a9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.506206 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 883ec65f15604346813e5f87d55802fc (DEFAULT_TABLE table=default.Table_17eda505104c417ba34f71dbb19633f5 [id=373b40a3cc5a425f8e0609881bd0029f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.506628 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883ec65f15604346813e5f87d55802fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.508550 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883ec65f15604346813e5f87d55802fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.509864 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bd0f4254424c979f90da0400e0ec70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.510967 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 2461ad6b3ec94233b9dd7f60cbad4639 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]) successfully deleted
I20260505 20:13:25.515525 8052 tablet_replica.cc:333] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.520880 8052 raft_consensus.cc:2243] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.522369 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f" } modify_external_catalogs: true
I20260505 20:13:25.522593 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f" } modify_external_catalogs: true
I20260505 20:13:25.524029 8052 raft_consensus.cc:2272] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.533078 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a73fbe5892774352b079b4b0ce80d9c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.533730 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a73fbe5892774352b079b4b0ce80d9c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.535315 8052 ts_tablet_manager.cc:1916] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.535367 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4f52fc53fe804024afb6471c231bbe43" } new_table_name: "default.Table_efe81e982113463b9ff4f04403f0bac7" modify_external_catalogs: true
I20260505 20:13:25.539300 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c8328c49347bf8b15d58cb5380fe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.539506 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.540148 8051 raft_consensus.cc:2272] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.540517 8079 raft_consensus.cc:493] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.540678 8079 raft_consensus.cc:515] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.542850 8079 leader_election.cc:290] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.548594 7644 tablet_service.cc:1511] Processing CreateTablet for tablet 56bd0f4254424c979f90da0400e0ec70 (DEFAULT_TABLE table=default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.552559 8050 tablet_replica.cc:333] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.552781 8050 raft_consensus.cc:2243] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.552991 8050 raft_consensus.cc:2272] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.553390 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 4628e33d204c452ab12acf76f754f2ad (DEFAULT_TABLE table=default.Table_6de073da4783421daab1910cc27d67f7 [id=607b2027efa648778bfe22e03371919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.553527 8050 ts_tablet_manager.cc:1916] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.553836 7631 tablet_service.cc:1511] Processing CreateTablet for tablet e083f131eca54d98852e5685e08ef46b (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:25.554005 7596 leader_election.cc:343] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 43f656c47c5f46fe811ff64c58972e76
I20260505 20:13:25.555231 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.555924 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 883ec65f15604346813e5f87d55802fc (DEFAULT_TABLE table=default.Table_17eda505104c417ba34f71dbb19633f5 [id=373b40a3cc5a425f8e0609881bd0029f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.556352 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883ec65f15604346813e5f87d55802fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.557164 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 0677740c3f77442895361e22d616a9ba (DEFAULT_TABLE table=default.Table_f92fa7cbfb9c470fa562c941ef044c19 [id=89e7a33609724be8b189af017488a9c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.557564 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0677740c3f77442895361e22d616a9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.558319 8054 consensus_queue.cc:260] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.559552 8051 ts_tablet_manager.cc:1916] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:25.559676 7598 leader_election.cc:343] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 43f656c47c5f46fe811ff64c58972e76
I20260505 20:13:25.560472 7598 leader_election.cc:304] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.560966 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4628e33d204c452ab12acf76f754f2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.561053 8054 ts_tablet_manager.cc:1434] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.061s user 0.001s sys 0.002s
I20260505 20:13:25.561444 8054 tablet_bootstrap.cc:492] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.564185 8052 ts_tablet_manager.cc:1929] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.564333 8052 log.cc:1199] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/13a4ddebda9447389c15be61aa60baaf
I20260505 20:13:25.564654 8052 ts_tablet_manager.cc:1950] T 13a4ddebda9447389c15be61aa60baaf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.566637 8053 tablet_bootstrap.cc:492] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.566825 8053 ts_tablet_manager.cc:1403] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.149s user 0.006s sys 0.003s
I20260505 20:13:25.567739 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e083f131eca54d98852e5685e08ef46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.567711 8053 raft_consensus.cc:359] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.567948 8053 raft_consensus.cc:385] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.568024 8053 raft_consensus.cc:740] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.568269 8053 consensus_queue.cc:260] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.569269 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bd0f4254424c979f90da0400e0ec70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.571485 8054 tablet_bootstrap.cc:654] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.571477 8079 raft_consensus.cc:2749] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.574739 8050 ts_tablet_manager.cc:1929] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.577697 8053 ts_tablet_manager.cc:1434] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260505 20:13:25.578155 8050 log.cc:1199] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/a9719876757e409b991b21410983e3bf
I20260505 20:13:25.578895 8050 ts_tablet_manager.cc:1950] T a9719876757e409b991b21410983e3bf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.582934 8050 tablet_replica.cc:333] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.582939 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 13a4ddebda9447389c15be61aa60baaf (table default.Table_6168f9d927844aadaca4cf743d95c088 [id=41e7773608d34ceb98c40adc9c782d6f]) successfully deleted
I20260505 20:13:25.583696 8050 raft_consensus.cc:2243] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.583707 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet a9719876757e409b991b21410983e3bf (table default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]) successfully deleted
I20260505 20:13:25.584396 8050 raft_consensus.cc:2272] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.585785 8053 tablet_bootstrap.cc:492] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.587592 8053 tablet_bootstrap.cc:654] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.588387 8050 ts_tablet_manager.cc:1916] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.588855 8052 tablet_replica.cc:333] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.589074 8052 raft_consensus.cc:2243] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.589267 8052 raft_consensus.cc:2272] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.590692 8052 ts_tablet_manager.cc:1916] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.597493 8052 ts_tablet_manager.cc:1929] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.600734 8054 tablet_bootstrap.cc:492] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.601059 8054 ts_tablet_manager.cc:1403] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.002s
I20260505 20:13:25.603065 8054 raft_consensus.cc:359] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.603436 8054 raft_consensus.cc:385] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.603590 8054 raft_consensus.cc:740] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.599983 8053 tablet_bootstrap.cc:492] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.604121 8052 log.cc:1199] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/4cbb29bc765d476cb4634178f2806c10
I20260505 20:13:25.603986 8054 consensus_queue.cc:260] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.604209 8053 ts_tablet_manager.cc:1403] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260505 20:13:25.605294 8053 raft_consensus.cc:359] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.605556 8053 raft_consensus.cc:385] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.605682 8053 raft_consensus.cc:740] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.606009 8054 ts_tablet_manager.cc:1434] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:25.606390 8053 consensus_queue.cc:260] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.606918 8054 tablet_bootstrap.cc:492] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.609264 8054 tablet_bootstrap.cc:654] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.610273 8053 ts_tablet_manager.cc:1434] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:25.613447 8053 tablet_bootstrap.cc:492] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.615162 8053 tablet_bootstrap.cc:654] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.616405 8052 ts_tablet_manager.cc:1950] T 4cbb29bc765d476cb4634178f2806c10 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.617887 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 4cbb29bc765d476cb4634178f2806c10 (table default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d]) successfully deleted
I20260505 20:13:25.619012 8052 tablet_replica.cc:333] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.619469 8052 raft_consensus.cc:2243] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.619980 8052 raft_consensus.cc:2272] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.621047 8052 ts_tablet_manager.cc:1916] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.629843 8050 ts_tablet_manager.cc:1929] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.631292 8171 raft_consensus.cc:493] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.631485 8171 raft_consensus.cc:515] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.632210 8171 leader_election.cc:290] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:25.633384 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a5d442f25242ea8371fca8643f4ce6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:25.633565 8050 log.cc:1199] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/862e865d406c4d95b97b579e9fe07df0
I20260505 20:13:25.633612 7936 raft_consensus.cc:2468] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:25.633944 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a5d442f25242ea8371fca8643f4ce6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.634063 8050 ts_tablet_manager.cc:1950] T 862e865d406c4d95b97b579e9fe07df0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.634258 7737 leader_election.cc:304] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:25.634547 8171 raft_consensus.cc:2804] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260505 20:13:25.634593 7736 leader_election.cc:343] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.634676 8171 raft_consensus.cc:493] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:25.634775 8171 raft_consensus.cc:3060] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.637480 8171 raft_consensus.cc:515] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.638947 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a5d442f25242ea8371fca8643f4ce6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:25.638998 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a5d442f25242ea8371fca8643f4ce6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:25.639180 7936 raft_consensus.cc:3060] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:25.639570 7736 leader_election.cc:343] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.641983 7936 raft_consensus.cc:2468] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:25.642458 7737 leader_election.cc:304] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.642630 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 862e865d406c4d95b97b579e9fe07df0 (table default.Table_7c4d921cc7404bab95415fb55b417bc8 [id=c7a48b7bdb6d411794fc792531c3bd26]) successfully deleted
I20260505 20:13:25.642791 8339 raft_consensus.cc:2804] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:25.642865 8171 leader_election.cc:290] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:25.642961 8050 tablet_replica.cc:333] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:25.642994 8339 raft_consensus.cc:697] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:25.643309 8339 consensus_queue.cc:237] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.647969 8052 ts_tablet_manager.cc:1929] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.649184 8051 ts_tablet_manager.cc:1929] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.649467 8051 log.cc:1199] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/46a5d46461b746be9fc29431e972b7b7
I20260505 20:13:25.650462 8051 ts_tablet_manager.cc:1950] T 46a5d46461b746be9fc29431e972b7b7 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:25.651736 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 46a5d46461b746be9fc29431e972b7b7 (table default.Table_3cdc5e88c3e742b5a633a8b309333e31 [id=f6758da8ac8e49a5b06230e1dcb75c19]) successfully deleted
I20260505 20:13:25.654934 8052 log.cc:1199] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:25.655844 8052 ts_tablet_manager.cc:1950] T 3e77ec84858a4e46a993c579d9990f1b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.658051 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 3e77ec84858a4e46a993c579d9990f1b (table default.Table_55818053abfc4ea0a0cc4ef3f1bab479 [id=0149b0d509e947c4a1523cd8645446da]) successfully deleted
I20260505 20:13:25.660104 8052 tablet_replica.cc:333] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.660836 8052 raft_consensus.cc:2243] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.661547 8052 raft_consensus.cc:2272] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.662190 8051 tablet_replica.cc:333] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:25.662504 8051 raft_consensus.cc:2243] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.662839 8051 raft_consensus.cc:2272] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.663331 8052 ts_tablet_manager.cc:1916] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.663596 8051 ts_tablet_manager.cc:1916] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.669991 8194 raft_consensus.cc:697] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:25.670401 8194 consensus_queue.cc:237] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.671458 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 0677740c3f77442895361e22d616a9ba (DEFAULT_TABLE table=default.Table_f92fa7cbfb9c470fa562c941ef044c19 [id=89e7a33609724be8b189af017488a9c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.671747 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 (DEFAULT_TABLE table=default.Table_98748ee269264963be11b33de38e1d1e [id=46cde0b7c30d4eae8254a080cb8caac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.672065 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0677740c3f77442895361e22d616a9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.672226 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54becbd4690c403e803a7a79f12cb6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.674427 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 (DEFAULT_TABLE table=default.Table_98748ee269264963be11b33de38e1d1e [id=46cde0b7c30d4eae8254a080cb8caac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.674593 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 (DEFAULT_TABLE table=default.Table_98748ee269264963be11b33de38e1d1e [id=46cde0b7c30d4eae8254a080cb8caac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:25.674904 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54becbd4690c403e803a7a79f12cb6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.675019 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54becbd4690c403e803a7a79f12cb6d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:25.682157 8317 tablet.cc:1724] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:25.688896 8079 raft_consensus.cc:493] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.689044 8348 raft_consensus.cc:493] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.689069 8079 raft_consensus.cc:515] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.689235 8348 raft_consensus.cc:515] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.690527 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e77ec84858a4e46a993c579d9990f1b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.690716 7661 raft_consensus.cc:2468] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:25.691290 7870 leader_election.cc:304] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:25.691671 8127 raft_consensus.cc:2804] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:25.691763 8127 raft_consensus.cc:493] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:25.691809 7340 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]). Expected version 1 got 0
I20260505 20:13:25.691877 8127 raft_consensus.cc:3060] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.692085 7340 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:25.693476 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet b91ccd9761ee4386b9e80cb9c9cfa975 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.694674 8127 raft_consensus.cc:515] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.696723 8127 leader_election.cc:290] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.696831 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e77ec84858a4e46a993c579d9990f1b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:25.697089 7661 raft_consensus.cc:3060] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.697206 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:25.698945 7869 leader_election.cc:343] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:25.699222 8339 consensus_queue.cc:1048] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:25.706437 8079 leader_election.cc:290] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.706904 8356 tablet.cc:1724] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:25.707262 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf3b6cf3a4ef6b7c077f78b793283" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:25.708086 7661 raft_consensus.cc:2468] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:25.708364 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41cf3b6cf3a4ef6b7c077f78b793283" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:25.708858 7870 leader_election.cc:304] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.709618 7596 leader_election.cc:304] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.710175 8079 raft_consensus.cc:2749] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.710489 8127 raft_consensus.cc:2804] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:25.717947 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f32d3ec040604ce7b384c4b6a202707f
I20260505 20:13:25.718530 7341 catalog_manager.cc:6741] ReplaceTablet: tablet f32d3ec040604ce7b384c4b6a202707f deleted and replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c
I20260505 20:13:25.719493 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet f32d3ec040604ce7b384c4b6a202707f with delete_type TABLET_DATA_DELETED (replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.719513 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet f32d3ec040604ce7b384c4b6a202707f with delete_type TABLET_DATA_DELETED (replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.720566 7341 catalog_manager.cc:5671] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:25.721113 7341 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 74a5d442f25242ea8371fca8643f4ce6 (table default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8]). Expected version 1 got 0
I20260505 20:13:25.725219 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet f32d3ec040604ce7b384c4b6a202707f with delete_type TABLET_DATA_DELETED (replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.725631 8050 raft_consensus.cc:2243] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:25.726229 8050 pending_rounds.cc:70] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:25.726334 8050 pending_rounds.cc:77] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737175308910592 op_type: NO_OP noop_request { }
I20260505 20:13:25.726538 8050 raft_consensus.cc:2889] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:25.726666 8050 raft_consensus.cc:2272] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.728086 8050 ts_tablet_manager.cc:1916] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:25.730537 7869 leader_election.cc:343] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:25.730732 8348 leader_election.cc:290] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.731191 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 00dbde45980c4f2b8d6bee05416fa2c6
I20260505 20:13:25.733711 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.733898 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.736939 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.738523 8050 ts_tablet_manager.cc:1929] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:25.744541 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
I20260505 20:13:25.747512 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.749910 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.750743 8054 tablet_bootstrap.cc:492] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.751355 8054 ts_tablet_manager.cc:1403] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.145s user 0.011s sys 0.023s
I20260505 20:13:25.751964 7661 raft_consensus.cc:3060] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.752483 8054 raft_consensus.cc:359] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.752676 8054 raft_consensus.cc:385] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.752774 8054 raft_consensus.cc:740] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.753010 8054 consensus_queue.cc:260] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.753670 8054 ts_tablet_manager.cc:1434] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:25.754472 8054 tablet_bootstrap.cc:492] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.756888 8054 tablet_bootstrap.cc:654] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.757072 8194 consensus_queue.cc:1048] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260505 20:13:25.758446 8127 raft_consensus.cc:697] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:25.758749 8357 tablet.cc:1724] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:25.759131 8050 log.cc:1199] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/725cb481751048c29695726011c80c08
I20260505 20:13:25.754832 8171 raft_consensus.cc:493] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.759470 8171 raft_consensus.cc:515] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.759665 8050 ts_tablet_manager.cc:1950] T 725cb481751048c29695726011c80c08 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.760114 8171 leader_election.cc:290] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:25.757625 8089 consensus_queue.cc:1048] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260505 20:13:25.746376 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.764746 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9719876757e409b991b21410983e3bf" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.765215 8058 tablet_bootstrap.cc:492] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.765414 8058 ts_tablet_manager.cc:1403] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.337s user 0.026s sys 0.035s
W20260505 20:13:25.765491 7736 leader_election.cc:343] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.765600 8079 raft_consensus.cc:493] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.765792 8079 raft_consensus.cc:515] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.766247 8058 raft_consensus.cc:359] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.766453 8079 leader_election.cc:290] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:25.767269 7596 leader_election.cc:343] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 1f3466dbbf1d42d2b6310a6e44f95f9d
I20260505 20:13:25.767241 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 725cb481751048c29695726011c80c08 (table default.Table_cfd1ed72bf61489999a9ce28da492f92 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:25.767556 8050 tablet_replica.cc:333] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
W20260505 20:13:25.767608 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f32d3ec040604ce7b384c4b6a202707f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32d3ec040604ce7b384c4b6a202707f already in progress: creating tablet
I20260505 20:13:25.767876 8050 raft_consensus.cc:2243] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:25.768544 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bc1096f82cec44098b552845e587e89e" } new_table_name: "default.Table_08e8ff8899e844538e9421366d07e8a4" modify_external_catalogs: true
I20260505 20:13:25.769408 8058 raft_consensus.cc:385] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.769531 8058 raft_consensus.cc:740] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.769948 8050 pending_rounds.cc:70] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:25.770018 8050 pending_rounds.cc:77] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737171966132224 op_type: NO_OP noop_request { }
I20260505 20:13:25.770144 8050 raft_consensus.cc:2889] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:25.770407 8058 consensus_queue.cc:260] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:25.771407 7598 leader_election.cc:343] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1f3466dbbf1d42d2b6310a6e44f95f9d
I20260505 20:13:25.771598 8050 raft_consensus.cc:2272] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.771581 7598 leader_election.cc:304] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.771838 8079 raft_consensus.cc:2749] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.773313 8053 tablet_bootstrap.cc:492] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.771484 8058 ts_tablet_manager.cc:1434] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260505 20:13:25.773485 8053 ts_tablet_manager.cc:1403] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.160s user 0.008s sys 0.008s
I20260505 20:13:25.773881 8058 tablet_bootstrap.cc:492] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:25.775188 7737 leader_election.cc:343] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a9719876757e409b991b21410983e3bf
I20260505 20:13:25.774482 8050 ts_tablet_manager.cc:1916] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.775352 7737 leader_election.cc:304] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.775731 8171 raft_consensus.cc:2749] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.759089 8127 consensus_queue.cc:237] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.780359 8058 tablet_bootstrap.cc:654] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.781067 8053 raft_consensus.cc:359] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.781879 8127 raft_consensus.cc:493] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.782087 8127 raft_consensus.cc:515] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.782089 8054 tablet_bootstrap.cc:492] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.783222 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cba502b064583a50fb85ba7dea1b5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:25.783630 8054 ts_tablet_manager.cc:1403] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260505 20:13:25.783588 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cba502b064583a50fb85ba7dea1b5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:25.784318 7869 leader_election.cc:343] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.784447 8054 raft_consensus.cc:359] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.784696 8054 raft_consensus.cc:385] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.781649 8053 raft_consensus.cc:385] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.784847 8054 raft_consensus.cc:740] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.785038 8053 raft_consensus.cc:740] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:25.785136 7870 leader_election.cc:343] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.785259 7870 leader_election.cc:304] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.785524 8053 consensus_queue.cc:260] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.785594 8361 raft_consensus.cc:2749] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.785295 8054 consensus_queue.cc:260] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.787930 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e98c0e648c98488e8c5509b296824bea
I20260505 20:13:25.787994 8054 ts_tablet_manager.cc:1434] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:25.788388 8054 tablet_bootstrap.cc:492] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.789971 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.790349 8127 leader_election.cc:290] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.791060 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.791283 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.793866 8053 ts_tablet_manager.cc:1434] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260505 20:13:25.794668 8054 tablet_bootstrap.cc:654] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.745714 8052 ts_tablet_manager.cc:1929] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.796155 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8a93780aa604483c859e40281c9ea802" } new_table_name: "default.Table_08e74268c74d44938d75f8cdbfb18948" modify_external_catalogs: true
I20260505 20:13:25.796793 8058 tablet_bootstrap.cc:492] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.796978 8058 ts_tablet_manager.cc:1403] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260505 20:13:25.798013 8058 raft_consensus.cc:359] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.798233 8058 raft_consensus.cc:385] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.798328 8052 log.cc:1199] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/725cb481751048c29695726011c80c08
I20260505 20:13:25.798342 8058 raft_consensus.cc:740] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.798784 8053 tablet_bootstrap.cc:492] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.800396 8053 tablet_bootstrap.cc:654] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.801211 8052 ts_tablet_manager.cc:1950] T 725cb481751048c29695726011c80c08 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.802271 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 725cb481751048c29695726011c80c08 (table default.Table_cfd1ed72bf61489999a9ce28da492f92 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:25.802647 8052 tablet_replica.cc:333] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.802902 8052 raft_consensus.cc:2243] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.802816 8058 consensus_queue.cc:260] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.803150 8052 raft_consensus.cc:2272] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.804461 8052 ts_tablet_manager.cc:1916] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.804647 8058 ts_tablet_manager.cc:1434] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260505 20:13:25.805017 8058 tablet_bootstrap.cc:492] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.807236 8058 tablet_bootstrap.cc:654] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.802160 8050 ts_tablet_manager.cc:1929] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:25.812176 8050 log.cc:1199] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/00dbde45980c4f2b8d6bee05416fa2c6
I20260505 20:13:25.812381 8053 tablet_bootstrap.cc:492] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.811349 8054 tablet_bootstrap.cc:492] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.812594 8053 ts_tablet_manager.cc:1403] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260505 20:13:25.812682 8054 ts_tablet_manager.cc:1403] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260505 20:13:25.813448 8053 raft_consensus.cc:359] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.809435 8127 raft_consensus.cc:493] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.813691 8053 raft_consensus.cc:385] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.813885 8053 raft_consensus.cc:740] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.813874 8127 raft_consensus.cc:515] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.814258 8053 consensus_queue.cc:260] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.813513 8054 raft_consensus.cc:359] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.814589 8054 raft_consensus.cc:385] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.815433 8054 raft_consensus.cc:740] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.815759 8054 consensus_queue.cc:260] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.816227 8127 leader_election.cc:290] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.817104 8054 ts_tablet_manager.cc:1434] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260505 20:13:25.817113 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e80a1674d26c42e5a4884da99ab7918c
I20260505 20:13:25.817490 8054 tablet_bootstrap.cc:492] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.817806 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet e083f131eca54d98852e5685e08ef46b from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.818114 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet e80a1674d26c42e5a4884da99ab7918c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.818423 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:25.818619 7800 raft_consensus.cc:2468] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:25.819056 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.819268 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet e80a1674d26c42e5a4884da99ab7918c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.819659 8054 tablet_bootstrap.cc:654] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:25.819693 7870 leader_election.cc:343] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.820968 8053 ts_tablet_manager.cc:1434] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260505 20:13:25.821775 8058 tablet_bootstrap.cc:492] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.822005 8058 ts_tablet_manager.cc:1403] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260505 20:13:25.823081 8058 raft_consensus.cc:359] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.823364 8058 raft_consensus.cc:385] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.823457 8058 raft_consensus.cc:740] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.824060 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet e80a1674d26c42e5a4884da99ab7918c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.823822 8058 consensus_queue.cc:260] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.824366 7869 leader_election.cc:304] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.825502 8051 ts_tablet_manager.cc:1929] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.825712 8051 log.cc:1199] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e32780089f084e57ab07a222e1353eff
I20260505 20:13:25.825913 8053 tablet_bootstrap.cc:492] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.826349 8051 ts_tablet_manager.cc:1950] T e32780089f084e57ab07a222e1353eff P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:25.826817 8127 raft_consensus.cc:2804] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:25.826957 8127 raft_consensus.cc:493] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:25.827865 8127 raft_consensus.cc:3060] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.829037 8058 ts_tablet_manager.cc:1434] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260505 20:13:25.831023 8053 tablet_bootstrap.cc:654] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.831425 8050 ts_tablet_manager.cc:1950] T 00dbde45980c4f2b8d6bee05416fa2c6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:25.834837 8052 ts_tablet_manager.cc:1929] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.835243 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 00dbde45980c4f2b8d6bee05416fa2c6 (table default.Table_a1437fdc2e924e39b8a96205ee5adc40 [id=dc99b341dea243b9aa707fb2ba807db9]) successfully deleted
W20260505 20:13:25.835601 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 already in progress: creating tablet
W20260505 20:13:25.835870 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e98c0e648c98488e8c5509b296824bea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e98c0e648c98488e8c5509b296824bea already in progress: creating tablet
I20260505 20:13:25.835904 8052 log.cc:1199] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/a9719876757e409b991b21410983e3bf
I20260505 20:13:25.836445 8052 ts_tablet_manager.cc:1950] T a9719876757e409b991b21410983e3bf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.837169 8127 raft_consensus.cc:515] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.837586 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet a9719876757e409b991b21410983e3bf (table default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]) successfully deleted
W20260505 20:13:25.837883 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e80a1674d26c42e5a4884da99ab7918c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e80a1674d26c42e5a4884da99ab7918c already in progress: creating tablet
I20260505 20:13:25.838910 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:25.839495 7870 leader_election.cc:343] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.840104 8127 leader_election.cc:290] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.840193 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 1e453fdf9a424fe8974076fac3ad74bf
I20260505 20:13:25.840418 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:25.840605 8058 tablet_bootstrap.cc:492] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.840610 7800 raft_consensus.cc:3060] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.840960 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 79ce82aca20d44819f28785322e935ae from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.842473 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.843178 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.843532 7800 raft_consensus.cc:2468] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:25.844234 7869 leader_election.cc:304] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:25.845036 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 1e453fdf9a424fe8974076fac3ad74bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e453fdf9a424fe8974076fac3ad74bf already in progress: creating tablet
I20260505 20:13:25.845113 8127 raft_consensus.cc:2804] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:25.845422 8127 raft_consensus.cc:697] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:25.845697 8052 tablet_replica.cc:333] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.846330 8127 consensus_queue.cc:237] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.846899 8052 raft_consensus.cc:2243] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.847151 8052 raft_consensus.cc:2272] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.847582 8058 tablet_bootstrap.cc:654] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.848212 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.848359 8054 tablet_bootstrap.cc:492] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.848454 8052 ts_tablet_manager.cc:1916] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.848536 8054 ts_tablet_manager.cc:1403] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260505 20:13:25.849507 8054 raft_consensus.cc:359] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.849757 8054 raft_consensus.cc:385] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.849852 8054 raft_consensus.cc:740] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.850162 8054 consensus_queue.cc:260] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.852867 8054 ts_tablet_manager.cc:1434] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260505 20:13:25.855118 8079 raft_consensus.cc:493] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.855312 8054 tablet_bootstrap.cc:492] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.855275 8079 raft_consensus.cc:515] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.855902 8079 leader_election.cc:290] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:25.856954 7598 leader_election.cc:343] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a9719876757e409b991b21410983e3bf
W20260505 20:13:25.857196 7596 leader_election.cc:343] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: a9719876757e409b991b21410983e3bf
I20260505 20:13:25.857326 7596 leader_election.cc:304] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:25.857802 8079 raft_consensus.cc:2749] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.857883 8054 tablet_bootstrap.cc:654] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.858986 8053 tablet_bootstrap.cc:492] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.859215 8053 ts_tablet_manager.cc:1403] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260505 20:13:25.860006 8053 raft_consensus.cc:359] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.860258 8053 raft_consensus.cc:385] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.860378 8053 raft_consensus.cc:740] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.860692 8053 consensus_queue.cc:260] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.862789 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f181142ec34d41af89373e942d282285"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.863466 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f181142ec34d41af89373e942d282285 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.864107 8053 ts_tablet_manager.cc:1434] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
W20260505 20:13:25.864841 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ec1037f771740d1a094a622d5e49082 consensus state has no leader
I20260505 20:13:25.865234 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e39a201cd67e459489cc0ee580f8a165"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.865722 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e39a201cd67e459489cc0ee580f8a165 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.867123 8053 tablet_bootstrap.cc:492] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.873947 8053 tablet_bootstrap.cc:654] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.875358 8051 tablet_replica.cc:333] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:25.875469 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e32780089f084e57ab07a222e1353eff (table default.Table_1e208cbf87594a0288a8c70a5d2e476e [id=6521a9dc88b746aebd36af503e674dea]) successfully deleted
I20260505 20:13:25.885731 8051 raft_consensus.cc:2243] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.888142 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b91ccd9761ee4386b9e80cb9c9cfa975
I20260505 20:13:25.888573 7340 catalog_manager.cc:6741] ReplaceTablet: tablet b91ccd9761ee4386b9e80cb9c9cfa975 deleted and replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3
I20260505 20:13:25.888764 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:25.889309 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_72dc9ef65e1442a8ac2e33e7ca75b20d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.889925 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72dc9ef65e1442a8ac2e33e7ca75b20d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.892807 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.893148 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98]). Expected version 1 got 0
I20260505 20:13:25.893180 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.893280 8052 ts_tablet_manager.cc:1929] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:25.893347 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 74a5d442f25242ea8371fca8643f4ce6 (table default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8]). Expected version 1 got 0
I20260505 20:13:25.893405 8052 log.cc:1199] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/862e865d406c4d95b97b579e9fe07df0
W20260505 20:13:25.894448 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b91ccd9761ee4386b9e80cb9c9cfa975 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91ccd9761ee4386b9e80cb9c9cfa975 already in progress: creating tablet
I20260505 20:13:25.895460 8051 raft_consensus.cc:2272] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.895821 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.891088 8058 tablet_bootstrap.cc:492] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.897125 8058 ts_tablet_manager.cc:1403] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.057s user 0.019s sys 0.019s
I20260505 20:13:25.897291 8051 ts_tablet_manager.cc:1916] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.898228 8053 tablet_bootstrap.cc:492] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:25.898387 8053 ts_tablet_manager.cc:1403] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260505 20:13:25.898335 8058 raft_consensus.cc:359] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.898612 8058 raft_consensus.cc:385] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.898730 8058 raft_consensus.cc:740] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.899045 8058 consensus_queue.cc:260] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.899302 8053 raft_consensus.cc:359] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.899480 8053 raft_consensus.cc:385] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.899832 8058 ts_tablet_manager.cc:1434] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:25.900018 8053 raft_consensus.cc:740] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.900228 8058 tablet_bootstrap.cc:492] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.900395 8053 consensus_queue.cc:260] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:25.904052 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 034852d91c26434f8a3c7fd8100c49ac consensus state has no leader
I20260505 20:13:25.904281 8058 tablet_bootstrap.cc:654] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.904561 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_cb573900a07b4be28febcbbaed8b4bea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:25.905055 8053 ts_tablet_manager.cc:1434] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
W20260505 20:13:25.905175 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb573900a07b4be28febcbbaed8b4bea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.908226 8053 tablet_bootstrap.cc:492] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:25.912966 8058 tablet_bootstrap.cc:492] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.913165 8058 ts_tablet_manager.cc:1403] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260505 20:13:25.914490 8058 raft_consensus.cc:359] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.914744 8058 raft_consensus.cc:385] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.914836 8058 raft_consensus.cc:740] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.915158 8058 consensus_queue.cc:260] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.915850 8058 ts_tablet_manager.cc:1434] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260505 20:13:25.916237 8058 tablet_bootstrap.cc:492] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.917366 8054 tablet_bootstrap.cc:492] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:25.917520 8054 ts_tablet_manager.cc:1403] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.019s
I20260505 20:13:25.917927 8052 ts_tablet_manager.cc:1950] T 862e865d406c4d95b97b579e9fe07df0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:25.918087 8058 tablet_bootstrap.cc:654] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.919183 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 862e865d406c4d95b97b579e9fe07df0 (table default.Table_7c4d921cc7404bab95415fb55b417bc8 [id=c7a48b7bdb6d411794fc792531c3bd26]) successfully deleted
I20260505 20:13:25.919374 8052 tablet_replica.cc:333] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:25.919592 8052 raft_consensus.cc:2243] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:25.919765 8052 pending_rounds.cc:70] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
W20260505 20:13:25.919759 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f32d3ec040604ce7b384c4b6a202707f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32d3ec040604ce7b384c4b6a202707f already in progress: creating tablet
I20260505 20:13:25.919847 8052 pending_rounds.cc:77] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737171966132224 op_type: NO_OP noop_request { }
I20260505 20:13:25.919953 8052 raft_consensus.cc:2889] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:25.920079 8052 raft_consensus.cc:2272] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:25.920130 8054 raft_consensus.cc:359] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.921531 8054 raft_consensus.cc:385] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:25.921608 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4939dab5a4d54a08a75424bcaabbb8dd consensus state has no leader
I20260505 20:13:25.921663 8054 raft_consensus.cc:740] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.921981 8054 consensus_queue.cc:260] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.922367 8053 tablet_bootstrap.cc:654] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.923715 8052 ts_tablet_manager.cc:1916] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:25.924386 8054 ts_tablet_manager.cc:1434] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260505 20:13:25.924659 8054 tablet_bootstrap.cc:492] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:25.926617 8054 tablet_bootstrap.cc:654] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.927742 8171 raft_consensus.cc:493] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.927894 8171 raft_consensus.cc:515] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.928479 8171 leader_election.cc:290] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:25.929400 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc8fb89d614388969b5eff86ba31ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:25.930266 7736 consensus_peers.cc:597] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:25.930474 7736 leader_election.cc:343] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.930604 8127 raft_consensus.cc:493] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.930792 8127 raft_consensus.cc:515] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.931638 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b677360578864cf6b251512952987f68" } new_table_name: "default.Table_ae5f3f820d7a408eb8027c6556b44309" modify_external_catalogs: true
I20260505 20:13:25.932483 8127 leader_election.cc:290] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.932526 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cbb29bc765d476cb4634178f2806c10" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:25.932781 7661 raft_consensus.cc:2468] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:25.933264 7936 raft_consensus.cc:1275] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:25.933599 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc8fb89d614388969b5eff86ba31ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:25.933705 7870 leader_election.cc:304] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:25.934046 8058 tablet_bootstrap.cc:492] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:25.934132 8127 raft_consensus.cc:2804] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:25.934237 8127 raft_consensus.cc:493] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:25.934324 8127 raft_consensus.cc:3060] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.934459 7937 raft_consensus.cc:2468] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:25.934195 8058 ts_tablet_manager.cc:1403] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
W20260505 20:13:25.935165 7869 leader_election.cc:343] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 4cbb29bc765d476cb4634178f2806c10
I20260505 20:13:25.935492 8058 raft_consensus.cc:359] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.935665 8058 raft_consensus.cc:385] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:25.935658 7737 leader_election.cc:304] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.935783 8058 raft_consensus.cc:740] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:25.936024 8058 consensus_queue.cc:260] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.936087 8334 consensus_queue.cc:1048] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:25.936487 8334 raft_consensus.cc:2804] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:25.936589 8334 raft_consensus.cc:493] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:25.936662 8058 ts_tablet_manager.cc:1434] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:25.936672 8334 raft_consensus.cc:3060] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.937044 8058 tablet_bootstrap.cc:492] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:25.937316 8127 raft_consensus.cc:515] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.939249 8058 tablet_bootstrap.cc:654] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:25.939527 8334 raft_consensus.cc:515] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.941032 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc8fb89d614388969b5eff86ba31ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:25.941813 7736 leader_election.cc:343] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.942122 8127 leader_election.cc:290] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.942106 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cbb29bc765d476cb4634178f2806c10" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:25.942291 7661 raft_consensus.cc:3060] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.945096 7661 raft_consensus.cc:2468] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:25.945572 7870 leader_election.cc:304] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:25.946014 8334 leader_election.cc:290] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:25.946416 8127 raft_consensus.cc:2804] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:25.946653 8127 raft_consensus.cc:697] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:25.946940 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e083f131eca54d98852e5685e08ef46b
I20260505 20:13:25.947288 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24fc8fb89d614388969b5eff86ba31ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:25.947494 7342 catalog_manager.cc:6741] ReplaceTablet: tablet e083f131eca54d98852e5685e08ef46b deleted and replaced by tablet 506b421a774c4929813205dba0fac32b
I20260505 20:13:25.947477 7936 raft_consensus.cc:3060] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:25.948078 8127 consensus_queue.cc:237] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:25.948949 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.949101 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:25.949640 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e083f131eca54d98852e5685e08ef46b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e083f131eca54d98852e5685e08ef46b already in progress: creating tablet
I20260505 20:13:25.950723 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 79ce82aca20d44819f28785322e935ae
I20260505 20:13:25.951185 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 79ce82aca20d44819f28785322e935ae deleted and replaced by tablet 168d9a40a69d4beab8e79a97e7723e69
I20260505 20:13:25.951612 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.951560 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_453aeb092a0040998c34044a79fbecfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.951869 7869 leader_election.cc:343] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 4cbb29bc765d476cb4634178f2806c10
W20260505 20:13:25.952158 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_453aeb092a0040998c34044a79fbecfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.954142 7936 raft_consensus.cc:2468] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:25.954588 7737 leader_election.cc:304] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.954926 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:25.955009 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:25.955149 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:25.955363 8334 raft_consensus.cc:2804] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:25.955839 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 79ce82aca20d44819f28785322e935ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79ce82aca20d44819f28785322e935ae already in progress: creating tablet
I20260505 20:13:25.956300 8334 raft_consensus.cc:697] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:25.956691 8334 consensus_queue.cc:237] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.958631 8361 raft_consensus.cc:493] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:25.958818 8361 raft_consensus.cc:515] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:25.959533 8361 leader_election.cc:290] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:25.960261 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293ea58772bb4b479501d4bf3ead3ba0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:25.960803 7869 leader_election.cc:343] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.962601 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293ea58772bb4b479501d4bf3ead3ba0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:25.963267 7870 leader_election.cc:343] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:25.963413 7870 leader_election.cc:304] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:25.964030 8361 raft_consensus.cc:2749] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:25.964566 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_9e0dd67f8b694d72a476c8bd63f3cdcd" } new_table_name: "default.Table_a60fa5c161734fd1ad2dea23839786c4" modify_external_catalogs: true
I20260505 20:13:25.983868 8357 tablet.cc:1724] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:25.984143 8317 tablet.cc:1724] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:25.994837 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bba6c3da778b48e99f89f01110a160da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.995465 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bba6c3da778b48e99f89f01110a160da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:25.998831 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c49a496156544e27a5039eab18590a91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:25.999430 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c49a496156544e27a5039eab18590a91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.008000 8051 ts_tablet_manager.cc:1929] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.016997 8054 tablet_bootstrap.cc:492] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.017246 8054 ts_tablet_manager.cc:1403] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.093s user 0.013s sys 0.007s
I20260505 20:13:26.018450 8054 raft_consensus.cc:359] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.019275 8054 raft_consensus.cc:385] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.019402 8054 raft_consensus.cc:740] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.019665 8054 consensus_queue.cc:260] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.024811 8396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.252:42521 every 8 connection(s)
I20260505 20:13:26.025794 8053 tablet_bootstrap.cc:492] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.027379 8053 ts_tablet_manager.cc:1403] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.119s user 0.005s sys 0.004s
I20260505 20:13:26.028534 8053 raft_consensus.cc:359] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.028755 8053 raft_consensus.cc:385] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.028837 8053 raft_consensus.cc:740] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.029098 8053 consensus_queue.cc:260] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.029626 8053 ts_tablet_manager.cc:1434] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:26.030305 8101 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.252:42521
I20260505 20:13:26.034487 8101 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-2/data/info.pb
I20260505 20:13:26.035815 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_c8ad976998f340cf8dcfe84814ef6234"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.036391 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8ad976998f340cf8dcfe84814ef6234 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.036604 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 8101
I20260505 20:13:26.037514 7341 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_36c89c315bed4e668607a8f215ce43bb [id=25578717c43d40dfb1999130c1208d98] alter complete (version 1)
I20260505 20:13:26.038369 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_207fda948999454b99cc51dc2fca63c6" } modify_external_catalogs: true
I20260505 20:13:26.038527 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_207fda948999454b99cc51dc2fca63c6" } modify_external_catalogs: true
I20260505 20:13:26.040338 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cc9499abee5f46aa9bc36f8f562decc2" } modify_external_catalogs: true
I20260505 20:13:26.040480 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cc9499abee5f46aa9bc36f8f562decc2" } modify_external_catalogs: true
I20260505 20:13:26.041937 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e11454be890e45bc9d2ba2cd319f2c93" } modify_external_catalogs: true
I20260505 20:13:26.042109 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e11454be890e45bc9d2ba2cd319f2c93" } modify_external_catalogs: true
I20260505 20:13:26.042215 8054 ts_tablet_manager.cc:1434] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.025s user 0.004s sys 0.000s
I20260505 20:13:26.042718 8054 tablet_bootstrap.cc:492] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.043388 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.043681 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.043892 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.044140 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ab400210c54e99bc396674f7ba8235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.044546 8050 tablet_replica.cc:333] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.044744 8050 raft_consensus.cc:2243] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.044948 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.045012 8050 pending_rounds.cc:70] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:26.045084 8050 pending_rounds.cc:77] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737176366800896 op_type: NO_OP noop_request { }
I20260505 20:13:26.045209 8050 raft_consensus.cc:2889] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:26.045306 8050 raft_consensus.cc:2272] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:26.046900 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 725cb481751048c29695726011c80c08 because the tablet was not found. No further retry: Not found: Tablet not found: 725cb481751048c29695726011c80c08
I20260505 20:13:26.047480 8050 ts_tablet_manager.cc:1916] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.048985 8052 ts_tablet_manager.cc:1929] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.052618 8054 tablet_bootstrap.cc:654] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.022603 8079 raft_consensus.cc:493] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.053349 8079 raft_consensus.cc:515] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:26.054116 8079 leader_election.cc:290] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.036991 8058 tablet_bootstrap.cc:492] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.055308 8058 ts_tablet_manager.cc:1403] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.118s user 0.039s sys 0.040s
W20260505 20:13:26.055584 7596 leader_election.cc:343] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: b4f05cad2989475fa0305e98f562037b
W20260505 20:13:26.056033 7598 leader_election.cc:343] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b4f05cad2989475fa0305e98f562037b
I20260505 20:13:26.056150 7598 leader_election.cc:304] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:26.056427 8058 raft_consensus.cc:359] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.056589 8079 raft_consensus.cc:2749] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.056686 8058 raft_consensus.cc:385] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.056762 8058 raft_consensus.cc:740] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.057039 8058 consensus_queue.cc:260] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.054868 8051 log.cc:1199] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/1f3466dbbf1d42d2b6310a6e44f95f9d
I20260505 20:13:26.057651 8051 ts_tablet_manager.cc:1950] T 1f3466dbbf1d42d2b6310a6e44f95f9d P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.059763 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 1f3466dbbf1d42d2b6310a6e44f95f9d (table default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]) successfully deleted
I20260505 20:13:26.051797 8053 tablet_bootstrap.cc:492] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.061995 8053 tablet_bootstrap.cc:654] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.063063 8052 log.cc:1199] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/00dbde45980c4f2b8d6bee05416fa2c6
I20260505 20:13:26.063644 8052 ts_tablet_manager.cc:1950] T 00dbde45980c4f2b8d6bee05416fa2c6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:26.064663 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 00dbde45980c4f2b8d6bee05416fa2c6 (table default.Table_a1437fdc2e924e39b8a96205ee5adc40 [id=dc99b341dea243b9aa707fb2ba807db9]) successfully deleted
I20260505 20:13:26.073359 8050 ts_tablet_manager.cc:1929] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.073565 8050 log.cc:1199] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/4cbb29bc765d476cb4634178f2806c10
I20260505 20:13:26.059602 8058 ts_tablet_manager.cc:1434] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:26.067566 8051 tablet_replica.cc:333] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.078758 8051 raft_consensus.cc:2243] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.079079 8051 raft_consensus.cc:2272] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.079874 8051 ts_tablet_manager.cc:1916] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:26.080379 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 168d9a40a69d4beab8e79a97e7723e69 has no consensus state
W20260505 20:13:26.080672 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 already in progress: creating tablet
W20260505 20:13:26.081321 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e98c0e648c98488e8c5509b296824bea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e98c0e648c98488e8c5509b296824bea already in progress: creating tablet
I20260505 20:13:26.080113 8058 tablet_bootstrap.cc:492] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.087409 8058 tablet_bootstrap.cc:654] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:26.092099 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aad2a9f37ac4cbfa127ecceb132c8bb has no consensus state
I20260505 20:13:26.092248 8050 ts_tablet_manager.cc:1950] T 4cbb29bc765d476cb4634178f2806c10 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.092545 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.092972 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e80a1674d26c42e5a4884da99ab7918c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e80a1674d26c42e5a4884da99ab7918c already in progress: creating tablet
W20260505 20:13:26.093120 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:26.093710 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 1e453fdf9a424fe8974076fac3ad74bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e453fdf9a424fe8974076fac3ad74bf already in progress: creating tablet
W20260505 20:13:26.094334 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet b91ccd9761ee4386b9e80cb9c9cfa975 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91ccd9761ee4386b9e80cb9c9cfa975 already in progress: creating tablet
I20260505 20:13:26.094357 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 4cbb29bc765d476cb4634178f2806c10 (table default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d]) successfully deleted
W20260505 20:13:26.095031 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e083f131eca54d98852e5685e08ef46b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e083f131eca54d98852e5685e08ef46b already in progress: creating tablet
W20260505 20:13:26.095695 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 79ce82aca20d44819f28785322e935ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79ce82aca20d44819f28785322e935ae already in progress: creating tablet
I20260505 20:13:26.099342 7917 tablet_service.cc:1511] Processing CreateTablet for tablet b9d2b417857347468529868b51ec07ab (DEFAULT_TABLE table=default.Table_52395f8e91e449d480c726f789bad840 [id=a15b96b299e14a4a84a7f7aea63b09cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.099891 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d2b417857347468529868b51ec07ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.104228 7773 tablet_service.cc:1511] Processing CreateTablet for tablet b9d2b417857347468529868b51ec07ab (DEFAULT_TABLE table=default.Table_52395f8e91e449d480c726f789bad840 [id=a15b96b299e14a4a84a7f7aea63b09cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.104511 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 876496f026c84eff8fef175387d20062 (DEFAULT_TABLE table=default.Table_69552f9e9e534627b2cf35ce35cc8d3e [id=a751be2c3deb4410bfda0de55efcfc59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.105598 7643 tablet_service.cc:1511] Processing CreateTablet for tablet b9d2b417857347468529868b51ec07ab (DEFAULT_TABLE table=default.Table_52395f8e91e449d480c726f789bad840 [id=a15b96b299e14a4a84a7f7aea63b09cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.106077 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d2b417857347468529868b51ec07ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.108894 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (DEFAULT_TABLE table=default.Table_2ce0810dc8c5449fb746e618b948f7a0 [id=43f99e8f61944d3f8527224eb22c5edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.109238 7639 tablet_service.cc:1511] Processing CreateTablet for tablet fca1e2a2ea424ffd83bd5260694c1b3e (DEFAULT_TABLE table=default.Table_1598c3fff8174cfe825ce07774d713da [id=f207462834a048e780f910f10d41a2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.109711 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 876496f026c84eff8fef175387d20062 (DEFAULT_TABLE table=default.Table_69552f9e9e534627b2cf35ce35cc8d3e [id=a751be2c3deb4410bfda0de55efcfc59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.104223 7765 tablet_service.cc:1511] Processing CreateTablet for tablet fca1e2a2ea424ffd83bd5260694c1b3e (DEFAULT_TABLE table=default.Table_1598c3fff8174cfe825ce07774d713da [id=f207462834a048e780f910f10d41a2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.111474 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1e2a2ea424ffd83bd5260694c1b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.111706 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (DEFAULT_TABLE table=default.Table_2ce0810dc8c5449fb746e618b948f7a0 [id=43f99e8f61944d3f8527224eb22c5edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.112092 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876496f026c84eff8fef175387d20062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.112690 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 880cbba188144dd795873186f8cda1e9 (DEFAULT_TABLE table=default.Table_4357617bff6a440898a3f318565ad4ea [id=f767d2b232d84c08b169b41a1c443199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.112994 8053 tablet_bootstrap.cc:492] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.113126 8053 ts_tablet_manager.cc:1403] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.083s user 0.003s sys 0.001s
I20260505 20:13:26.113384 7908 tablet_service.cc:1511] Processing CreateTablet for tablet fca1e2a2ea424ffd83bd5260694c1b3e (DEFAULT_TABLE table=default.Table_1598c3fff8174cfe825ce07774d713da [id=f207462834a048e780f910f10d41a2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.113843 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1e2a2ea424ffd83bd5260694c1b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.114118 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (DEFAULT_TABLE table=default.Table_2ce0810dc8c5449fb746e618b948f7a0 [id=43f99e8f61944d3f8527224eb22c5edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.114451 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50680deff6fe4dcabbf5a3aeb47ac01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.115321 8053 raft_consensus.cc:359] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.115437 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 (DEFAULT_TABLE table=default.Table_c7cd453210984ec7989f00858cf2aba5 [id=349bbf04fd494d7fb5fea9acc0a11d64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.115522 8053 raft_consensus.cc:385] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.115607 8053 raft_consensus.cc:740] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.116539 8053 consensus_queue.cc:260] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.117640 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 8e190c973c984ec080178efa39b2def0 (DEFAULT_TABLE table=default.Table_c96f5f09a5b74277ac2f72a83729e57a [id=d52c9e2e31b34773959865aaa6f1833a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.117899 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50680deff6fe4dcabbf5a3aeb47ac01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.119176 8053 ts_tablet_manager.cc:1434] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:26.120639 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 (DEFAULT_TABLE table=default.Table_cfd1ed72bf61489999a9ce28da492f92 [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.120671 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 8e190c973c984ec080178efa39b2def0 (DEFAULT_TABLE table=default.Table_c96f5f09a5b74277ac2f72a83729e57a [id=d52c9e2e31b34773959865aaa6f1833a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.121045 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e190c973c984ec080178efa39b2def0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.121845 8127 raft_consensus.cc:493] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.122077 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 (DEFAULT_TABLE table=default.Table_c7cd453210984ec7989f00858cf2aba5 [id=349bbf04fd494d7fb5fea9acc0a11d64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.122404 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ce3efe875a43d9b30d40623bf8a385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.122499 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 20bdc29641404cee850f27e9c392fbc0 (DEFAULT_TABLE table=default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.123179 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 (DEFAULT_TABLE table=default.Table_cfd1ed72bf61489999a9ce28da492f92 [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.123558 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096ca710e3564d4b8db50f29dd56a5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.131704 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 880cbba188144dd795873186f8cda1e9 (DEFAULT_TABLE table=default.Table_4357617bff6a440898a3f318565ad4ea [id=f767d2b232d84c08b169b41a1c443199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.132333 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880cbba188144dd795873186f8cda1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.122030 8127 raft_consensus.cc:515] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.133466 8127 leader_election.cc:290] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.133607 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 20bdc29641404cee850f27e9c392fbc0 (DEFAULT_TABLE table=default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.113863 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 876496f026c84eff8fef175387d20062 (DEFAULT_TABLE table=default.Table_69552f9e9e534627b2cf35ce35cc8d3e [id=a751be2c3deb4410bfda0de55efcfc59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.134020 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bdc29641404cee850f27e9c392fbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.134268 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876496f026c84eff8fef175387d20062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.138482 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 8e650b297603425184ad97ddf99ec36d (DEFAULT_TABLE table=default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.139364 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7766caea43904162a2c289b7b17405d4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.141522 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet d2841214f07b4ae6b8cd7e97493b69d6 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.142278 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50680deff6fe4dcabbf5a3aeb47ac01e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.139428 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 8e650b297603425184ad97ddf99ec36d (DEFAULT_TABLE table=default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.142887 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e650b297603425184ad97ddf99ec36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.142990 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e650b297603425184ad97ddf99ec36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.145891 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d2b417857347468529868b51ec07ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.146160 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880cbba188144dd795873186f8cda1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.146543 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1e2a2ea424ffd83bd5260694c1b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.146899 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876496f026c84eff8fef175387d20062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.150113 8079 raft_consensus.cc:493] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.150187 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e190c973c984ec080178efa39b2def0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.150305 8079 raft_consensus.cc:515] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:26.151145 8079 leader_election.cc:290] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:26.152215 7598 leader_election.cc:343] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 725cb481751048c29695726011c80c08
W20260505 20:13:26.152933 7870 leader_election.cc:343] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.153497 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ce3efe875a43d9b30d40623bf8a385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.153934 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7766caea43904162a2c289b7b17405d4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:26.154155 7800 raft_consensus.cc:2468] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:26.155071 7869 leader_election.cc:304] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.155829 8127 raft_consensus.cc:2804] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.155932 8127 raft_consensus.cc:493] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.156031 8127 raft_consensus.cc:3060] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.159541 8127 raft_consensus.cc:515] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:26.160079 7596 leader_election.cc:343] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 725cb481751048c29695726011c80c08
I20260505 20:13:26.160241 7596 leader_election.cc:304] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:26.161876 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bdc29641404cee850f27e9c392fbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.165560 8053 tablet_bootstrap.cc:492] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.166169 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096ca710e3564d4b8db50f29dd56a5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.169124 8079 raft_consensus.cc:493] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.169301 8079 raft_consensus.cc:515] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:26.170050 8079 leader_election.cc:290] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.170225 8079 raft_consensus.cc:2749] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.178191 8317 tablet.cc:1724] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:26.180751 7709 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.185572 8356 tablet.cc:1724] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:26.193737 8053 tablet_bootstrap.cc:654] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.160193 8050 tablet_replica.cc:333] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.172255 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:26.194940 8050 raft_consensus.cc:2243] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.180235 8357 tablet.cc:1724] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:26.195362 8050 pending_rounds.cc:70] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:26.180620 8361 raft_consensus.cc:493] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.195447 8050 pending_rounds.cc:77] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737175664357376 op_type: NO_OP noop_request { }
I20260505 20:13:26.195592 8050 raft_consensus.cc:2889] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:26.195562 8361 raft_consensus.cc:515] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.195745 8050 raft_consensus.cc:2272] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.196281 8361 leader_election.cc:290] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.196823 8050 ts_tablet_manager.cc:1916] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.198653 8127 leader_election.cc:290] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.202847 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (DEFAULT_TABLE table=default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.203020 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7766caea43904162a2c289b7b17405d4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:26.203214 7800 raft_consensus.cc:3060] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.203362 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.205979 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c104bd9c39af48449718b0c7f327f6ec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:26.206205 7801 raft_consensus.cc:2468] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:26.207213 7800 raft_consensus.cc:2468] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:26.207540 7982 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.210239 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 (DEFAULT_TABLE table=default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.210692 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ddf95d810c4c80a5f78c1b7600cee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.210065 7869 leader_election.cc:304] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.212203 7869 leader_election.cc:304] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.212508 8361 raft_consensus.cc:2804] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.212610 8361 raft_consensus.cc:493] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.212707 8361 raft_consensus.cc:3060] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.216073 8058 tablet_bootstrap.cc:492] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.216074 8361 raft_consensus.cc:515] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.216269 8058 ts_tablet_manager.cc:1403] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.136s user 0.003s sys 0.000s
I20260505 20:13:26.217253 8361 leader_election.cc:290] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.217351 8058 raft_consensus.cc:359] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.217538 8058 raft_consensus.cc:385] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.217636 8058 raft_consensus.cc:740] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:26.217574 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 862e865d406c4d95b97b579e9fe07df0 because the tablet was not found. No further retry: Not found: Tablet not found: 862e865d406c4d95b97b579e9fe07df0
I20260505 20:13:26.217906 8058 consensus_queue.cc:260] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.218137 8361 raft_consensus.cc:2804] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.218152 8053 tablet_bootstrap.cc:492] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.218602 8058 ts_tablet_manager.cc:1434] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:26.218881 8058 tablet_bootstrap.cc:492] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.219161 8361 raft_consensus.cc:697] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:26.219502 8361 consensus_queue.cc:237] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.220355 8053 ts_tablet_manager.cc:1403] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
I20260505 20:13:26.220570 8058 tablet_bootstrap.cc:654] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.221261 8053 raft_consensus.cc:359] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.221460 8053 raft_consensus.cc:385] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.221544 8053 raft_consensus.cc:740] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.222893 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c104bd9c39af48449718b0c7f327f6ec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:26.223093 7800 raft_consensus.cc:3060] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.224829 7709 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.225872 7800 raft_consensus.cc:2468] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:26.227303 7869 leader_election.cc:304] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.227447 8053 consensus_queue.cc:260] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.227772 8127 raft_consensus.cc:2804] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.228039 8127 raft_consensus.cc:697] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:26.228344 8127 consensus_queue.cc:237] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.230877 8053 ts_tablet_manager.cc:1434] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260505 20:13:26.233368 8050 ts_tablet_manager.cc:1929] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.234337 8089 raft_consensus.cc:493] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.234494 8089 raft_consensus.cc:515] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.235118 8089 leader_election.cc:290] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.235694 8050 log.cc:1199] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:26.235626 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:26.235885 7937 raft_consensus.cc:2468] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:26.236074 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.236159 8050 ts_tablet_manager.cc:1950] T 3e77ec84858a4e46a993c579d9990f1b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:26.236657 7736 leader_election.cc:343] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.236901 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 3e77ec84858a4e46a993c579d9990f1b (table default.Table_55818053abfc4ea0a0cc4ef3f1bab479 [id=0149b0d509e947c4a1523cd8645446da]) successfully deleted
I20260505 20:13:26.237540 7737 leader_election.cc:304] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.238431 8089 raft_consensus.cc:2804] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.238534 8089 raft_consensus.cc:493] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.238654 8089 raft_consensus.cc:3060] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.239171 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_557af34712374a3e925b6b5308c0545c" } modify_external_catalogs: true
I20260505 20:13:26.239392 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_557af34712374a3e925b6b5308c0545c" } modify_external_catalogs: true
I20260505 20:13:26.241062 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_69552f9e9e534627b2cf35ce35cc8d3e" } modify_external_catalogs: true
I20260505 20:13:26.241240 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_69552f9e9e534627b2cf35ce35cc8d3e" } modify_external_catalogs: true
I20260505 20:13:26.241343 8051 ts_tablet_manager.cc:1929] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.241475 8051 log.cc:1199] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/43f656c47c5f46fe811ff64c58972e76
I20260505 20:13:26.241397 8089 raft_consensus.cc:515] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.243790 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:26.244324 7736 leader_election.cc:343] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.244665 8089 leader_election.cc:290] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.245399 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:26.245627 7937 raft_consensus.cc:3060] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:26.248071 7327 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3aad2a9f37ac4cbfa127ecceb132c8bb consensus state has no leader
I20260505 20:13:26.248490 7937 raft_consensus.cc:2468] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:26.249540 7737 leader_election.cc:304] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.250036 8089 raft_consensus.cc:2804] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.250576 8089 raft_consensus.cc:697] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:26.250918 8089 consensus_queue.cc:237] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.251101 8050 tablet_replica.cc:333] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.252019 8050 raft_consensus.cc:2243] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.253451 8050 raft_consensus.cc:2272] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.253579 8051 ts_tablet_manager.cc:1950] T 43f656c47c5f46fe811ff64c58972e76 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.254743 8050 ts_tablet_manager.cc:1916] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.255087 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1088b8bf1039442b9962d35ee73ea794"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:26.255453 8053 tablet_bootstrap.cc:492] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.255241 7338 catalog_manager.cc:5671] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:26.255681 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9b375a4bbec4527af704aa6cd08acec (table default.Table_3e927ca3870e46dfac9020afe0c894e5 [id=7e050176e69345a8ba527b6fa0d49da3]). Expected version 2 got 0
W20260505 20:13:26.255735 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1088b8bf1039442b9962d35ee73ea794 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.255964 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (table default.Table_4cd74c87bda6442d8819f619e386bd93 [id=74178f7425164618bd69a1653b75e5d1]). Expected version 5 got 0
I20260505 20:13:26.256305 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:26.259070 8051 tablet_replica.cc:333] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.262876 8053 tablet_bootstrap.cc:654] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.263126 7982 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.265875 8337 raft_consensus.cc:493] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.266036 8337 raft_consensus.cc:515] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.266726 8398 sys_catalog.cc:263] Verifying existing consensus state
I20260505 20:13:26.266820 8337 leader_election.cc:290] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.267140 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 17acb52d6cde4ced988506cee48eb040
I20260505 20:13:26.267510 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eeb04e0a574132b247d5ce6d7add44" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.267800 7661 raft_consensus.cc:2468] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:26.268270 7736 leader_election.cc:304] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:26.268390 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 2c12a95b0ed445c7b598db136f6ac05c
I20260505 20:13:26.268527 8337 raft_consensus.cc:2804] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.268641 8337 raft_consensus.cc:493] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.268725 8337 raft_consensus.cc:3060] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.269819 8051 raft_consensus.cc:2243] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.270007 8051 raft_consensus.cc:2272] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.270568 8051 ts_tablet_manager.cc:1916] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.270638 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.271450 8337 raft_consensus.cc:515] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.272462 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 876496f026c84eff8fef175387d20062
I20260505 20:13:26.272760 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eeb04e0a574132b247d5ce6d7add44" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:26.272923 7661 raft_consensus.cc:3060] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.273377 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b596f03adbea413b813c9037d4243fae
I20260505 20:13:26.273375 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.274245 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.275465 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 172cd9f38dd8491ea3ecf42b680d398f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.275614 7661 raft_consensus.cc:2468] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:26.276432 7736 leader_election.cc:304] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:26.276719 8339 raft_consensus.cc:2804] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.276846 8339 raft_consensus.cc:697] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:26.277065 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4cd74c87bda6442d8819f619e386bd93" } new_table_name: "default.Table_6668622814b7401689dd9dfecee3a8b9" modify_external_catalogs: true
I20260505 20:13:26.277098 8339 consensus_queue.cc:237] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.278602 8058 tablet_bootstrap.cc:492] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.278792 8058 ts_tablet_manager.cc:1403] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20260505 20:13:26.278831 8337 leader_election.cc:290] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.278728 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_936302b13c514b96bd4a3f61995da46d" } new_table_name: "default.Table_f7d224c9388348eb8d42b645b0813213" modify_external_catalogs: true
I20260505 20:13:26.279681 8058 raft_consensus.cc:359] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.279923 8058 raft_consensus.cc:385] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.280028 8058 raft_consensus.cc:740] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.280397 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.280324 8058 consensus_queue.cc:260] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.280907 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2abcfc3982a14ad59d71192e56a1f1d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:26.281803 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eeb04e0a574132b247d5ce6d7add44" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:26.281970 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2ce0810dc8c5449fb746e618b948f7a0" } new_table_name: "default.Table_1723474623814100ab3a108f22e1d775" modify_external_catalogs: true
I20260505 20:13:26.282027 7936 raft_consensus.cc:3060] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:26.281459 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2abcfc3982a14ad59d71192e56a1f1d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.284754 7936 raft_consensus.cc:2468] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:26.284747 8058 ts_tablet_manager.cc:1434] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:26.285238 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20eeb04e0a574132b247d5ce6d7add44" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:26.285420 7937 raft_consensus.cc:2376] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1. Re-sending same reply.
I20260505 20:13:26.288666 8058 tablet_bootstrap.cc:492] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.291994 8058 tablet_bootstrap.cc:654] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.293406 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet d2841214f07b4ae6b8cd7e97493b69d6
I20260505 20:13:26.294054 7337 catalog_manager.cc:6741] ReplaceTablet: tablet d2841214f07b4ae6b8cd7e97493b69d6 deleted and replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433
I20260505 20:13:26.294023 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.294376 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet d2676078f47c4bc19391227d9643c15f from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.295047 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_adcd07552cd942b8a23b82a71361e1de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.295595 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adcd07552cd942b8a23b82a71361e1de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.297454 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 with delete_type TABLET_DATA_DELETED (replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:26.298454 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 876496f026c84eff8fef175387d20062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 876496f026c84eff8fef175387d20062 already in progress: creating tablet
I20260505 20:13:26.299340 8398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Bootstrap starting.
I20260505 20:13:26.299829 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 (DEFAULT_TABLE table=default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.300349 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ddf95d810c4c80a5f78c1b7600cee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.301077 8050 ts_tablet_manager.cc:1929] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.301895 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 with delete_type TABLET_DATA_DELETED (replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:26.302624 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet d2841214f07b4ae6b8cd7e97493b69d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2841214f07b4ae6b8cd7e97493b69d6 already in progress: creating tablet
I20260505 20:13:26.304116 8051 ts_tablet_manager.cc:1929] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.304273 8051 log.cc:1199] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/245c8328c49347bf8b15d58cb5380fe0
I20260505 20:13:26.304617 8051 ts_tablet_manager.cc:1950] T 245c8328c49347bf8b15d58cb5380fe0 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.305503 8051 tablet_replica.cc:333] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.308791 8050 log.cc:1199] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/99ab400210c54e99bc396674f7ba8235
I20260505 20:13:26.311259 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (DEFAULT_TABLE table=default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.311554 8050 ts_tablet_manager.cc:1950] T 99ab400210c54e99bc396674f7ba8235 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:26.292567 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 132538us
I20260505 20:13:26.312855 8051 raft_consensus.cc:2243] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.313198 8051 raft_consensus.cc:2272] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.313532 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9b375a4bbec4527af704aa6cd08acec" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:26.311825 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.313818 7800 raft_consensus.cc:2393] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:26.313944 8051 ts_tablet_manager.cc:1916] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.314322 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7766caea43904162a2c289b7b17405d4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:26.314913 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c104bd9c39af48449718b0c7f327f6ec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.315393 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c104bd9c39af48449718b0c7f327f6ec" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:26.316260 7643 tablet_service.cc:1511] Processing CreateTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 (DEFAULT_TABLE table=default.Table_c7cd453210984ec7989f00858cf2aba5 [id=349bbf04fd494d7fb5fea9acc0a11d64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.316713 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ce3efe875a43d9b30d40623bf8a385. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:26.317212 7870 leader_election.cc:343] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.317888 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 43f656c47c5f46fe811ff64c58972e76 (table default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]) successfully deleted
I20260505 20:13:26.318065 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 (DEFAULT_TABLE table=default.Table_cfd1ed72bf61489999a9ce28da492f92 [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.318126 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 245c8328c49347bf8b15d58cb5380fe0 (table default.Table_76b9386a48e94edcabaf5284ccf85588 [id=8c02c85d53eb4657a278fdc32a92d258]) successfully deleted
I20260505 20:13:26.318450 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096ca710e3564d4b8db50f29dd56a5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.318754 8058 tablet_bootstrap.cc:492] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.318845 7596 leader_election.cc:304] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:26.318933 8058 ts_tablet_manager.cc:1403] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.002s
I20260505 20:13:26.319515 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 880cbba188144dd795873186f8cda1e9 (DEFAULT_TABLE table=default.Table_4357617bff6a440898a3f318565ad4ea [id=f767d2b232d84c08b169b41a1c443199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.319892 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880cbba188144dd795873186f8cda1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.319833 8058 raft_consensus.cc:359] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.320027 8058 raft_consensus.cc:385] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.320132 8058 raft_consensus.cc:740] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.305928 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.321656 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.321763 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 99ab400210c54e99bc396674f7ba8235 (table default.Table_aef313ad65fe4481a016b5b6f222270a [id=c00635909bca435eaf43a1e25358fb88]) successfully deleted
I20260505 20:13:26.322193 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 20bdc29641404cee850f27e9c392fbc0 (DEFAULT_TABLE table=default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.322544 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bdc29641404cee850f27e9c392fbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.323448 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.323751 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.325073 8058 consensus_queue.cc:260] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.325387 8079 raft_consensus.cc:3060] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.325626 8058 ts_tablet_manager.cc:1434] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:26.326057 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 8e650b297603425184ad97ddf99ec36d (DEFAULT_TABLE table=default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.326393 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e650b297603425184ad97ddf99ec36d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:26.327169 7870 leader_election.cc:343] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:26.327631 7870 leader_election.cc:343] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.330156 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (DEFAULT_TABLE table=default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.330500 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.332437 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet ee3543a2f89f43a8ab938e3585953953 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.333212 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6071ca6b55a24946bfa133a951d84705"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.333863 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6071ca6b55a24946bfa133a951d84705 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.333891 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.334146 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.334378 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.334586 7640 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.334787 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 with delete_type TABLET_DATA_DELETED (replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.335722 7339 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet b9b375a4bbec4527af704aa6cd08acec (table default.Table_3e927ca3870e46dfac9020afe0c894e5 [id=7e050176e69345a8ba527b6fa0d49da3]). Expected version 2 got 0
I20260505 20:13:26.336338 8051 ts_tablet_manager.cc:1929] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.336453 8051 log.cc:1199] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:26.336606 8058 tablet_bootstrap.cc:492] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.336851 8051 ts_tablet_manager.cc:1950] T 3e77ec84858a4e46a993c579d9990f1b P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.337165 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:26.338002 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:26.338490 8058 tablet_bootstrap.cc:654] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.339228 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 8e190c973c984ec080178efa39b2def0 (DEFAULT_TABLE table=default.Table_c96f5f09a5b74277ac2f72a83729e57a [id=d52c9e2e31b34773959865aaa6f1833a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.339654 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e190c973c984ec080178efa39b2def0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.342262 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 (DEFAULT_TABLE table=default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.342630 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ddf95d810c4c80a5f78c1b7600cee4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:26.347237 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 2c12a95b0ed445c7b598db136f6ac05c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c12a95b0ed445c7b598db136f6ac05c already in progress: creating tablet
W20260505 20:13:26.347532 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 876496f026c84eff8fef175387d20062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 876496f026c84eff8fef175387d20062 already in progress: creating tablet
W20260505 20:13:26.347740 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b596f03adbea413b813c9037d4243fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b596f03adbea413b813c9037d4243fae already in progress: creating tablet
W20260505 20:13:26.347920 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet d2841214f07b4ae6b8cd7e97493b69d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2841214f07b4ae6b8cd7e97493b69d6 already in progress: creating tablet
W20260505 20:13:26.348093 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 17acb52d6cde4ced988506cee48eb040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17acb52d6cde4ced988506cee48eb040 already in progress: creating tablet
W20260505 20:13:26.348935 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 2c12a95b0ed445c7b598db136f6ac05c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c12a95b0ed445c7b598db136f6ac05c already in progress: creating tablet
W20260505 20:13:26.349149 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 17acb52d6cde4ced988506cee48eb040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17acb52d6cde4ced988506cee48eb040 already in progress: creating tablet
W20260505 20:13:26.349330 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet b596f03adbea413b813c9037d4243fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b596f03adbea413b813c9037d4243fae already in progress: creating tablet
I20260505 20:13:26.351444 8398 log.cc:826] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:26.352851 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.353253 8050 tablet_replica.cc:333] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.353578 8050 raft_consensus.cc:2243] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.353881 8050 raft_consensus.cc:2272] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.355283 8050 ts_tablet_manager.cc:1916] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.355381 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6560bac418ea4f8aad5c9a8257e5b261"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.356185 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6560bac418ea4f8aad5c9a8257e5b261 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:26.357841 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.362610 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.362988 8052 tablet_replica.cc:333] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:26.363231 8052 raft_consensus.cc:2243] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.363629 8052 raft_consensus.cc:2272] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.364789 8052 ts_tablet_manager.cc:1916] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.367787 8051 tablet_replica.cc:333] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.368010 8051 raft_consensus.cc:2243] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.368193 8051 raft_consensus.cc:2272] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.368764 8051 ts_tablet_manager.cc:1916] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.370065 8079 raft_consensus.cc:2749] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.373027 8052 ts_tablet_manager.cc:1929] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:26.373718 8052 log.cc:1199] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:26.374392 8052 ts_tablet_manager.cc:1950] T f41cf3b6cf3a4ef6b7c077f78b793283 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:26.375590 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]) successfully deleted
I20260505 20:13:26.376740 8089 raft_consensus.cc:493] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.376914 8089 raft_consensus.cc:515] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.377672 8089 leader_election.cc:290] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.379012 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cba502b064583a50fb85ba7dea1b5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:26.379261 7937 raft_consensus.cc:2468] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:26.379920 7737 leader_election.cc:304] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.380293 8089 raft_consensus.cc:2804] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.380409 8089 raft_consensus.cc:493] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.380494 8089 raft_consensus.cc:3060] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.381676 8053 tablet_bootstrap.cc:492] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.381855 8053 ts_tablet_manager.cc:1403] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.126s user 0.004s sys 0.000s
I20260505 20:13:26.382614 8053 raft_consensus.cc:359] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.382799 8053 raft_consensus.cc:385] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.382884 8053 raft_consensus.cc:740] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.383175 8053 consensus_queue.cc:260] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.383800 8089 raft_consensus.cc:515] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.384967 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cba502b064583a50fb85ba7dea1b5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:26.385663 7736 leader_election.cc:343] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.386330 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cba502b064583a50fb85ba7dea1b5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:26.386566 7937 raft_consensus.cc:3060] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.389891 8089 leader_election.cc:290] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.390339 7937 raft_consensus.cc:2468] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:26.390982 7737 leader_election.cc:304] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.391402 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95cba502b064583a50fb85ba7dea1b5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:26.391963 7736 leader_election.cc:343] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.392433 7847 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.401242 8051 ts_tablet_manager.cc:1929] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.401414 8051 log.cc:1199] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/00dbde45980c4f2b8d6bee05416fa2c6
I20260505 20:13:26.401846 8051 ts_tablet_manager.cc:1950] T 00dbde45980c4f2b8d6bee05416fa2c6 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.404178 8058 tablet_bootstrap.cc:492] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.405635 8058 ts_tablet_manager.cc:1403] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.017s
I20260505 20:13:26.406965 8058 raft_consensus.cc:359] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.408906 8050 ts_tablet_manager.cc:1929] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:26.409089 8050 log.cc:1199] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:26.409332 8058 raft_consensus.cc:385] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.409559 8050 ts_tablet_manager.cc:1950] T f41cf3b6cf3a4ef6b7c077f78b793283 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.409973 8058 raft_consensus.cc:740] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.410575 7847 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.411532 8089 raft_consensus.cc:2804] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.411767 8089 raft_consensus.cc:697] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:26.412050 8089 consensus_queue.cc:237] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.412766 8058 consensus_queue.cc:260] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.413683 8053 ts_tablet_manager.cc:1434] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260505 20:13:26.414032 8053 tablet_bootstrap.cc:492] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.415870 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.416123 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f05cad2989475fa0305e98f562037b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.416329 8054 tablet_bootstrap.cc:492] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.416355 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 3e77ec84858a4e46a993c579d9990f1b (table default.Table_55818053abfc4ea0a0cc4ef3f1bab479 [id=0149b0d509e947c4a1523cd8645446da]) successfully deleted
I20260505 20:13:26.416249 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 725cb481751048c29695726011c80c08 with delete_type TABLET_DATA_DELETED (replaced by tablet 944aad58d3c14577a0c66edd95fdf5e0) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.416477 8054 ts_tablet_manager.cc:1403] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.374s user 0.033s sys 0.025s
W20260505 20:13:26.416654 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f32d3ec040604ce7b384c4b6a202707f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32d3ec040604ce7b384c4b6a202707f already in progress: creating tablet
I20260505 20:13:26.417281 8054 raft_consensus.cc:359] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.417467 8054 raft_consensus.cc:385] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.417568 8054 raft_consensus.cc:740] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.417824 8054 consensus_queue.cc:260] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.418404 8053 tablet_bootstrap.cc:654] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.421196 8058 ts_tablet_manager.cc:1434] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260505 20:13:26.423169 8051 tablet_replica.cc:333] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.423367 8051 raft_consensus.cc:2243] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.423576 8051 raft_consensus.cc:2272] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:26.423983 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e8d5190032443d4bf6fdb83a34fabd8 consensus state has no leader
I20260505 20:13:26.424008 8058 tablet_bootstrap.cc:492] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.425954 8058 tablet_bootstrap.cc:654] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:26.426832 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50680deff6fe4dcabbf5a3aeb47ac01e consensus state has no leader
I20260505 20:13:26.427510 8054 ts_tablet_manager.cc:1434] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260505 20:13:26.427860 8054 tablet_bootstrap.cc:492] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.429243 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d5ccdf283f4a497ba3f7f316f7b786ae" } new_table_name: "default.Table_c3df4da03c5b4917b507a2945a453705" modify_external_catalogs: true
I20260505 20:13:26.430078 8053 tablet_bootstrap.cc:492] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.430240 8053 ts_tablet_manager.cc:1403] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260505 20:13:26.431023 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4bd6d8fe45184075935e942894062d87" } new_table_name: "default.Table_73a05203cc244d53b4fdb4628f087d00" modify_external_catalogs: true
I20260505 20:13:26.431077 8053 raft_consensus.cc:359] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.431272 8053 raft_consensus.cc:385] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.431347 8053 raft_consensus.cc:740] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.434295 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d3f51622819c4146803605c7494da89e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.435141 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3f51622819c4146803605c7494da89e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.435863 8054 tablet_bootstrap.cc:654] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.441089 8053 consensus_queue.cc:260] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.442317 8051 ts_tablet_manager.cc:1916] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.446033 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 13a4ddebda9447389c15be61aa60baaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.446465 8053 ts_tablet_manager.cc:1434] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260505 20:13:26.448143 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.448611 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet a9719876757e409b991b21410983e3bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:22 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.451382 8398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=13 ignored=0} inserts{seen=21 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260505 20:13:26.451992 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 00dbde45980c4f2b8d6bee05416fa2c6 (table default.Table_a1437fdc2e924e39b8a96205ee5adc40 [id=dc99b341dea243b9aa707fb2ba807db9]) successfully deleted
I20260505 20:13:26.452180 8398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: Bootstrap complete.
W20260505 20:13:26.452502 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 already in progress: creating tablet
I20260505 20:13:26.453115 8053 tablet_bootstrap.cc:492] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:26.453141 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e98c0e648c98488e8c5509b296824bea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e98c0e648c98488e8c5509b296824bea already in progress: creating tablet
W20260505 20:13:26.453472 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e80a1674d26c42e5a4884da99ab7918c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e80a1674d26c42e5a4884da99ab7918c already in progress: creating tablet
W20260505 20:13:26.453814 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 1e453fdf9a424fe8974076fac3ad74bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e453fdf9a424fe8974076fac3ad74bf already in progress: creating tablet
W20260505 20:13:26.454108 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b91ccd9761ee4386b9e80cb9c9cfa975 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91ccd9761ee4386b9e80cb9c9cfa975 already in progress: creating tablet
W20260505 20:13:26.454372 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e083f131eca54d98852e5685e08ef46b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e083f131eca54d98852e5685e08ef46b already in progress: creating tablet
W20260505 20:13:26.454679 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 79ce82aca20d44819f28785322e935ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79ce82aca20d44819f28785322e935ae already in progress: creating tablet
I20260505 20:13:26.454835 8053 tablet_bootstrap.cc:654] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:26.455031 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 17acb52d6cde4ced988506cee48eb040 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17acb52d6cde4ced988506cee48eb040 already in progress: creating tablet
W20260505 20:13:26.455293 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 2c12a95b0ed445c7b598db136f6ac05c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c12a95b0ed445c7b598db136f6ac05c already in progress: creating tablet
W20260505 20:13:26.455617 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 876496f026c84eff8fef175387d20062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 876496f026c84eff8fef175387d20062 already in progress: creating tablet
W20260505 20:13:26.455888 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b596f03adbea413b813c9037d4243fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b596f03adbea413b813c9037d4243fae already in progress: creating tablet
W20260505 20:13:26.456197 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet d2841214f07b4ae6b8cd7e97493b69d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2841214f07b4ae6b8cd7e97493b69d6 already in progress: creating tablet
I20260505 20:13:26.459123 8054 tablet_bootstrap.cc:492] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.459318 8054 ts_tablet_manager.cc:1403] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.004s
I20260505 20:13:26.460091 8054 raft_consensus.cc:359] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.460284 8054 raft_consensus.cc:385] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.460353 8054 raft_consensus.cc:740] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.461867 8054 consensus_queue.cc:260] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.462980 8054 ts_tablet_manager.cc:1434] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:26.465907 8054 tablet_bootstrap.cc:492] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.468708 8051 ts_tablet_manager.cc:1929] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:26.468847 8051 log.cc:1199] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:26.469254 8051 ts_tablet_manager.cc:1950] T f41cf3b6cf3a4ef6b7c077f78b793283 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.469704 8053 tablet_bootstrap.cc:492] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.469904 8053 ts_tablet_manager.cc:1403] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20260505 20:13:26.471390 8053 raft_consensus.cc:359] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.471606 8053 raft_consensus.cc:385] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.471701 8053 raft_consensus.cc:740] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.471976 8053 consensus_queue.cc:260] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.472515 8053 ts_tablet_manager.cc:1434] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:26.472914 8053 tablet_bootstrap.cc:492] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.474783 8053 tablet_bootstrap.cc:654] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.476004 8051 tablet_replica.cc:333] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.476755 8051 raft_consensus.cc:2243] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.476982 8051 raft_consensus.cc:2272] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.477569 8051 ts_tablet_manager.cc:1916] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.479930 8054 tablet_bootstrap.cc:654] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.489163 8398 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:26.506018 8089 raft_consensus.cc:493] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.506206 8089 raft_consensus.cc:515] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.506891 8089 leader_election.cc:290] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.507141 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]) successfully deleted
I20260505 20:13:26.508095 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8d5190032443d4bf6fdb83a34fabd8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.508322 7661 raft_consensus.cc:2468] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:26.509022 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f41cf3b6cf3a4ef6b7c077f78b793283 (table default.Table_cc9499abee5f46aa9bc36f8f562decc2 [id=ad94f05ab4f94cd38ff43d0603cf8d8f]) successfully deleted
I20260505 20:13:26.510264 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8d5190032443d4bf6fdb83a34fabd8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:26.510504 7937 raft_consensus.cc:2468] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:26.511031 7736 leader_election.cc:304] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:26.511399 8339 raft_consensus.cc:2804] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.511503 8339 raft_consensus.cc:493] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.511576 8339 raft_consensus.cc:3060] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.514452 7334 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8] alter complete (version 1)
I20260505 20:13:26.514933 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_51597b5bf7d34471a1f178b73c3fd20d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:26.515568 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d7d6dfb1719442dab808da26e3a7e10d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.515578 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51597b5bf7d34471a1f178b73c3fd20d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:26.516168 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7d6dfb1719442dab808da26e3a7e10d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.517973 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6da35009030241e0a1be14d63f55bcd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:26.518352 8051 ts_tablet_manager.cc:1929] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.518330 8339 raft_consensus.cc:515] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.518508 8051 log.cc:1199] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b4f05cad2989475fa0305e98f562037b
W20260505 20:13:26.518594 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6da35009030241e0a1be14d63f55bcd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.518883 8051 ts_tablet_manager.cc:1950] T b4f05cad2989475fa0305e98f562037b P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.519804 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8d5190032443d4bf6fdb83a34fabd8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:26.520047 7662 raft_consensus.cc:3060] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.522840 7662 raft_consensus.cc:2468] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:26.523478 7736 leader_election.cc:304] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:26.523810 8089 raft_consensus.cc:2804] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.523947 8089 raft_consensus.cc:697] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:26.524220 8089 consensus_queue.cc:237] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.534015 8127 raft_consensus.cc:493] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.534260 8127 raft_consensus.cc:515] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.535061 8051 tablet_replica.cc:333] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.535195 8127 leader_election.cc:290] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.536247 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3543a2f89f43a8ab938e3585953953" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:26.536504 7800 raft_consensus.cc:2468] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:26.537073 7869 leader_election.cc:304] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.537551 8127 raft_consensus.cc:2804] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.537664 8127 raft_consensus.cc:493] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.537775 8127 raft_consensus.cc:3060] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.539204 8051 raft_consensus.cc:2243] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.539469 8051 raft_consensus.cc:2272] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.540112 8051 ts_tablet_manager.cc:1916] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.540886 8127 raft_consensus.cc:515] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.542652 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3543a2f89f43a8ab938e3585953953" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:26.542873 7800 raft_consensus.cc:3060] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.546039 8339 leader_election.cc:290] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.546737 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8d5190032443d4bf6fdb83a34fabd8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:26.547031 7937 raft_consensus.cc:3060] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.551331 7800 raft_consensus.cc:2468] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:26.552304 7937 raft_consensus.cc:2468] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:26.552970 7869 leader_election.cc:304] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.553319 8361 raft_consensus.cc:2804] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.553437 8361 raft_consensus.cc:697] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:26.553730 8361 consensus_queue.cc:237] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.554811 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b4f05cad2989475fa0305e98f562037b (table default.Table_264d0b6fcd884b629f0fb38091195668 [id=f93e310a8d8049bfbeabf22d7fced243]) successfully deleted
I20260505 20:13:26.556953 8127 leader_election.cc:290] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.562291 8053 tablet_bootstrap.cc:492] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.562273 8398 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29603775b6d74153b21e0bbcc535ff98, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.562481 8053 ts_tablet_manager.cc:1403] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.090s user 0.010s sys 0.014s
I20260505 20:13:26.563234 8058 tablet_bootstrap.cc:492] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.563153 8398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:26.563400 8058 ts_tablet_manager.cc:1403] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.140s user 0.011s sys 0.019s
I20260505 20:13:26.564333 8058 raft_consensus.cc:359] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.564546 8058 raft_consensus.cc:385] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.564657 8058 raft_consensus.cc:740] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:26.565440 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01e800dfb0354beab9c835cbed9dceb4 consensus state has no leader
I20260505 20:13:26.565546 8053 raft_consensus.cc:359] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.565780 8053 raft_consensus.cc:385] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.565864 8053 raft_consensus.cc:740] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.565886 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_61d9b0e280f5450ea9007d9a0d283072" } modify_external_catalogs: true
I20260505 20:13:26.566074 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_61d9b0e280f5450ea9007d9a0d283072" } modify_external_catalogs: true
I20260505 20:13:26.566144 8053 consensus_queue.cc:260] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.566481 8058 consensus_queue.cc:260] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:26.566691 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0d4e198c91c4a0e99d8b798a1dd3433 has no consensus state
I20260505 20:13:26.567045 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1ed5779651c64985885b1277795cd799" } modify_external_catalogs: true
I20260505 20:13:26.567154 8053 ts_tablet_manager.cc:1434] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:26.567193 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1ed5779651c64985885b1277795cd799" } modify_external_catalogs: true
I20260505 20:13:26.567512 8053 tablet_bootstrap.cc:492] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.567946 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_813570fe84494402989524e1939f8ae7" } modify_external_catalogs: true
I20260505 20:13:26.568117 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_813570fe84494402989524e1939f8ae7" } modify_external_catalogs: true
I20260505 20:13:26.571842 7341 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (table default.Table_6668622814b7401689dd9dfecee3a8b9 [id=74178f7425164618bd69a1653b75e5d1]). Expected version 6 got 0
I20260505 20:13:26.572003 8058 ts_tablet_manager.cc:1434] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260505 20:13:26.572321 8058 tablet_bootstrap.cc:492] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:26.573921 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0b1e6d72c57e42f09432a30295c47f1f consensus state has no leader
I20260505 20:13:26.574244 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_54ae8ffe8e9a482daae20d9283315d37" } modify_external_catalogs: true
I20260505 20:13:26.574404 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_54ae8ffe8e9a482daae20d9283315d37" } modify_external_catalogs: true
I20260505 20:13:26.576437 8054 tablet_bootstrap.cc:492] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.576614 8054 ts_tablet_manager.cc:1403] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.019s
I20260505 20:13:26.577490 8054 raft_consensus.cc:359] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.577694 8054 raft_consensus.cc:385] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.577811 8054 raft_consensus.cc:740] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.578090 8054 consensus_queue.cc:260] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.578790 8054 ts_tablet_manager.cc:1434] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:26.579085 8054 tablet_bootstrap.cc:492] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.579339 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_5b66f4e343e14116ab2dc0b7ebce74c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:26.579994 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b66f4e343e14116ab2dc0b7ebce74c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:26.581037 8053 tablet_bootstrap.cc:654] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.583031 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.583371 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.583501 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.583847 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.584031 8058 tablet_bootstrap.cc:654] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.584051 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 24fc8fb89d614388969b5eff86ba31ca with delete_type TABLET_DATA_DELETED (replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.584226 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.584399 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e77ec84858a4e46a993c579d9990f1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.585474 8054 tablet_bootstrap.cc:654] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.586117 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.586259 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 24fc8fb89d614388969b5eff86ba31ca with delete_type TABLET_DATA_DELETED (replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.586088 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.586553 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.586802 8052 tablet_replica.cc:333] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:26.586839 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 00dbde45980c4f2b8d6bee05416fa2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.586993 8052 raft_consensus.cc:2243] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.587049 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.587276 8052 pending_rounds.cc:70] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:26.587352 8052 pending_rounds.cc:77] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737176418304000 op_type: NO_OP noop_request { }
I20260505 20:13:26.587531 8052 raft_consensus.cc:2889] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:26.587642 8052 raft_consensus.cc:2272] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.588424 8052 ts_tablet_manager.cc:1916] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:26.591781 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f41cf3b6cf3a4ef6b7c077f78b793283 because the tablet was not found. No further retry: Not found: Tablet not found: f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:26.593557 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7e6c02c635da4beeac8892d580b67a93" } modify_external_catalogs: true
I20260505 20:13:26.593801 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7e6c02c635da4beeac8892d580b67a93" } modify_external_catalogs: true
I20260505 20:13:26.595930 8053 tablet_bootstrap.cc:492] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.596079 8053 ts_tablet_manager.cc:1403] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.003s
I20260505 20:13:26.596858 8053 raft_consensus.cc:359] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.597019 8053 raft_consensus.cc:385] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.597105 8053 raft_consensus.cc:740] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.597281 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3543a2f89f43a8ab938e3585953953" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.597796 7662 raft_consensus.cc:2468] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:26.598269 8058 tablet_bootstrap.cc:492] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.598414 8058 ts_tablet_manager.cc:1403] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.005s
I20260505 20:13:26.599289 8127 raft_consensus.cc:493] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.599447 8127 raft_consensus.cc:515] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.599761 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 65003660c44547cc8674baeca370e395 (DEFAULT_TABLE table=default.Table_c49a496156544e27a5039eab18590a91 [id=497ef8628c1c4dc8b2992736e49a2e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.600140 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65003660c44547cc8674baeca370e395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.600214 8127 leader_election.cc:290] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.599161 8058 raft_consensus.cc:359] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.600734 8058 raft_consensus.cc:385] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.600803 8058 raft_consensus.cc:740] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.600841 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0d6b6035154e01850e7a158ad22dfa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:26.601058 7800 raft_consensus.cc:2468] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:26.601016 8058 consensus_queue.cc:260] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.601363 8053 consensus_queue.cc:260] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.601506 7869 leader_election.cc:304] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.601612 8339 raft_consensus.cc:493] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.601775 8127 raft_consensus.cc:2804] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.601761 8339 raft_consensus.cc:515] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.601872 8127 raft_consensus.cc:493] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.601941 8127 raft_consensus.cc:3060] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.602545 8339 leader_election.cc:290] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.603094 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:26.603590 7736 leader_election.cc:343] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.604203 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:26.604326 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 65003660c44547cc8674baeca370e395 (DEFAULT_TABLE table=default.Table_c49a496156544e27a5039eab18590a91 [id=497ef8628c1c4dc8b2992736e49a2e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.604729 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65003660c44547cc8674baeca370e395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.604661 8127 raft_consensus.cc:515] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:26.604728 7737 leader_election.cc:343] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.604851 7737 leader_election.cc:304] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.605203 8339 raft_consensus.cc:2749] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.605854 8053 ts_tablet_manager.cc:1434] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260505 20:13:26.605862 8127 leader_election.cc:290] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.606133 8053 tablet_bootstrap.cc:492] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.606518 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0d6b6035154e01850e7a158ad22dfa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:26.606773 7800 raft_consensus.cc:3060] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.607923 8053 tablet_bootstrap.cc:654] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.610596 8058 ts_tablet_manager.cc:1434] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260505 20:13:26.610826 7800 raft_consensus.cc:2468] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:26.611310 7869 leader_election.cc:304] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:26.611582 8127 raft_consensus.cc:2804] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:26.611742 8054 tablet_bootstrap.cc:492] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.611797 8127 raft_consensus.cc:697] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:26.611917 8054 ts_tablet_manager.cc:1403] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260505 20:13:26.612058 8127 consensus_queue.cc:237] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.612684 8054 raft_consensus.cc:359] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.612890 8054 raft_consensus.cc:385] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.612970 8054 raft_consensus.cc:740] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.613131 7338 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:26.613221 8054 consensus_queue.cc:260] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.613761 8054 ts_tablet_manager.cc:1434] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:26.614073 8054 tablet_bootstrap.cc:492] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.615754 8054 tablet_bootstrap.cc:654] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.616360 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.617139 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cbb29bc765d476cb4634178f2806c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:26.619082 8058 tablet_bootstrap.cc:492] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.620555 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1505e592e543cca92d8949bdae007e (DEFAULT_TABLE table=default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.620729 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1505e592e543cca92d8949bdae007e (DEFAULT_TABLE table=default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.620951 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1505e592e543cca92d8949bdae007e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.621052 8058 tablet_bootstrap.cc:654] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.621095 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1505e592e543cca92d8949bdae007e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.626183 8348 consensus_queue.cc:1048] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:26.628679 8348 raft_consensus.cc:493] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.628816 8348 raft_consensus.cc:515] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.629403 8348 leader_election.cc:290] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:26.631235 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32d3ec040604ce7b384c4b6a202707f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:26.631798 7869 leader_election.cc:343] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.634692 8054 tablet_bootstrap.cc:492] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.634840 8054 ts_tablet_manager.cc:1403] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.002s
I20260505 20:13:26.635674 8054 raft_consensus.cc:359] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.635876 8054 raft_consensus.cc:385] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.635972 8054 raft_consensus.cc:740] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.636504 8054 consensus_queue.cc:260] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.637663 8058 tablet_bootstrap.cc:492] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.637844 8058 ts_tablet_manager.cc:1403] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.004s
I20260505 20:13:26.638059 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3543a2f89f43a8ab938e3585953953" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:26.638298 7662 raft_consensus.cc:3060] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.638581 7338 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 74a5d442f25242ea8371fca8643f4ce6 (table default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8]). Expected version 1 got 0
I20260505 20:13:26.638707 8058 raft_consensus.cc:359] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.638903 8058 raft_consensus.cc:385] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.639025 8058 raft_consensus.cc:740] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.639282 8058 consensus_queue.cc:260] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.641192 8058 ts_tablet_manager.cc:1434] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:26.641512 8058 tablet_bootstrap.cc:492] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.642086 7662 raft_consensus.cc:2468] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:26.643359 8058 tablet_bootstrap.cc:654] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.645043 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 (DEFAULT_TABLE table=default.Table_453aeb092a0040998c34044a79fbecfc [id=79032ad4a3c549559bc0ec51b54172d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.645545 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608bffbbc10141e8bd19f475b95bdc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.646116 8054 ts_tablet_manager.cc:1434] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s
I20260505 20:13:26.646415 8054 tablet_bootstrap.cc:492] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.647640 8050 tablet_replica.cc:333] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.647912 8050 raft_consensus.cc:2243] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.648147 8050 raft_consensus.cc:2272] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.648216 8054 tablet_bootstrap.cc:654] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.648795 8050 ts_tablet_manager.cc:1916] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.649956 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ab400210c54e99bc396674f7ba8235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:26.651926 7914 tablet_service.cc:1511] Processing CreateTablet for tablet d411638715f747469f9f3dc490c0257c (DEFAULT_TABLE table=default.Table_53010b8cbf5e426590b4f82d68e96660 [id=3505dd62d0f747cb93b233259fadc6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.652297 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d411638715f747469f9f3dc490c0257c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.652369 8058 tablet_bootstrap.cc:492] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.652516 8058 ts_tablet_manager.cc:1403] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260505 20:13:26.653340 8058 raft_consensus.cc:359] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.653415 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0d6b6035154e01850e7a158ad22dfa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.653551 8058 raft_consensus.cc:385] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.653642 8058 raft_consensus.cc:740] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.654150 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 (DEFAULT_TABLE table=default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:26.654510 7327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.253:39345, user_credentials={real_user=slave}} blocked reactor thread for 92473.4us
I20260505 20:13:26.657301 8058 consensus_queue.cc:260] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.661249 8058 ts_tablet_manager.cc:1434] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260505 20:13:26.661589 8058 tablet_bootstrap.cc:492] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.661703 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 (DEFAULT_TABLE table=default.Table_72dc9ef65e1442a8ac2e33e7ca75b20d [id=5248510b86d2424eb2167fd9a12ec41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.662304 8053 tablet_bootstrap.cc:492] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.662493 8053 ts_tablet_manager.cc:1403] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.003s
I20260505 20:13:26.663288 8053 raft_consensus.cc:359] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.663504 8053 raft_consensus.cc:385] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.663578 8053 raft_consensus.cc:740] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.663831 8053 consensus_queue.cc:260] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.664324 8053 ts_tablet_manager.cc:1434] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:26.664451 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 (DEFAULT_TABLE table=default.Table_453aeb092a0040998c34044a79fbecfc [id=79032ad4a3c549559bc0ec51b54172d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.664649 8053 tablet_bootstrap.cc:492] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.664847 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608bffbbc10141e8bd19f475b95bdc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.666667 8053 tablet_bootstrap.cc:654] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.666837 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b0d6b6035154e01850e7a158ad22dfa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:26.667419 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32d3ec040604ce7b384c4b6a202707f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.668247 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 20eeb04e0a574132b247d5ce6d7add44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.669417 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 24fc8fb89d614388969b5eff86ba31ca with delete_type TABLET_DATA_DELETED (replaced by tablet 0b1e6d72c57e42f09432a30295c47f1f) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.669790 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 6bebda2a5c5a4c43a244504837cf0923 (DEFAULT_TABLE table=default.Table_f181142ec34d41af89373e942d282285 [id=e5e18bb6866143cd80c5bd1282d890cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.669885 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 506b421a774c4929813205dba0fac32b (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.669885 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 (DEFAULT_TABLE table=default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.670282 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.670853 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bebda2a5c5a4c43a244504837cf0923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.671028 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 089517a7c2214dce9367b21beb555733 (DEFAULT_TABLE table=default.Table_bba6c3da778b48e99f89f01110a160da [id=7fd3bc8f4d484299a9a21b95ada7e77f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.671114 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168d9a40a69d4beab8e79a97e7723e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.671411 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089517a7c2214dce9367b21beb555733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.671624 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.671868 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506b421a774c4929813205dba0fac32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.672650 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 (DEFAULT_TABLE table=default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.673478 7764 tablet_service.cc:1511] Processing CreateTablet for tablet d411638715f747469f9f3dc490c0257c (DEFAULT_TABLE table=default.Table_53010b8cbf5e426590b4f82d68e96660 [id=3505dd62d0f747cb93b233259fadc6ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.673934 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.681555 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.681915 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d411638715f747469f9f3dc490c0257c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.682904 7709 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:26.685017 8079 raft_consensus.cc:493] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.685187 8079 raft_consensus.cc:515] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.685866 8079 leader_election.cc:290] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:26.686873 7598 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:26.690958 8058 tablet_bootstrap.cc:654] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.697616 8053 tablet_bootstrap.cc:492] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.697814 8053 ts_tablet_manager.cc:1403] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.007s
I20260505 20:13:26.698673 8053 raft_consensus.cc:359] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.698869 8053 raft_consensus.cc:385] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.699474 8052 ts_tablet_manager.cc:1929] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.699685 8052 log.cc:1199] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/24fc8fb89d614388969b5eff86ba31ca
I20260505 20:13:26.700304 8052 ts_tablet_manager.cc:1950] T 24fc8fb89d614388969b5eff86ba31ca P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:26.700955 8052 tablet_replica.cc:333] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:26.701205 8052 raft_consensus.cc:2243] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.701504 8052 pending_rounds.cc:70] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:26.701622 8052 pending_rounds.cc:77] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737178268483584 op_type: NO_OP noop_request { }
I20260505 20:13:26.701906 8052 raft_consensus.cc:2889] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:26.702265 8052 raft_consensus.cc:2272] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.702984 8051 ts_tablet_manager.cc:1929] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.703325 8052 ts_tablet_manager.cc:1916] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.686591 8050 ts_tablet_manager.cc:1929] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.703606 8050 log.cc:1199] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:26.692598 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 579bd562fea64fe69db2b4a6085b7bed (DEFAULT_TABLE table=default.Table_e39a201cd67e459489cc0ee580f8a165 [id=d29890b44f684d74b435fd28c0f5d28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.693225 7900 tablet_service.cc:1511] Processing CreateTablet for tablet f29fd054d41e4c48ab0da8dec2b952d5 (DEFAULT_TABLE table=default.Table_a73fbe5892774352b079b4b0ce80d9c3 [id=2caf3e7ce2e84c259297c6e06ddf26a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.704174 8051 log.cc:1199] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/725cb481751048c29695726011c80c08
I20260505 20:13:26.704042 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bd562fea64fe69db2b4a6085b7bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.704675 8051 ts_tablet_manager.cc:1950] T 725cb481751048c29695726011c80c08 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.705353 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 65003660c44547cc8674baeca370e395 (DEFAULT_TABLE table=default.Table_c49a496156544e27a5039eab18590a91 [id=497ef8628c1c4dc8b2992736e49a2e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.705688 8051 tablet_replica.cc:333] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.705771 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65003660c44547cc8674baeca370e395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.705904 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29fd054d41e4c48ab0da8dec2b952d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.705938 8051 raft_consensus.cc:2243] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.706102 8051 raft_consensus.cc:2272] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.706688 8051 ts_tablet_manager.cc:1916] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.710950 8058 tablet_bootstrap.cc:492] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.711087 8058 ts_tablet_manager.cc:1403] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.000s
I20260505 20:13:26.704026 8050 ts_tablet_manager.cc:1950] T 293ea58772bb4b479501d4bf3ead3ba0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.711890 8058 raft_consensus.cc:359] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.712088 8058 raft_consensus.cc:385] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.712177 8058 raft_consensus.cc:740] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.712728 8050 tablet_replica.cc:333] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.712968 8050 raft_consensus.cc:2243] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.713152 8050 raft_consensus.cc:2272] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.713608 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.713723 8050 ts_tablet_manager.cc:1916] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.714319 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 (DEFAULT_TABLE table=default.Table_72dc9ef65e1442a8ac2e33e7ca75b20d [id=5248510b86d2424eb2167fd9a12ec41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.715112 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 (DEFAULT_TABLE table=default.Table_453aeb092a0040998c34044a79fbecfc [id=79032ad4a3c549559bc0ec51b54172d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.715926 8058 consensus_queue.cc:260] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.717406 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 8f1505e592e543cca92d8949bdae007e (DEFAULT_TABLE table=default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:26.718186 7308 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 61354.6us
I20260505 20:13:26.718761 8058 ts_tablet_manager.cc:1434] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260505 20:13:26.719070 8058 tablet_bootstrap.cc:492] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:26.723927 7870 leader_election.cc:343] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:26.724406 7870 leader_election.cc:343] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.725021 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 293ea58772bb4b479501d4bf3ead3ba0 (table default.Table_08e74268c74d44938d75f8cdbfb18948 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:26.744164 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 (DEFAULT_TABLE table=default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.746003 7635 tablet_service.cc:1511] Processing CreateTablet for tablet d411638715f747469f9f3dc490c0257c (DEFAULT_TABLE table=default.Table_53010b8cbf5e426590b4f82d68e96660 [id=3505dd62d0f747cb93b233259fadc6ef]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:26.748518 7870 leader_election.cc:343] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.748701 7870 leader_election.cc:304] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.749261 8361 raft_consensus.cc:2749] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.750259 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 24fc8fb89d614388969b5eff86ba31ca (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]) successfully deleted
I20260505 20:13:26.750689 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet f41cf3b6cf3a4ef6b7c077f78b793283 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.751917 8058 tablet_bootstrap.cc:654] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.752285 8127 consensus_queue.cc:1048] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:26.757666 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608bffbbc10141e8bd19f475b95bdc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.758119 7906 tablet_service.cc:1511] Processing CreateTablet for tablet bda4fd8b0f214da7a1e8b944e1820c0c (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.758256 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d411638715f747469f9f3dc490c0257c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.758667 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.758703 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda4fd8b0f214da7a1e8b944e1820c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.759034 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.762418 8079 raft_consensus.cc:493] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.762601 8079 raft_consensus.cc:515] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.763286 8079 leader_election.cc:290] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:26.764354 7598 leader_election.cc:343] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:26.765064 8050 ts_tablet_manager.cc:1929] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.766855 7338 catalog_manager.cc:5671] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:26.774544 8058 tablet_bootstrap.cc:492] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.774766 8058 ts_tablet_manager.cc:1403] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.013s
I20260505 20:13:26.777313 8058 raft_consensus.cc:359] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:26.777580 8058 raft_consensus.cc:385] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.777676 8058 raft_consensus.cc:740] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.779672 8051 ts_tablet_manager.cc:1929] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.775274 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 624398f68961440f8369a7859b0724c4 (DEFAULT_TABLE table=default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.781522 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624398f68961440f8369a7859b0724c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.776250 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6326375bac48f0944eeeaa9b39682c (DEFAULT_TABLE table=default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.786149 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6326375bac48f0944eeeaa9b39682c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.781553 8058 consensus_queue.cc:260] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:26.788574 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f1505e592e543cca92d8949bdae007e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.790022 8050 log.cc:1199] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/20eeb04e0a574132b247d5ce6d7add44
I20260505 20:13:26.790262 8051 log.cc:1199] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/13a4ddebda9447389c15be61aa60baaf
I20260505 20:13:26.790841 8050 ts_tablet_manager.cc:1950] T 20eeb04e0a574132b247d5ce6d7add44 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.790405 8058 ts_tablet_manager.cc:1434] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260505 20:13:26.703912 8053 raft_consensus.cc:740] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.747139 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 089517a7c2214dce9367b21beb555733 (DEFAULT_TABLE table=default.Table_bba6c3da778b48e99f89f01110a160da [id=7fd3bc8f4d484299a9a21b95ada7e77f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.747490 7768 tablet_service.cc:1511] Processing CreateTablet for tablet bda4fd8b0f214da7a1e8b944e1820c0c (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.796604 8053 consensus_queue.cc:260] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.747650 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 6bebda2a5c5a4c43a244504837cf0923 (DEFAULT_TABLE table=default.Table_f181142ec34d41af89373e942d282285 [id=e5e18bb6866143cd80c5bd1282d890cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.797251 8053 ts_tablet_manager.cc:1434] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.099s user 0.001s sys 0.000s
I20260505 20:13:26.797601 8053 tablet_bootstrap.cc:492] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.798487 8398 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: configured and running, proceeding with master startup.
I20260505 20:13:26.799319 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda4fd8b0f214da7a1e8b944e1820c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.747607 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 579bd562fea64fe69db2b4a6085b7bed (DEFAULT_TABLE table=default.Table_e39a201cd67e459489cc0ee580f8a165 [id=d29890b44f684d74b435fd28c0f5d28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.799825 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bd562fea64fe69db2b4a6085b7bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.800745 8050 tablet_replica.cc:333] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.800935 8050 raft_consensus.cc:2243] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.800976 8053 tablet_bootstrap.cc:654] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.801189 8050 pending_rounds.cc:70] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:26.748090 7778 tablet_service.cc:1511] Processing CreateTablet for tablet f29fd054d41e4c48ab0da8dec2b952d5 (DEFAULT_TABLE table=default.Table_a73fbe5892774352b079b4b0ce80d9c3 [id=2caf3e7ce2e84c259297c6e06ddf26a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.801241 8050 pending_rounds.cc:77] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737178847473664 op_type: NO_OP noop_request { }
I20260505 20:13:26.801373 8050 raft_consensus.cc:2889] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:26.801473 8050 raft_consensus.cc:2272] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.801630 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29fd054d41e4c48ab0da8dec2b952d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.801865 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089517a7c2214dce9367b21beb555733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.806363 8050 ts_tablet_manager.cc:1916] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.806421 8433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:26.806722 8433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
W20260505 20:13:26.807325 7308 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 67298.5us
I20260505 20:13:26.748242 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 (DEFAULT_TABLE table=default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.748344 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 624398f68961440f8369a7859b0724c4 (DEFAULT_TABLE table=default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.748972 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6326375bac48f0944eeeaa9b39682c (DEFAULT_TABLE table=default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.751230 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 506b421a774c4929813205dba0fac32b (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.757522 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 (DEFAULT_TABLE table=default.Table_72dc9ef65e1442a8ac2e33e7ca75b20d [id=5248510b86d2424eb2167fd9a12ec41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.809607 8058 tablet_bootstrap.cc:492] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.795018 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293ea58772bb4b479501d4bf3ead3ba0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:26.806384 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 20eeb04e0a574132b247d5ce6d7add44 (table default.Table_8f812ed4658e43018df5551d9bbe2e2d [id=1a58839ed48640caa2fcb8fe1d77bbaf]) successfully deleted
I20260505 20:13:26.814559 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
W20260505 20:13:26.815747 7596 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:26.815932 7596 leader_election.cc:304] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:26.816221 8079 raft_consensus.cc:2749] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.817214 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 506b421a774c4929813205dba0fac32b (DEFAULT_TABLE table=default.Table_179af68819324947a142bb734a25e38c [id=44f7f9f11ebb427db990437f24a5662c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.817687 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506b421a774c4929813205dba0fac32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.821620 8050 ts_tablet_manager.cc:1929] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.825424 8058 tablet_bootstrap.cc:654] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.830231 8051 ts_tablet_manager.cc:1950] T 13a4ddebda9447389c15be61aa60baaf P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.830844 8051 tablet_replica.cc:333] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.831092 8051 raft_consensus.cc:2243] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.831318 8051 raft_consensus.cc:2272] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.831903 8051 ts_tablet_manager.cc:1916] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.825250 7800 raft_consensus.cc:2468] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:26.833366 8050 log.cc:1199] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ee3543a2f89f43a8ab938e3585953953
I20260505 20:13:26.834108 8050 ts_tablet_manager.cc:1950] T ee3543a2f89f43a8ab938e3585953953 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.835290 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet ee3543a2f89f43a8ab938e3585953953 (table default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]) successfully deleted
W20260505 20:13:26.836015 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f41cf3b6cf3a4ef6b7c077f78b793283 because the tablet was not found. No further retry: Not found: Tablet not found: f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:26.836154 8058 tablet_bootstrap.cc:492] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.836310 8058 ts_tablet_manager.cc:1403] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.002s
I20260505 20:13:26.836339 8050 tablet_replica.cc:333] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.836532 8050 raft_consensus.cc:2243] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.837270 8050 raft_consensus.cc:2272] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.838173 8050 ts_tablet_manager.cc:1916] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.838487 8058 raft_consensus.cc:359] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.838747 8058 raft_consensus.cc:385] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.838850 8058 raft_consensus.cc:740] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.839136 8058 consensus_queue.cc:260] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.837393 8054 tablet_bootstrap.cc:492] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.839465 8054 ts_tablet_manager.cc:1403] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.193s user 0.009s sys 0.036s
I20260505 20:13:26.839829 8058 ts_tablet_manager.cc:1434] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:26.840178 8058 tablet_bootstrap.cc:492] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:26.840365 8054 raft_consensus.cc:359] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.840581 8054 raft_consensus.cc:385] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.840674 8054 raft_consensus.cc:740] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.840934 8054 consensus_queue.cc:260] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.841450 8054 ts_tablet_manager.cc:1434] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:26.844040 8053 tablet_bootstrap.cc:492] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.844221 8053 ts_tablet_manager.cc:1403] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.003s
I20260505 20:13:26.845101 8053 raft_consensus.cc:359] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.845312 8053 raft_consensus.cc:385] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.845425 8053 raft_consensus.cc:740] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.845681 8053 consensus_queue.cc:260] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.846221 8053 ts_tablet_manager.cc:1434] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:26.846555 8053 tablet_bootstrap.cc:492] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.846740 8054 tablet_bootstrap.cc:492] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:26.853961 8054 tablet_bootstrap.cc:654] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.856387 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 (DEFAULT_TABLE table=default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.856942 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168d9a40a69d4beab8e79a97e7723e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.860952 8050 ts_tablet_manager.cc:1929] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.865399 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bebda2a5c5a4c43a244504837cf0923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.866184 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6326375bac48f0944eeeaa9b39682c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.869983 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506b421a774c4929813205dba0fac32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.874614 7639 tablet_service.cc:1511] Processing CreateTablet for tablet bda4fd8b0f214da7a1e8b944e1820c0c (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.875043 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624398f68961440f8369a7859b0724c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.875140 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda4fd8b0f214da7a1e8b944e1820c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.876103 8050 log.cc:1199] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/24fc8fb89d614388969b5eff86ba31ca
I20260505 20:13:26.876864 8050 ts_tablet_manager.cc:1950] T 24fc8fb89d614388969b5eff86ba31ca P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.878369 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 579bd562fea64fe69db2b4a6085b7bed (DEFAULT_TABLE table=default.Table_e39a201cd67e459489cc0ee580f8a165 [id=d29890b44f684d74b435fd28c0f5d28f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.878779 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.878957 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579bd562fea64fe69db2b4a6085b7bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.879242 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 24fc8fb89d614388969b5eff86ba31ca (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]) successfully deleted
I20260505 20:13:26.879524 8050 tablet_replica.cc:333] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.880295 8050 raft_consensus.cc:2243] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.881069 8050 raft_consensus.cc:2272] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.882200 8050 ts_tablet_manager.cc:1916] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.885929 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168d9a40a69d4beab8e79a97e7723e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.893075 8058 tablet_bootstrap.cc:654] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.899926 7630 tablet_service.cc:1511] Processing CreateTablet for tablet 089517a7c2214dce9367b21beb555733 (DEFAULT_TABLE table=default.Table_bba6c3da778b48e99f89f01110a160da [id=7fd3bc8f4d484299a9a21b95ada7e77f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.900624 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089517a7c2214dce9367b21beb555733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.904271 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 6bebda2a5c5a4c43a244504837cf0923 (DEFAULT_TABLE table=default.Table_f181142ec34d41af89373e942d282285 [id=e5e18bb6866143cd80c5bd1282d890cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.904724 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bebda2a5c5a4c43a244504837cf0923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.905001 8050 ts_tablet_manager.cc:1929] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.905159 8050 log.cc:1199] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c95cba502b064583a50fb85ba7dea1b5
I20260505 20:13:26.905603 8050 ts_tablet_manager.cc:1950] T c95cba502b064583a50fb85ba7dea1b5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.906668 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c95cba502b064583a50fb85ba7dea1b5 (table default.Table_528b585197824127a1f24d4f16e3f840 [id=e4f40ca8f6ce4601b2066218fd09cff5]) successfully deleted
I20260505 20:13:26.912217 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 624398f68961440f8369a7859b0724c4 (DEFAULT_TABLE table=default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.912271 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6326375bac48f0944eeeaa9b39682c (DEFAULT_TABLE table=default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.912804 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 624398f68961440f8369a7859b0724c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:26.915395 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 3e77ec84858a4e46a993c579d9990f1b because the tablet was not found. No further retry: Not found: Tablet not found: 3e77ec84858a4e46a993c579d9990f1b
I20260505 20:13:26.918066 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6326375bac48f0944eeeaa9b39682c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.919088 8053 tablet_bootstrap.cc:654] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.919821 8089 raft_consensus.cc:493] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:26.919982 8089 raft_consensus.cc:515] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.920818 8089 leader_election.cc:290] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.921994 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f5bfa086f9422ebda96b2485ad986b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:26.922255 8050 tablet_replica.cc:333] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:26.922497 8050 raft_consensus.cc:2243] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:26.922794 8050 pending_rounds.cc:70] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:26.922856 8050 pending_rounds.cc:77] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737177514455040 op_type: NO_OP noop_request { }
I20260505 20:13:26.922981 8050 raft_consensus.cc:2889] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260505 20:13:26.922967 7736 leader_election.cc:343] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.923069 8050 raft_consensus.cc:2272] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:26.924094 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f5bfa086f9422ebda96b2485ad986b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:26.924849 7737 leader_election.cc:343] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:26.925069 7737 leader_election.cc:304] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:26.925477 8089 raft_consensus.cc:2749] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:26.926321 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 725cb481751048c29695726011c80c08 (table default.Table_cfd1ed72bf61489999a9ce28da492f92 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:26.927435 8050 ts_tablet_manager.cc:1916] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:26.928578 7636 tablet_service.cc:1511] Processing CreateTablet for tablet f29fd054d41e4c48ab0da8dec2b952d5 (DEFAULT_TABLE table=default.Table_a73fbe5892774352b079b4b0ce80d9c3 [id=2caf3e7ce2e84c259297c6e06ddf26a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:26.929044 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29fd054d41e4c48ab0da8dec2b952d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:26.934688 7596 leader_election.cc:304] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:26.935140 8079 raft_consensus.cc:2804] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:26.935256 8079 raft_consensus.cc:493] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:26.935367 8079 raft_consensus.cc:3060] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.935873 8053 tablet_bootstrap.cc:492] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.936015 8053 ts_tablet_manager.cc:1403] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.090s user 0.011s sys 0.003s
I20260505 20:13:26.936385 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 13a4ddebda9447389c15be61aa60baaf (table default.Table_6168f9d927844aadaca4cf743d95c088 [id=41e7773608d34ceb98c40adc9c782d6f]) successfully deleted
I20260505 20:13:26.936879 8053 raft_consensus.cc:359] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.937059 8053 raft_consensus.cc:385] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.937151 8053 raft_consensus.cc:740] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.937366 8053 consensus_queue.cc:260] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.937911 8053 ts_tablet_manager.cc:1434] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:26.938284 8053 tablet_bootstrap.cc:492] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.938946 8079 raft_consensus.cc:515] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.940080 8053 tablet_bootstrap.cc:654] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:26.940580 7598 leader_election.cc:343] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:26.940300 8079 leader_election.cc:290] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:26.941641 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:26.943058 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet b17da5cf513647d9b8e582a9b3b460a1 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.943536 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 28ce3efe875a43d9b30d40623bf8a385 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:26.949160 8050 ts_tablet_manager.cc:1929] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.950547 8053 tablet_bootstrap.cc:492] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:26.950727 8053 ts_tablet_manager.cc:1403] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260505 20:13:26.951436 8053 raft_consensus.cc:359] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.951666 8053 raft_consensus.cc:385] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.951758 8053 raft_consensus.cc:740] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.952009 8053 consensus_queue.cc:260] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.952566 8053 ts_tablet_manager.cc:1434] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:26.962316 8050 log.cc:1199] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:26.963631 8050 ts_tablet_manager.cc:1950] T c104bd9c39af48449718b0c7f327f6ec P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:26.963860 8058 tablet_bootstrap.cc:492] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:26.964063 8058 ts_tablet_manager.cc:1403] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.124s user 0.002s sys 0.001s
I20260505 20:13:26.965045 8058 raft_consensus.cc:359] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.965279 8058 raft_consensus.cc:385] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.965372 8058 raft_consensus.cc:740] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.965653 8058 consensus_queue.cc:260] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.966939 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c104bd9c39af48449718b0c7f327f6ec (table default.Table_0dd057d830894bc0a635f56b257151d7 [id=7517daa10e164e339a320e44a40bebda]) successfully deleted
I20260505 20:13:26.967980 8058 ts_tablet_manager.cc:1434] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260505 20:13:26.968320 8058 tablet_bootstrap.cc:492] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:26.969563 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 4cbb29bc765d476cb4634178f2806c10 because the tablet was not found. No further retry: Not found: Tablet not found: 4cbb29bc765d476cb4634178f2806c10
I20260505 20:13:26.970109 8058 tablet_bootstrap.cc:654] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.974880 8467 tablet.cc:1724] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:26.978765 8051 ts_tablet_manager.cc:1929] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:26.978998 8051 log.cc:1199] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/4cbb29bc765d476cb4634178f2806c10
I20260505 20:13:26.979517 8051 ts_tablet_manager.cc:1950] T 4cbb29bc765d476cb4634178f2806c10 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:26.980686 8051 tablet_replica.cc:333] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:26.981042 8051 raft_consensus.cc:2243] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:26.981290 8052 ts_tablet_manager.cc:1929] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:26.981529 8052 log.cc:1199] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c95cba502b064583a50fb85ba7dea1b5
I20260505 20:13:26.982097 8054 tablet_bootstrap.cc:492] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:26.982123 8052 ts_tablet_manager.cc:1950] T c95cba502b064583a50fb85ba7dea1b5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:26.982167 8465 tablet.cc:1724] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:26.982375 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 4cbb29bc765d476cb4634178f2806c10 (table default.Table_f4773b76a3564290a6bc4a8870c4e836 [id=bc43e7a8c2394fb4a2606d9b920f292d]) successfully deleted
I20260505 20:13:26.982354 8054 ts_tablet_manager.cc:1403] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.141s user 0.007s sys 0.023s
I20260505 20:13:26.983702 8054 raft_consensus.cc:359] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.983970 8054 raft_consensus.cc:385] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:26.984105 8054 raft_consensus.cc:740] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:26.984447 8054 consensus_queue.cc:260] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:26.985101 8054 ts_tablet_manager.cc:1434] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:26.985642 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "293ea58772bb4b479501d4bf3ead3ba0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:26.985890 7801 raft_consensus.cc:3060] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:26.986168 8053 tablet_bootstrap.cc:492] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:26.988384 8053 tablet_bootstrap.cc:654] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.988873 7801 raft_consensus.cc:2468] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:26.995609 7847 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:27.002261 8054 tablet_bootstrap.cc:492] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.004134 8054 tablet_bootstrap.cc:654] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:26.995296 8079 raft_consensus.cc:493] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.004460 8079 raft_consensus.cc:515] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.005120 8079 leader_election.cc:290] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.005272 8079 raft_consensus.cc:493] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.005376 8079 raft_consensus.cc:515] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.007150 8079 leader_election.cc:290] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.002322 8058 tablet_bootstrap.cc:492] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.008037 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80a1674d26c42e5a4884da99ab7918c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.007957 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a5d442f25242ea8371fca8643f4ce6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.008373 8058 ts_tablet_manager.cc:1403] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260505 20:13:27.008425 7936 raft_consensus.cc:2468] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:27.008946 7598 leader_election.cc:304] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.009298 8079 raft_consensus.cc:2804] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.009397 8079 raft_consensus.cc:493] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.009473 8079 raft_consensus.cc:3060] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.012849 8079 raft_consensus.cc:515] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.013943 8079 leader_election.cc:290] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.014070 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80a1674d26c42e5a4884da99ab7918c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:27.014326 7936 raft_consensus.cc:3060] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.015094 8058 raft_consensus.cc:359] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.015311 8058 raft_consensus.cc:385] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.015396 8058 raft_consensus.cc:740] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.015635 8058 consensus_queue.cc:260] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.016278 7596 leader_election.cc:304] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:27.016880 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80a1674d26c42e5a4884da99ab7918c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.017060 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a5d442f25242ea8371fca8643f4ce6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.017113 7801 raft_consensus.cc:2468] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:27.017341 7936 raft_consensus.cc:2468] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:27.017438 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80a1674d26c42e5a4884da99ab7918c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:27.017625 7802 raft_consensus.cc:3060] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.017825 7598 leader_election.cc:304] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.018494 7596 leader_election.cc:304] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.018810 8472 raft_consensus.cc:2804] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.019114 8051 raft_consensus.cc:2272] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.019016 8079 raft_consensus.cc:2804] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.019728 8051 ts_tablet_manager.cc:1916] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.020319 7802 raft_consensus.cc:2468] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:27.021160 8058 ts_tablet_manager.cc:1434] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:27.021562 8058 tablet_bootstrap.cc:492] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.034722 8058 tablet_bootstrap.cc:654] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.038322 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c95cba502b064583a50fb85ba7dea1b5 (table default.Table_528b585197824127a1f24d4f16e3f840 [id=e4f40ca8f6ce4601b2066218fd09cff5]) successfully deleted
I20260505 20:13:27.038770 8052 tablet_replica.cc:333] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.039094 8052 raft_consensus.cc:2243] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.039387 8052 raft_consensus.cc:2272] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.040045 8477 raft_consensus.cc:2749] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.040120 8052 ts_tablet_manager.cc:1916] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.045156 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 249cad23ecfe4b9dbbd34f2a1fa899e3
I20260505 20:13:27.045974 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 6cf77f6323af4263852853e10003faee
I20260505 20:13:27.046223 8479 tablet.cc:1724] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:27.046768 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bf624872acc84e63b23fe61fd237af86" } new_table_name: "default.Table_5e2133ac533b4b6084978252a3244509" modify_external_catalogs: true
I20260505 20:13:27.046981 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3558bdbcaf1644aeb0377cc616ce9dae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.047677 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3558bdbcaf1644aeb0377cc616ce9dae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.048136 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:27.048848 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c7cd453210984ec7989f00858cf2aba5" } new_table_name: "default.Table_96a76218de254fee8498ed283135bbbf" modify_external_catalogs: true
I20260505 20:13:27.049871 7336 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:27.050282 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9875a3e2f0d444018fb87797fd4bcde6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.050173 7336 catalog_manager.cc:5671] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:27.050694 7336 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (table default.Table_6668622814b7401689dd9dfecee3a8b9 [id=74178f7425164618bd69a1653b75e5d1]). Expected version 6 got 0
W20260505 20:13:27.050828 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9875a3e2f0d444018fb87797fd4bcde6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.052026 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet bd01314146a34257b444a622829b2fe4
I20260505 20:13:27.052241 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.052479 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa with delete_type TABLET_DATA_DELETED (replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.052637 7337 master_service.cc:954] ReplaceTablet: received request to replace tablet 84fb3dcea55d4b348cbf92c3c4581dda from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.052774 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.052832 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet ef996218e8b14e3b80eeab3397edec57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.053031 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.040287 8472 raft_consensus.cc:697] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:27.053280 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf77f6323af4263852853e10003faee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.053323 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a5f6228ca6384c5b88cd9242e5d25334"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.053498 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.053943 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.053968 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b966b4bbaf9f4774af96051f857f02f7
I20260505 20:13:27.053885 8472 consensus_queue.cc:237] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.054579 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_531f36cb82b349d78a8739ba749d0782"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.055080 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_531f36cb82b349d78a8739ba749d0782 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.055851 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.056322 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf77f6323af4263852853e10003faee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.056679 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.057067 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.057075 8079 raft_consensus.cc:697] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:27.057871 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.057938 8052 ts_tablet_manager.cc:1929] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.058094 8052 log.cc:1199] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:27.057500 8079 consensus_queue.cc:237] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.058502 8052 ts_tablet_manager.cc:1950] T c104bd9c39af48449718b0c7f327f6ec P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.060133 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet e80a1674d26c42e5a4884da99ab7918c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.060379 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet f32d3ec040604ce7b384c4b6a202707f with delete_type TABLET_DATA_DELETED (replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.060603 8050 tablet_replica.cc:333] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.060799 8050 raft_consensus.cc:2243] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.061067 8050 pending_rounds.cc:70] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:27.061124 8050 pending_rounds.cc:77] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737179085660160 op_type: NO_OP noop_request { }
I20260505 20:13:27.061239 8058 tablet_bootstrap.cc:492] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.061268 8050 raft_consensus.cc:2889] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.061367 8050 raft_consensus.cc:2272] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.066668 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c104bd9c39af48449718b0c7f327f6ec (table default.Table_0dd057d830894bc0a635f56b257151d7 [id=7517daa10e164e339a320e44a40bebda]) successfully deleted
W20260505 20:13:27.066948 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 00dbde45980c4f2b8d6bee05416fa2c6 because the tablet was not found. No further retry: Not found: Tablet not found: 00dbde45980c4f2b8d6bee05416fa2c6
I20260505 20:13:27.068045 7333 master_service.cc:954] ReplaceTablet: received request to replace tablet f62626fb4f8445e3a6e2822277181762 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.068485 8052 tablet_replica.cc:333] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.068718 8052 raft_consensus.cc:2243] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.068903 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.069195 8052 pending_rounds.cc:70] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:27.069286 8052 pending_rounds.cc:77] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737177713455104 op_type: NO_OP noop_request { }
I20260505 20:13:27.069398 8052 raft_consensus.cc:2889] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.069861 8052 raft_consensus.cc:2272] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.069988 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.070199 8050 ts_tablet_manager.cc:1916] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.070439 8051 ts_tablet_manager.cc:1929] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.070636 8058 ts_tablet_manager.cc:1403] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260505 20:13:27.071499 8058 raft_consensus.cc:359] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.071718 8058 raft_consensus.cc:385] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.071790 8058 raft_consensus.cc:740] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.071982 8051 log.cc:1199] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/a9719876757e409b991b21410983e3bf
I20260505 20:13:27.072388 8051 ts_tablet_manager.cc:1950] T a9719876757e409b991b21410983e3bf P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.073001 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet a9719876757e409b991b21410983e3bf (table default.Table_50fe331fc2b042a59cbe8680d748f55d [id=50486337046a42e9b81be28203a2845b]) successfully deleted
I20260505 20:13:27.073204 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.073513 8051 tablet_replica.cc:333] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.073908 7661 raft_consensus.cc:3060] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.077863 8058 consensus_queue.cc:260] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.078192 8475 raft_consensus.cc:493] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.078462 8058 ts_tablet_manager.cc:1434] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260505 20:13:27.078415 8475 raft_consensus.cc:515] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.079423 8475 leader_election.cc:290] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.079758 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 28ce3efe875a43d9b30d40623bf8a385
I20260505 20:13:27.080271 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 28ce3efe875a43d9b30d40623bf8a385 deleted and replaced by tablet c720fc66db36402a83a7690d70a40353
I20260505 20:13:27.073699 8051 raft_consensus.cc:2243] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.080700 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_471e002676d8465fb3a2af7b858cd2c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.080912 8051 raft_consensus.cc:2272] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:27.081310 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_471e002676d8465fb3a2af7b858cd2c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:27.081410 7598 leader_election.cc:343] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 99ab400210c54e99bc396674f7ba8235
I20260505 20:13:27.081518 8051 ts_tablet_manager.cc:1916] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.082639 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 with delete_type TABLET_DATA_DELETED (replaced by tablet c720fc66db36402a83a7690d70a40353) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.082623 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ab400210c54e99bc396674f7ba8235" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.083015 8089 consensus_queue.cc:1048] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:27.083308 7596 leader_election.cc:304] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.083848 8053 tablet_bootstrap.cc:492] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:27.084007 8053 ts_tablet_manager.cc:1403] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.001s
I20260505 20:13:27.084965 8053 raft_consensus.cc:359] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.085165 8053 raft_consensus.cc:385] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.085259 8053 raft_consensus.cc:740] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.085857 8058 tablet_bootstrap.cc:492] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.085942 8472 raft_consensus.cc:2749] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:27.086530 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 with delete_type TABLET_DATA_DELETED (replaced by tablet c720fc66db36402a83a7690d70a40353) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:27.088418 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5f6228ca6384c5b88cd9242e5d25334 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.089584 8058 tablet_bootstrap.cc:654] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.085492 8053 consensus_queue.cc:260] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.089162 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 with delete_type TABLET_DATA_DELETED (replaced by tablet c720fc66db36402a83a7690d70a40353) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.090552 8053 ts_tablet_manager.cc:1434] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:27.090931 8053 tablet_bootstrap.cc:492] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:27.092957 8053 tablet_bootstrap.cc:654] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.094457 8054 tablet_bootstrap.cc:492] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.094650 8054 ts_tablet_manager.cc:1403] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.007s
I20260505 20:13:27.098546 7342 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet b9b375a4bbec4527af704aa6cd08acec (table default.Table_3e927ca3870e46dfac9020afe0c894e5 [id=7e050176e69345a8ba527b6fa0d49da3]). Expected version 2 got 0
I20260505 20:13:27.100175 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c49a496156544e27a5039eab18590a91" } new_table_name: "default.Table_1897c19ad8a941ec9278d5f5fd46a14c" modify_external_catalogs: true
I20260505 20:13:27.100353 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa with delete_type TABLET_DATA_DELETED (replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.100354 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet 99ab400210c54e99bc396674f7ba8235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.102530 7336 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4357617bff6a440898a3f318565ad4ea" } new_table_name: "default.Table_743988c08e634a86b20fea79e4c3a340" modify_external_catalogs: true
I20260505 20:13:27.102564 8054 raft_consensus.cc:359] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.102746 8054 raft_consensus.cc:385] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.102805 8054 raft_consensus.cc:740] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.103070 8054 consensus_queue.cc:260] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.103624 8054 ts_tablet_manager.cc:1434] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260505 20:13:27.104719 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bc0ac75d0a8d46caa8026d33f784689d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.105259 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc0ac75d0a8d46caa8026d33f784689d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:27.106452 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 949fecb197084426b5a6adb959f5c886 consensus state has no leader
I20260505 20:13:27.106868 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_52395f8e91e449d480c726f789bad840" } new_table_name: "default.Table_24dc4b8440024bde9145ce5b588d47cc" modify_external_catalogs: true
I20260505 20:13:27.107848 8054 tablet_bootstrap.cc:492] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.109730 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 293ea58772bb4b479501d4bf3ead3ba0 with delete_type TABLET_DATA_DELETED (replaced by tablet 4939dab5a4d54a08a75424bcaabbb8dd) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.110011 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b0d6b6035154e01850e7a158ad22dfa with delete_type TABLET_DATA_DELETED (replaced by tablet 84fb3dcea55d4b348cbf92c3c4581dda) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.110112 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet ee3543a2f89f43a8ab938e3585953953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.110417 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet e80a1674d26c42e5a4884da99ab7918c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.110823 7982 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:27.110919 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet c95cba502b064583a50fb85ba7dea1b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.111140 8053 tablet_bootstrap.cc:492] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:27.113372 8053 ts_tablet_manager.cc:1403] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260505 20:13:27.114269 8053 raft_consensus.cc:359] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.114480 8053 raft_consensus.cc:385] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.114575 8053 raft_consensus.cc:740] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.118453 8054 tablet_bootstrap.cc:654] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.119283 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.119565 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.119753 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf77f6323af4263852853e10003faee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.121417 8050 ts_tablet_manager.cc:1929] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.121570 8050 log.cc:1199] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/5b0d6b6035154e01850e7a158ad22dfa
I20260505 20:13:27.122071 8050 ts_tablet_manager.cc:1950] T 5b0d6b6035154e01850e7a158ad22dfa P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:27.124212 8053 consensus_queue.cc:260] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.126444 8050 tablet_replica.cc:333] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.127744 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 5b0d6b6035154e01850e7a158ad22dfa (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
W20260505 20:13:27.128077 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c104bd9c39af48449718b0c7f327f6ec because the tablet was not found. No further retry: Not found: Tablet not found: c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:27.128903 8050 raft_consensus.cc:2243] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.129812 8053 ts_tablet_manager.cc:1434] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260505 20:13:27.127499 8052 ts_tablet_manager.cc:1916] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:27.133008 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c720fc66db36402a83a7690d70a40353 has no consensus state
I20260505 20:13:27.133301 7335 master_service.cc:954] ReplaceTablet: received request to replace tablet 84fb3dcea55d4b348cbf92c3c4581dda from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.133625 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f62626fb4f8445e3a6e2822277181762
I20260505 20:13:27.134101 7333 catalog_manager.cc:6741] ReplaceTablet: tablet f62626fb4f8445e3a6e2822277181762 deleted and replaced by tablet d138d27f444f45d28acdc7d72a9649f5
I20260505 20:13:27.134176 8339 raft_consensus.cc:493] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.134336 8339 raft_consensus.cc:515] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:27.135021 7336 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 880cbba188144dd795873186f8cda1e9 consensus state has no leader
I20260505 20:13:27.135018 8339 leader_election.cc:290] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:27.135655 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65003660c44547cc8674baeca370e395 consensus state has no leader
I20260505 20:13:27.135710 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.135953 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6589a0f15d4f31acc2e49e6c071e6a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:27.136087 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9d2b417857347468529868b51ec07ab consensus state has no leader
I20260505 20:13:27.136193 7662 raft_consensus.cc:2468] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:27.136678 7736 leader_election.cc:304] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.136946 8339 raft_consensus.cc:2804] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.137053 8339 raft_consensus.cc:493] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.137157 8339 raft_consensus.cc:3060] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.139855 8339 raft_consensus.cc:515] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.141029 8339 leader_election.cc:290] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.141510 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6589a0f15d4f31acc2e49e6c071e6a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:27.141714 7662 raft_consensus.cc:3060] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.144480 8051 ts_tablet_manager.cc:1929] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.144618 8051 log.cc:1199] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/20eeb04e0a574132b247d5ce6d7add44
I20260505 20:13:27.144989 7662 raft_consensus.cc:2468] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:27.145043 8051 ts_tablet_manager.cc:1950] T 20eeb04e0a574132b247d5ce6d7add44 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.141928 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.145803 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 20eeb04e0a574132b247d5ce6d7add44 (table default.Table_8f812ed4658e43018df5551d9bbe2e2d [id=1a58839ed48640caa2fcb8fe1d77bbaf]) successfully deleted
W20260505 20:13:27.149266 7737 consensus_peers.cc:597] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99ab400210c54e99bc396674f7ba8235. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:27.149870 8053 tablet_bootstrap.cc:492] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:27.136277 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6589a0f15d4f31acc2e49e6c071e6a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.152319 7936 raft_consensus.cc:2468] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:27.138784 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.141491 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6589a0f15d4f31acc2e49e6c071e6a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:27.152993 7937 raft_consensus.cc:3060] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.153985 8053 tablet_bootstrap.cc:654] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.154044 8443 raft_consensus.cc:493] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.154234 8443 raft_consensus.cc:515] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.154956 8054 tablet_bootstrap.cc:492] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.155123 8443 leader_election.cc:290] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.155992 7937 raft_consensus.cc:2468] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:27.156579 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591290e4ddf4bcc9d4676a2618a346c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.155121 8054 ts_tablet_manager.cc:1403] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.003s
I20260505 20:13:27.156793 7802 raft_consensus.cc:2468] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:27.157393 8050 raft_consensus.cc:2272] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.158715 7737 leader_election.cc:304] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:27.159006 8089 raft_consensus.cc:2804] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.159139 8089 raft_consensus.cc:697] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:27.159416 8089 consensus_queue.cc:237] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.160044 8051 tablet_replica.cc:333] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.161255 8051 raft_consensus.cc:2243] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.159147 7869 leader_election.cc:304] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:27.161885 8050 ts_tablet_manager.cc:1916] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.162081 8443 raft_consensus.cc:2804] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.162240 8443 raft_consensus.cc:493] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.162361 8443 raft_consensus.cc:3060] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.162379 8051 raft_consensus.cc:2272] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.164778 8051 ts_tablet_manager.cc:1916] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.167164 8443 raft_consensus.cc:515] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.167191 8054 raft_consensus.cc:359] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.168505 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591290e4ddf4bcc9d4676a2618a346c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:27.169711 8054 raft_consensus.cc:385] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.169893 8054 raft_consensus.cc:740] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.170203 8054 consensus_queue.cc:260] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.172077 8054 ts_tablet_manager.cc:1434] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260505 20:13:27.172511 8054 tablet_bootstrap.cc:492] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.174965 8054 tablet_bootstrap.cc:654] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:27.177434 7870 leader_election.cc:343] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.179411 8050 ts_tablet_manager.cc:1929] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.179629 8050 log.cc:1199] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ef996218e8b14e3b80eeab3397edec57
I20260505 20:13:27.182083 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d35a015103974aae8ba25b644b320d5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.182636 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d35a015103974aae8ba25b644b320d5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.183902 8053 tablet_bootstrap.cc:492] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:27.183954 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_a62884f24a7b450e86c9ec17c75bd041"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.184067 8053 ts_tablet_manager.cc:1403] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
W20260505 20:13:27.184480 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a62884f24a7b450e86c9ec17c75bd041 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.184527 8443 leader_election.cc:290] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.160609 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591290e4ddf4bcc9d4676a2618a346c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:27.185146 7870 leader_election.cc:343] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.185652 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_efe2580fbb5b4113b2ba4580914aacc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.186125 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efe2580fbb5b4113b2ba4580914aacc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.187196 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591290e4ddf4bcc9d4676a2618a346c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:27.187409 7802 raft_consensus.cc:3060] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.189388 8053 raft_consensus.cc:359] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.189576 8053 raft_consensus.cc:385] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.189670 8053 raft_consensus.cc:740] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.190001 8052 ts_tablet_manager.cc:1929] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.190106 8052 log.cc:1199] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/20eeb04e0a574132b247d5ce6d7add44
I20260505 20:13:27.190553 8052 ts_tablet_manager.cc:1950] T 20eeb04e0a574132b247d5ce6d7add44 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.191186 8053 consensus_queue.cc:260] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.193717 7802 raft_consensus.cc:2468] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:27.194291 7869 leader_election.cc:304] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:27.194809 8443 raft_consensus.cc:2804] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.195842 8443 raft_consensus.cc:697] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:27.196247 8443 consensus_queue.cc:237] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.196605 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 20eeb04e0a574132b247d5ce6d7add44 (table default.Table_8f812ed4658e43018df5551d9bbe2e2d [id=1a58839ed48640caa2fcb8fe1d77bbaf]) successfully deleted
I20260505 20:13:27.197563 8053 ts_tablet_manager.cc:1434] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:27.197860 8052 tablet_replica.cc:333] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.200413 8052 raft_consensus.cc:2243] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.201164 7341 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:27.205093 7630 tablet_service.cc:1511] Processing CreateTablet for tablet e69bdfc75a494635837178cb16c08c1c (DEFAULT_TABLE table=default.Table_6071ca6b55a24946bfa133a951d84705 [id=1d0a4f96e2d2469eb1f5713c8be415df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.205195 7334 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_3e927ca3870e46dfac9020afe0c894e5 [id=7e050176e69345a8ba527b6fa0d49da3] alter complete (version 2)
I20260505 20:13:27.205596 7630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69bdfc75a494635837178cb16c08c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.208012 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet e80a1674d26c42e5a4884da99ab7918c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.208274 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a with delete_type TABLET_DATA_DELETED (replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.208482 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet c104bd9c39af48449718b0c7f327f6ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.208732 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 with delete_type TABLET_DATA_DELETED (replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.208954 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e865d406c4d95b97b579e9fe07df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.210124 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a with delete_type TABLET_DATA_DELETED (replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.210337 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet a1f5bfa086f9422ebda96b2485ad986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.210983 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet f32d3ec040604ce7b384c4b6a202707f with delete_type TABLET_DATA_DELETED (replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.211236 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.211421 7639 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec5c094e2bb4a4481825df17becde52 (DEFAULT_TABLE table=default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.211516 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet ef996218e8b14e3b80eeab3397edec57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.212379 8052 raft_consensus.cc:2272] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.212469 7905 tablet_service.cc:1511] Processing CreateTablet for tablet e69bdfc75a494635837178cb16c08c1c (DEFAULT_TABLE table=default.Table_6071ca6b55a24946bfa133a951d84705 [id=1d0a4f96e2d2469eb1f5713c8be415df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.202075 8053 tablet_bootstrap.cc:492] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:27.203840 7767 tablet_service.cc:1511] Processing CreateTablet for tablet e69bdfc75a494635837178cb16c08c1c (DEFAULT_TABLE table=default.Table_6071ca6b55a24946bfa133a951d84705 [id=1d0a4f96e2d2469eb1f5713c8be415df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.212628 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.212908 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet aa6589a0f15d4f31acc2e49e6c071e6a with delete_type TABLET_DATA_DELETED (replaced by tablet cdda1cc266cd47c993b5d1a0a78c7df9) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.212970 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69bdfc75a494635837178cb16c08c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.213129 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec5c094e2bb4a4481825df17becde52 (DEFAULT_TABLE table=default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.214466 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69bdfc75a494635837178cb16c08c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.214764 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec5c094e2bb4a4481825df17becde52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.218477 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 972b5c40369d41739d8c7a5bca22f04e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.218609 8058 tablet_bootstrap.cc:492] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.218767 8058 ts_tablet_manager.cc:1403] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.133s user 0.010s sys 0.000s
I20260505 20:13:27.219313 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.219614 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet 64a82a9d144746338b3fc6550aa35d3c from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.220912 8053 tablet_bootstrap.cc:654] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.221307 8058 raft_consensus.cc:359] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.221617 8058 raft_consensus.cc:385] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.221793 8058 raft_consensus.cc:740] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.222414 8058 consensus_queue.cc:260] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.223009 8058 ts_tablet_manager.cc:1434] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260505 20:13:27.224869 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 43a3e9d404f14b43ae99c4a905f50086 (DEFAULT_TABLE table=default.Table_adcd07552cd942b8a23b82a71361e1de [id=88123d48cd234b2a8b5c68f4cc4cb788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.225075 8058 tablet_bootstrap.cc:492] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.227222 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 (DEFAULT_TABLE table=default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974 [id=5023dca3a2084d33a514ca739ffa7ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.227695 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.228070 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 43a3e9d404f14b43ae99c4a905f50086 (DEFAULT_TABLE table=default.Table_adcd07552cd942b8a23b82a71361e1de [id=88123d48cd234b2a8b5c68f4cc4cb788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.228498 8052 ts_tablet_manager.cc:1916] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.228621 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a3e9d404f14b43ae99c4a905f50086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.230020 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 43a3e9d404f14b43ae99c4a905f50086 (DEFAULT_TABLE table=default.Table_adcd07552cd942b8a23b82a71361e1de [id=88123d48cd234b2a8b5c68f4cc4cb788]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.230108 7637 tablet_service.cc:1511] Processing CreateTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 (DEFAULT_TABLE table=default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974 [id=5023dca3a2084d33a514ca739ffa7ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.230391 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a3e9d404f14b43ae99c4a905f50086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.234020 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec5c094e2bb4a4481825df17becde52 (DEFAULT_TABLE table=default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.234457 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec5c094e2bb4a4481825df17becde52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.235499 8058 tablet_bootstrap.cc:654] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.239459 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 982da795cf2c4e578f3392066b1cc1ea (DEFAULT_TABLE table=default.Table_d3f51622819c4146803605c7494da89e [id=33e3959f29394995be644ddc2dcf0585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.239512 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 (DEFAULT_TABLE table=default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974 [id=5023dca3a2084d33a514ca739ffa7ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.239899 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.241528 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 (DEFAULT_TABLE table=default.Table_2abcfc3982a14ad59d71192e56a1f1d9 [id=2514754262884627a95e5da503db0535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.243222 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 (DEFAULT_TABLE table=default.Table_2abcfc3982a14ad59d71192e56a1f1d9 [id=2514754262884627a95e5da503db0535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.243741 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.244247 7937 raft_consensus.cc:1275] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:27.245375 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 982da795cf2c4e578f3392066b1cc1ea (DEFAULT_TABLE table=default.Table_d3f51622819c4146803605c7494da89e [id=33e3959f29394995be644ddc2dcf0585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.245774 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982da795cf2c4e578f3392066b1cc1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.247671 7632 tablet_service.cc:1511] Processing CreateTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 (DEFAULT_TABLE table=default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.247854 8089 consensus_queue.cc:1048] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:27.248356 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 (DEFAULT_TABLE table=default.Table_2abcfc3982a14ad59d71192e56a1f1d9 [id=2514754262884627a95e5da503db0535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.248797 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:27.254170 7326 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_c3df4da03c5b4917b507a2945a453705 [id=fcfe44f6abce4d00b4290752ab326b49], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01e800dfb0354beab9c835cbed9dceb4 consensus state has no leader
I20260505 20:13:27.254680 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 982da795cf2c4e578f3392066b1cc1ea (DEFAULT_TABLE table=default.Table_d3f51622819c4146803605c7494da89e [id=33e3959f29394995be644ddc2dcf0585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.257633 7764 tablet_service.cc:1511] Processing CreateTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 (DEFAULT_TABLE table=default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.258561 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d4e198c91c4a0e99d8b798a1dd3433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.261157 7767 tablet_service.cc:1511] Processing CreateTablet for tablet f697fa87e7fe4da0b70bfa42a8818660 (DEFAULT_TABLE table=default.Table_1088b8bf1039442b9962d35ee73ea794 [id=ca6c4e13eead4e5f9bd6003d9024ebd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.261629 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f697fa87e7fe4da0b70bfa42a8818660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.262216 7662 raft_consensus.cc:1275] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:27.263180 8089 consensus_queue.cc:1048] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:27.263473 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_efe81e982113463b9ff4f04403f0bac7" } modify_external_catalogs: true
I20260505 20:13:27.263672 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_efe81e982113463b9ff4f04403f0bac7" } modify_external_catalogs: true
I20260505 20:13:27.263731 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_531f36cb82b349d78a8739ba749d0782" } modify_external_catalogs: true
I20260505 20:13:27.263866 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_531f36cb82b349d78a8739ba749d0782" } modify_external_catalogs: true
I20260505 20:13:27.264258 7643 tablet_service.cc:1511] Processing CreateTablet for tablet f697fa87e7fe4da0b70bfa42a8818660 (DEFAULT_TABLE table=default.Table_1088b8bf1039442b9962d35ee73ea794 [id=ca6c4e13eead4e5f9bd6003d9024ebd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.264961 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_90124bd7f0774a3ab49bcd90a3ec3733" } modify_external_catalogs: true
I20260505 20:13:27.265137 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_90124bd7f0774a3ab49bcd90a3ec3733" } modify_external_catalogs: true
I20260505 20:13:27.265555 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_71d954d3c76548d5a3c1218e3d906bd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.266141 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71d954d3c76548d5a3c1218e3d906bd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.267385 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5e2133ac533b4b6084978252a3244509" } modify_external_catalogs: true
I20260505 20:13:27.267544 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5e2133ac533b4b6084978252a3244509" } modify_external_catalogs: true
I20260505 20:13:27.273027 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cfe51d65e3714a898d30eb1ee2551e7d" } modify_external_catalogs: true
I20260505 20:13:27.273209 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cfe51d65e3714a898d30eb1ee2551e7d" } modify_external_catalogs: true
I20260505 20:13:27.275043 8058 tablet_bootstrap.cc:492] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.275285 8058 ts_tablet_manager.cc:1403] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.000s
I20260505 20:13:27.276007 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 19720f3a29f34515a952e50f4fec9f97 (DEFAULT_TABLE table=default.Table_6560bac418ea4f8aad5c9a8257e5b261 [id=ff0a7d8e28664804b1db5842a0dd8eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.276182 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet 972b5c40369d41739d8c7a5bca22f04e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.276429 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19720f3a29f34515a952e50f4fec9f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.276567 8058 raft_consensus.cc:359] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.276754 8058 raft_consensus.cc:385] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.276850 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 19720f3a29f34515a952e50f4fec9f97 (DEFAULT_TABLE table=default.Table_6560bac418ea4f8aad5c9a8257e5b261 [id=ff0a7d8e28664804b1db5842a0dd8eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.276844 8058 raft_consensus.cc:740] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.277382 8058 consensus_queue.cc:260] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.278002 8058 ts_tablet_manager.cc:1434] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:27.278299 8058 tablet_bootstrap.cc:492] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.283761 8058 tablet_bootstrap.cc:654] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.284147 7639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec5c094e2bb4a4481825df17becde52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.284703 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d4e198c91c4a0e99d8b798a1dd3433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.285157 7643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f697fa87e7fe4da0b70bfa42a8818660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.285538 7637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.285980 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982da795cf2c4e578f3392066b1cc1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.286013 8052 ts_tablet_manager.cc:1929] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.286144 8052 log.cc:1199] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/99ab400210c54e99bc396674f7ba8235
I20260505 20:13:27.286484 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a3e9d404f14b43ae99c4a905f50086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.286625 8052 ts_tablet_manager.cc:1950] T 99ab400210c54e99bc396674f7ba8235 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.286942 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19720f3a29f34515a952e50f4fec9f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.287408 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.293478 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 99ab400210c54e99bc396674f7ba8235 (table default.Table_aef313ad65fe4481a016b5b6f222270a [id=c00635909bca435eaf43a1e25358fb88]) successfully deleted
I20260505 20:13:27.294193 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 6cf77f6323af4263852853e10003faee from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.294389 8051 ts_tablet_manager.cc:1929] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.294737 8051 log.cc:1199] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/24fc8fb89d614388969b5eff86ba31ca
I20260505 20:13:27.298779 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d74b7092fc2d4c3aa335636b0905e53f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.299419 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d74b7092fc2d4c3aa335636b0905e53f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.301263 7333 master_service.cc:954] ReplaceTablet: received request to replace tablet cdda1cc266cd47c993b5d1a0a78c7df9 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.309854 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_225b81788b06457ba1ad9809609dc97d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.310458 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_225b81788b06457ba1ad9809609dc97d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.311726 8479 tablet.cc:1724] T 9e8d5190032443d4bf6fdb83a34fabd8 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260505 20:13:27.321946 7847 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
W20260505 20:13:27.328809 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet b966b4bbaf9f4774af96051f857f02f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b966b4bbaf9f4774af96051f857f02f7 already in progress: creating tablet
W20260505 20:13:27.329504 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 0112c04befa14c48bb5b2e7dfb60dac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0112c04befa14c48bb5b2e7dfb60dac7 already in progress: creating tablet
W20260505 20:13:27.330106 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 28ce3efe875a43d9b30d40623bf8a385 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28ce3efe875a43d9b30d40623bf8a385 already in progress: creating tablet
I20260505 20:13:27.335532 8052 tablet_replica.cc:333] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.336234 8052 raft_consensus.cc:2243] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.337236 8052 raft_consensus.cc:2272] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.338645 8052 ts_tablet_manager.cc:1916] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.314049 8467 tablet.cc:1724] T 9e8d5190032443d4bf6fdb83a34fabd8 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260505 20:13:27.346180 8051 ts_tablet_manager.cc:1950] T 24fc8fb89d614388969b5eff86ba31ca P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.347637 8051 tablet_replica.cc:333] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.347883 8051 raft_consensus.cc:2243] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.348373 8051 pending_rounds.cc:70] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:27.348551 8051 pending_rounds.cc:77] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737180914987008 op_type: NO_OP noop_request { }
I20260505 20:13:27.348728 8051 raft_consensus.cc:2889] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.348875 8051 raft_consensus.cc:2272] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.349265 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 24fc8fb89d614388969b5eff86ba31ca (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]) successfully deleted
I20260505 20:13:27.349732 8051 ts_tablet_manager.cc:1916] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.317389 8058 tablet_bootstrap.cc:492] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.350205 8058 ts_tablet_manager.cc:1403] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.072s user 0.005s sys 0.002s
I20260505 20:13:27.351150 8058 raft_consensus.cc:359] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.351343 8058 raft_consensus.cc:385] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.351437 8058 raft_consensus.cc:740] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.351694 8058 consensus_queue.cc:260] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.352202 8058 ts_tablet_manager.cc:1434] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:27.352521 8058 tablet_bootstrap.cc:492] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.337976 8079 raft_consensus.cc:493] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.354141 8079 raft_consensus.cc:515] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.354727 8079 leader_election.cc:290] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.356998 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982da795cf2c4e578f3392066b1cc1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.358999 8052 ts_tablet_manager.cc:1929] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.362884 8052 log.cc:1199] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:27.364241 8052 ts_tablet_manager.cc:1950] T 293ea58772bb4b479501d4bf3ead3ba0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.365727 8050 ts_tablet_manager.cc:1950] T ef996218e8b14e3b80eeab3397edec57 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:27.365943 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 293ea58772bb4b479501d4bf3ead3ba0 (table default.Table_08e74268c74d44938d75f8cdbfb18948 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:27.369093 8052 tablet_replica.cc:333] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.370380 8052 raft_consensus.cc:2243] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.370782 8058 tablet_bootstrap.cc:654] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.370474 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7766caea43904162a2c289b7b17405d4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.371958 7802 raft_consensus.cc:2393] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:27.372279 8052 raft_consensus.cc:2272] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.372794 8054 tablet_bootstrap.cc:492] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.374023 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet ef996218e8b14e3b80eeab3397edec57 (table default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]) successfully deleted
W20260505 20:13:27.374421 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 0112c04befa14c48bb5b2e7dfb60dac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0112c04befa14c48bb5b2e7dfb60dac7 already in progress: creating tablet
I20260505 20:13:27.374598 8051 ts_tablet_manager.cc:1929] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.374607 8054 ts_tablet_manager.cc:1403] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.201s user 0.004s sys 0.000s
I20260505 20:13:27.374745 8051 log.cc:1199] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/293ea58772bb4b479501d4bf3ead3ba0
I20260505 20:13:27.374941 8050 tablet_replica.cc:333] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.375180 8051 ts_tablet_manager.cc:1950] T 293ea58772bb4b479501d4bf3ead3ba0 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.375244 7916 tablet_service.cc:1511] Processing CreateTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 (DEFAULT_TABLE table=default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.376196 8052 ts_tablet_manager.cc:1916] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.376577 8050 raft_consensus.cc:2243] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.376785 8050 raft_consensus.cc:2272] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.378505 8050 ts_tablet_manager.cc:1916] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.378674 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7766caea43904162a2c289b7b17405d4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.379799 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d4e198c91c4a0e99d8b798a1dd3433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.385366 7598 leader_election.cc:304] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.385954 8079 raft_consensus.cc:3060] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.386250 8058 tablet_bootstrap.cc:492] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.386435 8058 ts_tablet_manager.cc:1403] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.003s
I20260505 20:13:27.387315 8058 raft_consensus.cc:359] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.387559 8058 raft_consensus.cc:385] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.387630 8058 raft_consensus.cc:740] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.387912 8058 consensus_queue.cc:260] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.388710 8058 ts_tablet_manager.cc:1434] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:27.388893 8079 raft_consensus.cc:2749] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.392804 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 19720f3a29f34515a952e50f4fec9f97 (DEFAULT_TABLE table=default.Table_6560bac418ea4f8aad5c9a8257e5b261 [id=ff0a7d8e28664804b1db5842a0dd8eaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.393337 7906 tablet_service.cc:1511] Processing CreateTablet for tablet f697fa87e7fe4da0b70bfa42a8818660 (DEFAULT_TABLE table=default.Table_1088b8bf1039442b9962d35ee73ea794 [id=ca6c4e13eead4e5f9bd6003d9024ebd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.395077 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19720f3a29f34515a952e50f4fec9f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.401293 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f697fa87e7fe4da0b70bfa42a8818660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.404548 8054 raft_consensus.cc:359] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.407557 8348 consensus_queue.cc:1048] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:27.409315 8054 raft_consensus.cc:385] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.409428 8054 raft_consensus.cc:740] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.409960 8054 consensus_queue.cc:260] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.410471 8054 ts_tablet_manager.cc:1434] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260505 20:13:27.411082 8054 tablet_bootstrap.cc:492] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.412784 8465 tablet.cc:1724] T 9e8d5190032443d4bf6fdb83a34fabd8 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260505 20:13:27.417018 8052 ts_tablet_manager.cc:1929] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.417222 8052 log.cc:1199] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/5b0d6b6035154e01850e7a158ad22dfa
I20260505 20:13:27.417677 8052 ts_tablet_manager.cc:1950] T 5b0d6b6035154e01850e7a158ad22dfa P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.418144 8054 tablet_bootstrap.cc:654] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.423563 8079 raft_consensus.cc:493] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.423815 8079 raft_consensus.cc:515] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.424618 8079 leader_election.cc:290] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.425030 8052 tablet_replica.cc:333] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.425289 8052 raft_consensus.cc:2243] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.425354 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 5b0d6b6035154e01850e7a158ad22dfa (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
I20260505 20:13:27.428479 8052 raft_consensus.cc:2272] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.429241 8052 ts_tablet_manager.cc:1916] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.439126 7709 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:27.439955 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 293ea58772bb4b479501d4bf3ead3ba0 (table default.Table_08e74268c74d44938d75f8cdbfb18948 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:27.440464 8051 tablet_replica.cc:333] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.440659 8051 raft_consensus.cc:2243] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.440820 8051 raft_consensus.cc:2272] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.441354 8051 ts_tablet_manager.cc:1916] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.453166 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 64a82a9d144746338b3fc6550aa35d3c
I20260505 20:13:27.453408 8058 tablet_bootstrap.cc:492] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.453703 7334 catalog_manager.cc:6741] ReplaceTablet: tablet 64a82a9d144746338b3fc6550aa35d3c deleted and replaced by tablet d49e4bb0c885499cbe30f86e15f12989
I20260505 20:13:27.456281 8058 tablet_bootstrap.cc:654] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:27.457062 7596 leader_election.cc:343] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: c95cba502b064583a50fb85ba7dea1b5
W20260505 20:13:27.457938 7598 leader_election.cc:343] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c95cba502b064583a50fb85ba7dea1b5
I20260505 20:13:27.458356 7598 leader_election.cc:304] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.458518 8089 raft_consensus.cc:493] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.458725 8089 raft_consensus.cc:515] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.459540 8089 leader_election.cc:290] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.460481 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:27.461146 7736 leader_election.cc:343] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.461946 8079 raft_consensus.cc:2749] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.464706 8052 ts_tablet_manager.cc:1929] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.464875 8052 log.cc:1199] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/ee3543a2f89f43a8ab938e3585953953
I20260505 20:13:27.465351 8052 ts_tablet_manager.cc:1950] T ee3543a2f89f43a8ab938e3585953953 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.466490 8348 raft_consensus.cc:493] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.471251 8079 raft_consensus.cc:493] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.471642 8079 raft_consensus.cc:515] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.471763 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.472676 8079 leader_election.cc:290] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.473210 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet ee3543a2f89f43a8ab938e3585953953 (table default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]) successfully deleted
I20260505 20:13:27.474139 8051 ts_tablet_manager.cc:1929] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.474309 8051 log.cc:1199] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/ee3543a2f89f43a8ab938e3585953953
I20260505 20:13:27.474563 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2841214f07b4ae6b8cd7e97493b69d6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:27.475183 7596 leader_election.cc:343] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.475849 8051 ts_tablet_manager.cc:1950] T ee3543a2f89f43a8ab938e3585953953 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.476068 8052 tablet_replica.cc:333] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.477125 8051 tablet_replica.cc:333] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.477259 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet ee3543a2f89f43a8ab938e3585953953 (table default.Table_976061a8cd004c20a33f68445f330d0e [id=9a902245cb0d463b9540e1b0dc6a908d]) successfully deleted
I20260505 20:13:27.477481 8052 raft_consensus.cc:2243] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:27.477615 7327 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f41cf3b6cf3a4ef6b7c077f78b793283 because the tablet was not found. No further retry: Not found: Tablet not found: f41cf3b6cf3a4ef6b7c077f78b793283
I20260505 20:13:27.479352 8051 raft_consensus.cc:2243] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.480195 8051 raft_consensus.cc:2272] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.481197 8051 ts_tablet_manager.cc:1916] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.483116 8052 raft_consensus.cc:2272] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.483896 8052 ts_tablet_manager.cc:1916] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.489943 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.490800 8079 raft_consensus.cc:493] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.491096 8079 raft_consensus.cc:515] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:27.493096 7596 leader_election.cc:343] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 5b0d6b6035154e01850e7a158ad22dfa
I20260505 20:13:27.493392 8079 leader_election.cc:290] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.499130 8053 tablet_bootstrap.cc:492] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:27.499334 8053 ts_tablet_manager.cc:1403] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.297s user 0.014s sys 0.031s
I20260505 20:13:27.499329 8052 ts_tablet_manager.cc:1929] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.500483 8052 log.cc:1199] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e80a1674d26c42e5a4884da99ab7918c
I20260505 20:13:27.501147 8052 ts_tablet_manager.cc:1950] T e80a1674d26c42e5a4884da99ab7918c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.501780 7661 raft_consensus.cc:3060] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.500420 8053 raft_consensus.cc:359] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.502197 8053 raft_consensus.cc:385] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.502269 8053 raft_consensus.cc:740] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.502548 8053 consensus_queue.cc:260] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.504005 8053 ts_tablet_manager.cc:1434] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260505 20:13:27.504319 8053 tablet_bootstrap.cc:492] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:27.504642 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e041ebc882b14484a51fe3a6589cddd6
I20260505 20:13:27.505975 8053 tablet_bootstrap.cc:654] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.506551 7338 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (table default.Table_6668622814b7401689dd9dfecee3a8b9 [id=74178f7425164618bd69a1653b75e5d1]). Expected version 6 got 0
I20260505 20:13:27.507153 7341 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 724ffa8b22854c62b4045e69d60de1b2
I20260505 20:13:27.507524 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_acfe8795c2434306851f082e414eedda" } new_table_name: "default.Table_4ea12411a44f4701a2b87ff72c38e8d6" modify_external_catalogs: true
I20260505 20:13:27.508203 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e80a1674d26c42e5a4884da99ab7918c (table default.Table_d533f0e3c58043698845036dc6f256d4 [id=80b8d26bbec14e7c8f1f108dc281077a]) successfully deleted
I20260505 20:13:27.508426 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:27.508466 7326 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c95cba502b064583a50fb85ba7dea1b5 because the tablet was not found. No further retry: Not found: Tablet not found: c95cba502b064583a50fb85ba7dea1b5
I20260505 20:13:27.509895 8089 raft_consensus.cc:493] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.510088 8089 raft_consensus.cc:515] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.510865 8089 leader_election.cc:290] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.511732 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 6ec1037f771740d1a094a622d5e49082
I20260505 20:13:27.512318 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32d3ec040604ce7b384c4b6a202707f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:27.512395 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_50a000f935234ed89d856749b3b17554"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.512944 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50a000f935234ed89d856749b3b17554 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.514132 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 949fecb197084426b5a6adb959f5c886
I20260505 20:13:27.515045 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_adcd07552cd942b8a23b82a71361e1de" } new_table_name: "default.Table_7646d675edc848db9de3a71afeb0633d" modify_external_catalogs: true
W20260505 20:13:27.515683 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 already in progress: creating tablet
I20260505 20:13:27.515897 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 56bd0f4254424c979f90da0400e0ec70
W20260505 20:13:27.515951 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet bd01314146a34257b444a622829b2fe4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd01314146a34257b444a622829b2fe4 already in progress: creating tablet
I20260505 20:13:27.516407 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ec1037f771740d1a094a622d5e49082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.516518 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet cdda1cc266cd47c993b5d1a0a78c7df9
I20260505 20:13:27.516624 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.516563 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b9ccf3e9460f4ba28802602c516ab4af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.517045 7333 catalog_manager.cc:6741] ReplaceTablet: tablet cdda1cc266cd47c993b5d1a0a78c7df9 deleted and replaced by tablet f2b2e40635b141c59d3789aca81efba7
W20260505 20:13:27.517117 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9ccf3e9460f4ba28802602c516ab4af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.517462 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1723474623814100ab3a108f22e1d775" } new_table_name: "default.Table_673d30b70e044e20b54300c4b5670ecb" modify_external_catalogs: true
W20260505 20:13:27.517824 7736 leader_election.cc:343] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.519060 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_07cd2eeb8ed74e90ac630e511f01ccb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.519605 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07cd2eeb8ed74e90ac630e511f01ccb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.521273 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cfd1ed72bf61489999a9ce28da492f92" } new_table_name: "default.Table_4dda980af4a44fb3b08d9845bc9a4c2f" modify_external_catalogs: true
I20260505 20:13:27.522177 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.522433 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:27.523967 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 46088us
I20260505 20:13:27.526211 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.526140 8348 raft_consensus.cc:515] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.527069 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ec1037f771740d1a094a622d5e49082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.527472 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_36c89c315bed4e668607a8f215ce43bb" } new_table_name: "default.Table_2cdd70905bf04e9da6c310c3df99d628" modify_external_catalogs: true
I20260505 20:13:27.527845 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.528611 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.529418 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.531661 8058 tablet_bootstrap.cc:492] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.531793 8058 ts_tablet_manager.cc:1403] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.085s user 0.007s sys 0.007s
I20260505 20:13:27.533259 8058 raft_consensus.cc:359] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.533492 8058 raft_consensus.cc:385] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.533584 8058 raft_consensus.cc:740] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.534009 8058 consensus_queue.cc:260] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.534539 8058 ts_tablet_manager.cc:1434] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:27.534825 8058 tablet_bootstrap.cc:492] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:27.538026 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2841214f07b4ae6b8cd7e97493b69d6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.540333 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b5c40369d41739d8c7a5bca22f04e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:27.540539 7662 raft_consensus.cc:2468] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:27.541026 7870 leader_election.cc:304] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.543175 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.546373 7334 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_6668622814b7401689dd9dfecee3a8b9 [id=74178f7425164618bd69a1653b75e5d1] alter complete (version 6)
I20260505 20:13:27.546955 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_59e5c20b026c4ceb9e6452635dffc57f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.548684 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet 64a82a9d144746338b3fc6550aa35d3c from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:27.549674 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48cce2fd271641ad83c9b3e4beeb12ee consensus state has no leader
I20260505 20:13:27.549958 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 0d5ed062508b411eb0fa5a14637830ea from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:27.551736 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50680deff6fe4dcabbf5a3aeb47ac01e consensus state has no leader
I20260505 20:13:27.552078 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_66c5be236e674e1fb1666d4ed27efc85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.553059 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43a3e9d404f14b43ae99c4a905f50086 consensus state has no leader
I20260505 20:13:27.553402 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b1105189a66e41bdb0025fcdfdb95313"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.554678 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_30eb9a9bb910469a805041e2341c0a4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.555481 8348 leader_election.cc:290] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:27.558264 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59e5c20b026c4ceb9e6452635dffc57f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:27.560473 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 6cf77f6323af4263852853e10003faee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf77f6323af4263852853e10003faee already in progress: creating tablet
W20260505 20:13:27.563891 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1105189a66e41bdb0025fcdfdb95313 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:27.565107 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66c5be236e674e1fb1666d4ed27efc85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.565490 8058 tablet_bootstrap.cc:654] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:27.566304 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30eb9a9bb910469a805041e2341c0a4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.569944 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.567518 8507 consensus_queue.cc:1048] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260505 20:13:27.574591 8052 tablet_replica.cc:333] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
W20260505 20:13:27.574698 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f62626fb4f8445e3a6e2822277181762 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62626fb4f8445e3a6e2822277181762 already in progress: creating tablet
I20260505 20:13:27.574864 8052 raft_consensus.cc:2243] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.575165 8052 pending_rounds.cc:70] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:27.575137 8348 raft_consensus.cc:2804] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260505 20:13:27.576623 7598 leader_election.cc:343] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 5b0d6b6035154e01850e7a158ad22dfa
I20260505 20:13:27.576792 7598 leader_election.cc:304] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.577109 8079 raft_consensus.cc:2749] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:27.577293 7598 leader_election.cc:343] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.577435 7598 leader_election.cc:304] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.577679 8079 raft_consensus.cc:2749] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.577888 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.578209 8348 raft_consensus.cc:493] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.578351 8348 raft_consensus.cc:3060] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.581684 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ec1037f771740d1a094a622d5e49082 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.582043 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.582218 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.583072 8079 raft_consensus.cc:493] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.583228 8079 raft_consensus.cc:515] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.583920 8079 leader_election.cc:290] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.584137 8052 pending_rounds.cc:77] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737181327749120 op_type: NO_OP noop_request { }
I20260505 20:13:27.584316 8052 raft_consensus.cc:2889] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.584448 8052 raft_consensus.cc:2272] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.584726 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef996218e8b14e3b80eeab3397edec57" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.584973 7802 raft_consensus.cc:2468] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:27.585455 7596 leader_election.cc:304] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.585707 8050 ts_tablet_manager.cc:1929] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.585777 8079 raft_consensus.cc:2804] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.585889 8079 raft_consensus.cc:493] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.586006 8079 raft_consensus.cc:3060] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.586012 8050 log.cc:1199] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/6cf77f6323af4263852853e10003faee
I20260505 20:13:27.586525 8050 ts_tablet_manager.cc:1950] T 6cf77f6323af4263852853e10003faee P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:27.588675 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 096ca710e3564d4b8db50f29dd56a5d4 consensus state has no leader
I20260505 20:13:27.589771 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 8f1505e592e543cca92d8949bdae007e from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:27.589733 7598 leader_election.cc:343] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: ef996218e8b14e3b80eeab3397edec57
I20260505 20:13:27.590072 8079 raft_consensus.cc:515] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.590449 8051 ts_tablet_manager.cc:1929] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.590484 7337 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:27.590588 8051 log.cc:1199] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c95cba502b064583a50fb85ba7dea1b5
I20260505 20:13:27.590999 8051 ts_tablet_manager.cc:1950] T c95cba502b064583a50fb85ba7dea1b5 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.591069 8079 leader_election.cc:290] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.591782 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef996218e8b14e3b80eeab3397edec57" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:27.591941 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet e17b17089792450bbc4dba372076af9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.592000 7802 raft_consensus.cc:3060] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.593364 8051 tablet_replica.cc:333] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.593607 8051 raft_consensus.cc:2243] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.593859 8051 raft_consensus.cc:2272] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.594887 7802 raft_consensus.cc:2468] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:27.594997 8051 ts_tablet_manager.cc:1916] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:27.595170 7598 leader_election.cc:343] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: ef996218e8b14e3b80eeab3397edec57
I20260505 20:13:27.595384 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 6cf77f6323af4263852853e10003faee (table default.Table_813570fe84494402989524e1939f8ae7 [id=a5182c95fa7443dbb6f5eeea64a90764]) successfully deleted
W20260505 20:13:27.595636 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bd01314146a34257b444a622829b2fe4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd01314146a34257b444a622829b2fe4 already in progress: creating tablet
I20260505 20:13:27.595714 7596 leader_election.cc:304] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
W20260505 20:13:27.595827 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet ee3543a2f89f43a8ab938e3585953953 because the tablet was not found. No further retry: Not found: Tablet not found: ee3543a2f89f43a8ab938e3585953953
I20260505 20:13:27.596006 8079 raft_consensus.cc:2804] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:27.596057 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 already in progress: creating tablet
I20260505 20:13:27.596341 8079 raft_consensus.cc:697] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:27.596635 8079 consensus_queue.cc:237] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.602041 8050 tablet_replica.cc:333] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.602355 8050 raft_consensus.cc:2243] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.602581 8050 raft_consensus.cc:2272] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.603233 8050 ts_tablet_manager.cc:1916] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.605535 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c95cba502b064583a50fb85ba7dea1b5 (table default.Table_528b585197824127a1f24d4f16e3f840 [id=e4f40ca8f6ce4601b2066218fd09cff5]) successfully deleted
W20260505 20:13:27.606005 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 already in progress: creating tablet
W20260505 20:13:27.606320 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 6cf77f6323af4263852853e10003faee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf77f6323af4263852853e10003faee already in progress: creating tablet
W20260505 20:13:27.606570 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 0112c04befa14c48bb5b2e7dfb60dac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0112c04befa14c48bb5b2e7dfb60dac7 already in progress: creating tablet
W20260505 20:13:27.606770 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet bd01314146a34257b444a622829b2fe4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd01314146a34257b444a622829b2fe4 already in progress: creating tablet
W20260505 20:13:27.607054 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b966b4bbaf9f4774af96051f857f02f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b966b4bbaf9f4774af96051f857f02f7 already in progress: creating tablet
W20260505 20:13:27.607329 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 28ce3efe875a43d9b30d40623bf8a385 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28ce3efe875a43d9b30d40623bf8a385 already in progress: creating tablet
I20260505 20:13:27.607570 8052 ts_tablet_manager.cc:1916] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.614754 8058 tablet_bootstrap.cc:492] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.614957 8058 ts_tablet_manager.cc:1403] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.003s
I20260505 20:13:27.615830 8058 raft_consensus.cc:359] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.616040 8058 raft_consensus.cc:385] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.616117 8058 raft_consensus.cc:740] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.618927 8472 raft_consensus.cc:493] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.619127 8472 raft_consensus.cc:515] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.619835 8472 leader_election.cc:290] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:27.622485 7596 leader_election.cc:343] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:27.622987 8058 consensus_queue.cc:260] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.623719 8058 ts_tablet_manager.cc:1434] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260505 20:13:27.624096 8058 tablet_bootstrap.cc:492] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:27.625934 7598 leader_election.cc:343] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:27.626091 7598 leader_election.cc:304] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.625988 8348 raft_consensus.cc:515] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.626529 8472 raft_consensus.cc:2749] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.625937 8058 tablet_bootstrap.cc:654] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.626821 8348 leader_election.cc:290] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.640467 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.641189 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32d3ec040604ce7b384c4b6a202707f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.641388 7937 raft_consensus.cc:2468] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:27.642309 7737 leader_election.cc:343] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.642494 7737 leader_election.cc:304] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:27.642604 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b5c40369d41739d8c7a5bca22f04e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.642834 7802 raft_consensus.cc:2468] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:27.642947 7737 leader_election.cc:304] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:27.643496 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b5c40369d41739d8c7a5bca22f04e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:27.643707 7800 raft_consensus.cc:3060] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.643980 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 972b5c40369d41739d8c7a5bca22f04e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.644265 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet e17b17089792450bbc4dba372076af9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.645087 8054 tablet_bootstrap.cc:492] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.645373 8054 ts_tablet_manager.cc:1403] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.235s user 0.010s sys 0.005s
I20260505 20:13:27.645862 8490 raft_consensus.cc:2749] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.646124 8490 raft_consensus.cc:2804] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.646243 8490 raft_consensus.cc:493] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.646339 8490 raft_consensus.cc:3060] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.646477 8054 raft_consensus.cc:359] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.646705 8054 raft_consensus.cc:385] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.646826 8054 raft_consensus.cc:740] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.647115 8054 consensus_queue.cc:260] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.647538 8052 ts_tablet_manager.cc:1929] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.647612 7333 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:27.647662 8054 ts_tablet_manager.cc:1434] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:27.647958 8054 tablet_bootstrap.cc:492] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.649068 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet a1f5bfa086f9422ebda96b2485ad986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.649485 8490 raft_consensus.cc:515] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.651125 7800 raft_consensus.cc:2468] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
W20260505 20:13:27.651532 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 110569us
I20260505 20:13:27.651971 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32d3ec040604ce7b384c4b6a202707f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:27.652405 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b5c40369d41739d8c7a5bca22f04e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:27.652598 7663 raft_consensus.cc:3060] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:27.652621 7736 leader_election.cc:343] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.652940 8490 leader_election.cc:290] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.653287 8052 log.cc:1199] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/aa6589a0f15d4f31acc2e49e6c071e6a
I20260505 20:13:27.653709 8052 ts_tablet_manager.cc:1950] T aa6589a0f15d4f31acc2e49e6c071e6a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.654165 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32d3ec040604ce7b384c4b6a202707f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:27.654268 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.654392 7937 raft_consensus.cc:3060] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.655457 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet aa6589a0f15d4f31acc2e49e6c071e6a (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:27.656219 7663 raft_consensus.cc:2468] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:27.656903 8079 raft_consensus.cc:493] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.657080 8079 raft_consensus.cc:515] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:27.657171 7937 raft_consensus.cc:2468] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:27.657886 8079 leader_election.cc:290] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.658366 8051 ts_tablet_manager.cc:1929] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.658536 8051 log.cc:1199] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/5b0d6b6035154e01850e7a158ad22dfa
I20260505 20:13:27.658631 7870 leader_election.cc:304] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:27.658849 7598 leader_election.cc:343] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 862e865d406c4d95b97b579e9fe07df0
I20260505 20:13:27.659034 8051 ts_tablet_manager.cc:1950] T 5b0d6b6035154e01850e7a158ad22dfa P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.659282 8443 raft_consensus.cc:2804] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.660193 8443 raft_consensus.cc:697] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:27.660442 8443 consensus_queue.cc:237] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:27.661026 7596 leader_election.cc:343] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 862e865d406c4d95b97b579e9fe07df0
I20260505 20:13:27.661164 7596 leader_election.cc:304] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.662881 7737 leader_election.cc:304] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:27.663239 8490 raft_consensus.cc:2804] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.664844 8490 raft_consensus.cc:697] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:27.665264 8490 consensus_queue.cc:237] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.667994 8052 tablet_replica.cc:333] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.671370 8052 raft_consensus.cc:2243] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.659584 8051 tablet_replica.cc:333] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.672683 8079 raft_consensus.cc:2749] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.676523 8467 tablet.cc:1724] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:27.677466 8052 raft_consensus.cc:2272] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.677699 8051 raft_consensus.cc:2243] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.678125 8051 raft_consensus.cc:2272] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.681042 8050 ts_tablet_manager.cc:1929] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.681185 8050 log.cc:1199] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e80a1674d26c42e5a4884da99ab7918c
I20260505 20:13:27.681617 8050 ts_tablet_manager.cc:1950] T e80a1674d26c42e5a4884da99ab7918c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:27.682282 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e80a1674d26c42e5a4884da99ab7918c (table default.Table_d533f0e3c58043698845036dc6f256d4 [id=80b8d26bbec14e7c8f1f108dc281077a]) successfully deleted
I20260505 20:13:27.683285 8052 ts_tablet_manager.cc:1916] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.683985 8054 tablet_bootstrap.cc:654] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.674932 8053 tablet_bootstrap.cc:492] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:27.685696 8053 ts_tablet_manager.cc:1403] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.181s user 0.003s sys 0.002s
I20260505 20:13:27.686551 8512 raft_consensus.cc:493] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.686780 8050 tablet_replica.cc:333] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.686753 8512 raft_consensus.cc:515] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.686808 8053 raft_consensus.cc:359] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.687034 8050 raft_consensus.cc:2243] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.687044 8053 raft_consensus.cc:385] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.687139 8053 raft_consensus.cc:740] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.687208 8050 raft_consensus.cc:2272] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.687415 8053 consensus_queue.cc:260] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.687659 8512 leader_election.cc:290] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.688468 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17b17089792450bbc4dba372076af9a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.688671 7800 raft_consensus.cc:2468] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:27.689208 7869 leader_election.cc:304] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:27.689589 8512 raft_consensus.cc:2804] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.689718 8054 tablet_bootstrap.cc:492] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.693156 8054 ts_tablet_manager.cc:1403] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260505 20:13:27.693276 8512 raft_consensus.cc:493] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.688112 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17b17089792450bbc4dba372076af9a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:27.694016 7661 raft_consensus.cc:2468] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:27.695343 8051 ts_tablet_manager.cc:1916] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.704816 8079 raft_consensus.cc:493] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.705008 8079 raft_consensus.cc:515] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.705596 8079 leader_election.cc:290] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.710369 8053 ts_tablet_manager.cc:1434] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260505 20:13:27.710780 8053 tablet_bootstrap.cc:492] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:27.713138 8053 tablet_bootstrap.cc:654] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.714622 8479 tablet.cc:1724] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:27.715051 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591290e4ddf4bcc9d4676a2618a346c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:27.715312 7800 raft_consensus.cc:2393] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:27.717376 8050 ts_tablet_manager.cc:1916] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.721228 8467 tablet.cc:1724] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:27.728121 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_75b399df34af49b78ee0de07fcdc0991" } modify_external_catalogs: true
I20260505 20:13:27.728400 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_75b399df34af49b78ee0de07fcdc0991" } modify_external_catalogs: true
I20260505 20:13:27.730173 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974" } modify_external_catalogs: true
I20260505 20:13:27.730329 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974" } modify_external_catalogs: true
I20260505 20:13:27.730811 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f694abaae6f4ded97efb1bba5f767bc" } modify_external_catalogs: true
I20260505 20:13:27.730962 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_0f694abaae6f4ded97efb1bba5f767bc" } modify_external_catalogs: true
I20260505 20:13:27.733615 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6071ca6b55a24946bfa133a951d84705" } modify_external_catalogs: true
I20260505 20:13:27.734010 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9be38cc8ceb7408d9d7853cba373f215"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.734601 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9be38cc8ceb7408d9d7853cba373f215 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.735286 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6071ca6b55a24946bfa133a951d84705" } modify_external_catalogs: true
I20260505 20:13:27.737156 8052 ts_tablet_manager.cc:1929] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.737385 8052 log.cc:1199] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/a1f5bfa086f9422ebda96b2485ad986b
I20260505 20:13:27.737972 8052 ts_tablet_manager.cc:1950] T a1f5bfa086f9422ebda96b2485ad986b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:27.740588 8512 raft_consensus.cc:3060] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.740718 8051 ts_tablet_manager.cc:1929] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.740890 8051 log.cc:1199] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/99ab400210c54e99bc396674f7ba8235
I20260505 20:13:27.741325 8051 ts_tablet_manager.cc:1950] T 99ab400210c54e99bc396674f7ba8235 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:27.742743 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7591290e4ddf4bcc9d4676a2618a346c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.744514 7598 leader_election.cc:304] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:27.745024 8465 tablet.cc:1724] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:27.747821 8079 raft_consensus.cc:3060] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.749418 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_96a76218de254fee8498ed283135bbbf" } modify_external_catalogs: true
I20260505 20:13:27.749621 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_96a76218de254fee8498ed283135bbbf" } modify_external_catalogs: true
I20260505 20:13:27.751488 8079 raft_consensus.cc:2749] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:27.751508 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 74a5d442f25242ea8371fca8643f4ce6
I20260505 20:13:27.752589 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 71bfd96314244e6cbbb4d5b48841e06f (DEFAULT_TABLE table=default.Table_efe2580fbb5b4113b2ba4580914aacc4 [id=3392dc17dfb345459b94ec7f28fb17b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.756111 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bfd96314244e6cbbb4d5b48841e06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.757892 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 99ab400210c54e99bc396674f7ba8235 (table default.Table_aef313ad65fe4481a016b5b6f222270a [id=c00635909bca435eaf43a1e25358fb88]) successfully deleted
W20260505 20:13:27.758129 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f62626fb4f8445e3a6e2822277181762 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62626fb4f8445e3a6e2822277181762 already in progress: creating tablet
I20260505 20:13:27.759028 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.759341 8053 tablet_bootstrap.cc:492] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:27.759509 8053 ts_tablet_manager.cc:1403] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
W20260505 20:13:27.759543 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.752584 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 436489e0e72945f689ebd653804e7723 (DEFAULT_TABLE table=default.Table_bc0ac75d0a8d46caa8026d33f784689d [id=81cca356ac0a4576af3226017a09f6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.753919 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 74a5d442f25242ea8371fca8643f4ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.760311 8053 raft_consensus.cc:359] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.760717 8053 raft_consensus.cc:385] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.760793 8053 raft_consensus.cc:740] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.761435 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 436489e0e72945f689ebd653804e7723 (DEFAULT_TABLE table=default.Table_bc0ac75d0a8d46caa8026d33f784689d [id=81cca356ac0a4576af3226017a09f6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.761868 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436489e0e72945f689ebd653804e7723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.762257 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 74a5d442f25242ea8371fca8643f4ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.762912 8053 consensus_queue.cc:260] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.763055 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 71bfd96314244e6cbbb4d5b48841e06f (DEFAULT_TABLE table=default.Table_efe2580fbb5b4113b2ba4580914aacc4 [id=3392dc17dfb345459b94ec7f28fb17b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.763396 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bfd96314244e6cbbb4d5b48841e06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.763499 8053 ts_tablet_manager.cc:1434] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260505 20:13:27.763558 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5497df41ba46cc9228c0debd18551b (DEFAULT_TABLE table=default.Table_a5f6228ca6384c5b88cd9242e5d25334 [id=74c243106f024592ac3c7ad007a462e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.763645 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6d8507ea845641ba9e0d0f6228317e2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.763834 8053 tablet_bootstrap.cc:492] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:27.763940 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5497df41ba46cc9228c0debd18551b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:27.764156 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d8507ea845641ba9e0d0f6228317e2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.766513 8053 tablet_bootstrap.cc:654] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.767208 7333 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:27.767860 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 67c582e419f746b28530c0971fede09f (DEFAULT_TABLE table=default.Table_9875a3e2f0d444018fb87797fd4bcde6 [id=0b04ae6c921741049ea506fe8323865c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.768224 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c582e419f746b28530c0971fede09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.768559 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5b66f4e343e14116ab2dc0b7ebce74c1" } new_table_name: "default.Table_cfbc6470d8d34b93a3d1434dfa9df8cf" modify_external_catalogs: true
I20260505 20:13:27.769110 7917 tablet_service.cc:1511] Processing CreateTablet for tablet b9f684cd880b4a748cab49795de11503 (DEFAULT_TABLE table=default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.769433 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f684cd880b4a748cab49795de11503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.770197 7900 tablet_service.cc:1511] Processing CreateTablet for tablet dc1323c894d742909e2add9b8f7e2577 (DEFAULT_TABLE table=default.Table_a62884f24a7b450e86c9ec17c75bd041 [id=01f0244c225b47459ca461d8b3c0bde3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.770313 7773 tablet_service.cc:1511] Processing CreateTablet for tablet dc1323c894d742909e2add9b8f7e2577 (DEFAULT_TABLE table=default.Table_a62884f24a7b450e86c9ec17c75bd041 [id=01f0244c225b47459ca461d8b3c0bde3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.770387 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 67c582e419f746b28530c0971fede09f (DEFAULT_TABLE table=default.Table_9875a3e2f0d444018fb87797fd4bcde6 [id=0b04ae6c921741049ea506fe8323865c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.770514 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1323c894d742909e2add9b8f7e2577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.770658 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1323c894d742909e2add9b8f7e2577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.770978 7782 tablet_service.cc:1511] Processing CreateTablet for tablet b9f684cd880b4a748cab49795de11503 (DEFAULT_TABLE table=default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.771319 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f684cd880b4a748cab49795de11503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.771893 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5497df41ba46cc9228c0debd18551b (DEFAULT_TABLE table=default.Table_a5f6228ca6384c5b88cd9242e5d25334 [id=74c243106f024592ac3c7ad007a462e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.772224 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5497df41ba46cc9228c0debd18551b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.772274 7766 tablet_service.cc:1511] Processing CreateTablet for tablet c720fc66db36402a83a7690d70a40353 (DEFAULT_TABLE table=default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.772584 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c720fc66db36402a83a7690d70a40353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.775919 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c582e419f746b28530c0971fede09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.781446 8054 raft_consensus.cc:359] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.781699 8054 raft_consensus.cc:385] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.781813 8054 raft_consensus.cc:740] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.782065 8054 consensus_queue.cc:260] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.782577 8054 ts_tablet_manager.cc:1434] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.089s user 0.002s sys 0.000s
I20260505 20:13:27.782965 8054 tablet_bootstrap.cc:492] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.784627 7768 tablet_service.cc:1511] Processing CreateTablet for tablet c278b516135b47ee96ed61b1ae595f9a (DEFAULT_TABLE table=default.Table_6da35009030241e0a1be14d63f55bcd7 [id=e15ceb414ab94d7a9f3faca77320faf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.785009 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c278b516135b47ee96ed61b1ae595f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.786131 8054 tablet_bootstrap.cc:654] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.787343 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 0d5ed062508b411eb0fa5a14637830ea
I20260505 20:13:27.787777 7341 catalog_manager.cc:6741] ReplaceTablet: tablet 0d5ed062508b411eb0fa5a14637830ea deleted and replaced by tablet f2b0dd5d7870453bb1b771405daeb22f
I20260505 20:13:27.789598 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_71c89ce7dcda42769625f9694e5923e2" } new_table_name: "default.Table_81e65112cd9f427cad2c364792f117bf" modify_external_catalogs: true
I20260505 20:13:27.789995 7338 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_2cdd70905bf04e9da6c310c3df99d628 [id=25578717c43d40dfb1999130c1208d98] alter complete (version 2)
I20260505 20:13:27.790539 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bd78ac7f2b9041e1b06f223b4585712d" } new_table_name: "default.Table_7ddae9d794cb4fc8bdd97ec5db7a246c" modify_external_catalogs: true
I20260505 20:13:27.794495 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e69bdfc75a494635837178cb16c08c1c
I20260505 20:13:27.794821 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 2faf7c64c3c340ceb8c87e416a32a7ed (DEFAULT_TABLE table=default.Table_d35a015103974aae8ba25b644b320d5e [id=6d62e1270ed54b76aaff276b11d04c2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.795392 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2faf7c64c3c340ceb8c87e416a32a7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.796809 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.797358 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.800386 7909 tablet_service.cc:1511] Processing CreateTablet for tablet c278b516135b47ee96ed61b1ae595f9a (DEFAULT_TABLE table=default.Table_6da35009030241e0a1be14d63f55bcd7 [id=e15ceb414ab94d7a9f3faca77320faf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.800930 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c278b516135b47ee96ed61b1ae595f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.801143 7905 tablet_service.cc:1511] Processing CreateTablet for tablet d138d27f444f45d28acdc7d72a9649f5 (DEFAULT_TABLE table=default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.801556 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d138d27f444f45d28acdc7d72a9649f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.806119 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 1218bd76239540be9a93ca455ba3eb47 (DEFAULT_TABLE table=default.Table_5b66f4e343e14116ab2dc0b7ebce74c1 [id=813ff9cab8554a79a0b9b5a01f63127c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.806381 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 (DEFAULT_TABLE table=default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.806530 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1218bd76239540be9a93ca455ba3eb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.806778 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.807116 7907 tablet_service.cc:1511] Processing CreateTablet for tablet b393bfc209b6461aab958ebf49014d25 (DEFAULT_TABLE table=default.Table_51597b5bf7d34471a1f178b73c3fd20d [id=fd2ae4ccfffd4eb5b7aa1bb5e0613015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.807483 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b393bfc209b6461aab958ebf49014d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.809710 7902 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bdfc75a494635837178cb16c08c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.809900 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.810267 7915 tablet_service.cc:1511] Processing CreateTablet for tablet bcd289ce979940ae96554d5756d140d7 (DEFAULT_TABLE table=default.Table_471e002676d8465fb3a2af7b858cd2c0 [id=3fa488eaad8a4777bfb3ff65aa8b15f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.810664 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd289ce979940ae96554d5756d140d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.806133 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 2faf7c64c3c340ceb8c87e416a32a7ed (DEFAULT_TABLE table=default.Table_d35a015103974aae8ba25b644b320d5e [id=6d62e1270ed54b76aaff276b11d04c2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.814731 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2faf7c64c3c340ceb8c87e416a32a7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.817986 7901 tablet_service.cc:1511] Processing CreateTablet for tablet c720fc66db36402a83a7690d70a40353 (DEFAULT_TABLE table=default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.818383 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c720fc66db36402a83a7690d70a40353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.822672 8512 raft_consensus.cc:515] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.823685 7766 tablet_service.cc:1511] Processing CreateTablet for tablet d138d27f444f45d28acdc7d72a9649f5 (DEFAULT_TABLE table=default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.824697 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d138d27f444f45d28acdc7d72a9649f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.823347 8512 leader_election.cc:290] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.831808 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8f1505e592e543cca92d8949bdae007e
I20260505 20:13:27.832309 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 8f1505e592e543cca92d8949bdae007e deleted and replaced by tablet 5b3595eb9b1144d9b802f1f563d01461
I20260505 20:13:27.832528 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 8f1505e592e543cca92d8949bdae007e from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.833069 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet 8e650b297603425184ad97ddf99ec36d from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.752684 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 436489e0e72945f689ebd653804e7723 (DEFAULT_TABLE table=default.Table_bc0ac75d0a8d46caa8026d33f784689d [id=81cca356ac0a4576af3226017a09f6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.752905 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet 74a5d442f25242ea8371fca8643f4ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.833591 7637 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bdfc75a494635837178cb16c08c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.752701 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 71bfd96314244e6cbbb4d5b48841e06f (DEFAULT_TABLE table=default.Table_efe2580fbb5b4113b2ba4580914aacc4 [id=3392dc17dfb345459b94ec7f28fb17b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.834299 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet d138d27f444f45d28acdc7d72a9649f5
I20260505 20:13:27.834944 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bba6c3da778b48e99f89f01110a160da" } new_table_name: "default.Table_809c498b516844ba9571d7f1e7b17e05" modify_external_catalogs: true
I20260505 20:13:27.756796 8051 tablet_replica.cc:333] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:27.757228 7630 tablet_service.cc:1558] Processing DeleteTablet for tablet ef996218e8b14e3b80eeab3397edec57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.757395 7639 tablet_service.cc:1558] Processing DeleteTablet for tablet e17b17089792450bbc4dba372076af9a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.757536 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet 7591290e4ddf4bcc9d4676a2618a346c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.761605 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5497df41ba46cc9228c0debd18551b (DEFAULT_TABLE table=default.Table_a5f6228ca6384c5b88cd9242e5d25334 [id=74c243106f024592ac3c7ad007a462e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.762693 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 67c582e419f746b28530c0971fede09f (DEFAULT_TABLE table=default.Table_9875a3e2f0d444018fb87797fd4bcde6 [id=0b04ae6c921741049ea506fe8323865c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.764573 7635 tablet_service.cc:1511] Processing CreateTablet for tablet b9f684cd880b4a748cab49795de11503 (DEFAULT_TABLE table=default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.766145 7640 tablet_service.cc:1511] Processing CreateTablet for tablet dc1323c894d742909e2add9b8f7e2577 (DEFAULT_TABLE table=default.Table_a62884f24a7b450e86c9ec17c75bd041 [id=01f0244c225b47459ca461d8b3c0bde3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.767490 7642 tablet_service.cc:1511] Processing CreateTablet for tablet c720fc66db36402a83a7690d70a40353 (DEFAULT_TABLE table=default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.771258 7634 tablet_service.cc:1511] Processing CreateTablet for tablet d138d27f444f45d28acdc7d72a9649f5 (DEFAULT_TABLE table=default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.771466 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet a1f5bfa086f9422ebda96b2485ad986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.783989 7641 tablet_service.cc:1511] Processing CreateTablet for tablet c278b516135b47ee96ed61b1ae595f9a (DEFAULT_TABLE table=default.Table_6da35009030241e0a1be14d63f55bcd7 [id=e15ceb414ab94d7a9f3faca77320faf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.793476 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.793963 7628 tablet_service.cc:1511] Processing CreateTablet for tablet b393bfc209b6461aab958ebf49014d25 (DEFAULT_TABLE table=default.Table_51597b5bf7d34471a1f178b73c3fd20d [id=fd2ae4ccfffd4eb5b7aa1bb5e0613015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.794028 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 (DEFAULT_TABLE table=default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.794148 7626 tablet_service.cc:1511] Processing CreateTablet for tablet bcd289ce979940ae96554d5756d140d7 (DEFAULT_TABLE table=default.Table_471e002676d8465fb3a2af7b858cd2c0 [id=3fa488eaad8a4777bfb3ff65aa8b15f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.794319 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 1218bd76239540be9a93ca455ba3eb47 (DEFAULT_TABLE table=default.Table_5b66f4e343e14116ab2dc0b7ebce74c1 [id=813ff9cab8554a79a0b9b5a01f63127c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.794658 7629 tablet_service.cc:1511] Processing CreateTablet for tablet 2faf7c64c3c340ceb8c87e416a32a7ed (DEFAULT_TABLE table=default.Table_d35a015103974aae8ba25b644b320d5e [id=6d62e1270ed54b76aaff276b11d04c2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.823930 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17b17089792450bbc4dba372076af9a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:27.837579 7664 raft_consensus.cc:3060] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.840325 7664 raft_consensus.cc:2468] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:27.840855 7870 leader_election.cc:304] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.841410 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f1505e592e543cca92d8949bdae007e with delete_type TABLET_DATA_DELETED (replaced by tablet 5b3595eb9b1144d9b802f1f563d01461) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.842485 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436489e0e72945f689ebd653804e7723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.844995 8512 raft_consensus.cc:2804] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.846635 8512 raft_consensus.cc:697] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:27.847059 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bfd96314244e6cbbb4d5b48841e06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.847179 8512 consensus_queue.cc:237] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.845233 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.840855 8050 ts_tablet_manager.cc:1929] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.848258 8050 log.cc:1199] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f32d3ec040604ce7b384c4b6a202707f
I20260505 20:13:27.848802 8050 ts_tablet_manager.cc:1950] T f32d3ec040604ce7b384c4b6a202707f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:27.849359 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f32d3ec040604ce7b384c4b6a202707f (table default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]) successfully deleted
I20260505 20:13:27.850893 8050 tablet_replica.cc:333] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.851044 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5497df41ba46cc9228c0debd18551b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.851177 8050 raft_consensus.cc:2243] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.851430 8050 pending_rounds.cc:70] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:27.851493 8050 pending_rounds.cc:77] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737182104231936 op_type: NO_OP noop_request { }
I20260505 20:13:27.851617 8050 raft_consensus.cc:2889] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.851707 8054 tablet_bootstrap.cc:492] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.851727 8050 raft_consensus.cc:2272] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.851858 8054 ts_tablet_manager.cc:1403] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.000s
I20260505 20:13:27.852562 8050 ts_tablet_manager.cc:1916] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.852705 8054 raft_consensus.cc:359] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.852864 8054 raft_consensus.cc:385] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.852963 8054 raft_consensus.cc:740] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.853163 8054 consensus_queue.cc:260] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.853667 8054 ts_tablet_manager.cc:1434] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:27.853976 8054 tablet_bootstrap.cc:492] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.854043 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c582e419f746b28530c0971fede09f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:27.854319 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b966b4bbaf9f4774af96051f857f02f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b966b4bbaf9f4774af96051f857f02f7 already in progress: creating tablet
W20260505 20:13:27.854597 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 28ce3efe875a43d9b30d40623bf8a385 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28ce3efe875a43d9b30d40623bf8a385 already in progress: creating tablet
I20260505 20:13:27.855724 8054 tablet_bootstrap.cc:654] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.856159 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9f684cd880b4a748cab49795de11503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.856914 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436489e0e72945f689ebd653804e7723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.857046 8052 tablet_replica.cc:333] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:27.857247 8052 raft_consensus.cc:2243] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:27.857555 8052 pending_rounds.cc:70] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:27.857648 8052 pending_rounds.cc:77] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737183400935424 op_type: NO_OP noop_request { }
I20260505 20:13:27.857784 8052 raft_consensus.cc:2889] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.857909 8052 raft_consensus.cc:2272] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.862298 7640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1323c894d742909e2add9b8f7e2577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.866230 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c720fc66db36402a83a7690d70a40353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.869666 8054 tablet_bootstrap.cc:492] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.869897 8054 ts_tablet_manager.cc:1403] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260505 20:13:27.870617 8054 raft_consensus.cc:359] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.870803 8054 raft_consensus.cc:385] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.870878 8054 raft_consensus.cc:740] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.871107 8054 consensus_queue.cc:260] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.871512 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d138d27f444f45d28acdc7d72a9649f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.871592 8054 ts_tablet_manager.cc:1434] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:27.871647 8339 raft_consensus.cc:493] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.871794 8339 raft_consensus.cc:515] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.871935 8054 tablet_bootstrap.cc:492] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.872473 8339 leader_election.cc:290] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.873513 8054 tablet_bootstrap.cc:654] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.873994 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c278b516135b47ee96ed61b1ae595f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.878079 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b393bfc209b6461aab958ebf49014d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.882182 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.883150 8447 raft_consensus.cc:493] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.883299 8447 raft_consensus.cc:515] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.884001 8447 leader_election.cc:290] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:27.886113 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd289ce979940ae96554d5756d140d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.886914 8054 tablet_bootstrap.cc:492] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.887064 8054 ts_tablet_manager.cc:1403] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20260505 20:13:27.887919 8054 raft_consensus.cc:359] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.888115 8054 raft_consensus.cc:385] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.888197 8054 raft_consensus.cc:740] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.888448 8054 consensus_queue.cc:260] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.889012 8054 ts_tablet_manager.cc:1434] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:27.889313 8054 tablet_bootstrap.cc:492] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.889916 8050 ts_tablet_manager.cc:1929] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:27.890072 8050 log.cc:1199] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/7591290e4ddf4bcc9d4676a2618a346c
I20260505 20:13:27.891140 8054 tablet_bootstrap.cc:654] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.901722 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 with delete_type TABLET_DATA_DELETED (replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.901882 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 (DEFAULT_TABLE table=default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.902310 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bdfc75a494635837178cb16c08c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.902390 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.902738 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f1505e592e543cca92d8949bdae007e with delete_type TABLET_DATA_DELETED (replaced by tablet 5b3595eb9b1144d9b802f1f563d01461) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.903155 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.903434 7781 tablet_service.cc:1511] Processing CreateTablet for tablet b393bfc209b6461aab958ebf49014d25 (DEFAULT_TABLE table=default.Table_51597b5bf7d34471a1f178b73c3fd20d [id=fd2ae4ccfffd4eb5b7aa1bb5e0613015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.903846 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b393bfc209b6461aab958ebf49014d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.905926 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:27.906344 7782 tablet_service.cc:1511] Processing CreateTablet for tablet bcd289ce979940ae96554d5756d140d7 (DEFAULT_TABLE table=default.Table_471e002676d8465fb3a2af7b858cd2c0 [id=3fa488eaad8a4777bfb3ff65aa8b15f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.906724 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd289ce979940ae96554d5756d140d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.907116 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2841214f07b4ae6b8cd7e97493b69d6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:27.907333 7936 raft_consensus.cc:2468] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:27.908080 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17b17089792450bbc4dba372076af9a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:27.908262 7800 raft_consensus.cc:3060] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.908516 7737 leader_election.cc:304] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:27.908856 8339 raft_consensus.cc:2804] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:27.908991 8339 raft_consensus.cc:493] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:27.909096 8339 raft_consensus.cc:3060] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.910403 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet c720fc66db36402a83a7690d70a40353
I20260505 20:13:27.911902 7800 raft_consensus.cc:2468] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:27.911999 8339 raft_consensus.cc:515] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.912763 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_51597b5bf7d34471a1f178b73c3fd20d" } new_table_name: "default.Table_1dd7483dde8948a787cb771f42d23f8e" modify_external_catalogs: true
I20260505 20:13:27.912886 8339 leader_election.cc:290] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.913455 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1218bd76239540be9a93ca455ba3eb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.914247 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7ddda7425d0f44d18fe52b4af466e35c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.914757 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ddda7425d0f44d18fe52b4af466e35c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.916611 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet a1f5bfa086f9422ebda96b2485ad986b (table default.Table_381e5521f71b4d388d6643fb24a3bc27 [id=6606be420f5c424f93d731dfa574a5e7]) successfully deleted
I20260505 20:13:27.919545 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1037f771740d1a094a622d5e49082" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:27.921108 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1218bd76239540be9a93ca455ba3eb47 consensus state has no leader
I20260505 20:13:27.921926 7643 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.922220 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2841214f07b4ae6b8cd7e97493b69d6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:27.922449 7663 raft_consensus.cc:2468] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:27.923373 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6407eb94904a4c3db461964a5e97fe89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.923592 8051 raft_consensus.cc:2243] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
W20260505 20:13:27.924001 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6407eb94904a4c3db461964a5e97fe89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.925251 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f1505e592e543cca92d8949bdae007e with delete_type TABLET_DATA_DELETED (replaced by tablet 5b3595eb9b1144d9b802f1f563d01461) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:27.925305 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e6da3130e724445b0d1f3c20e4e3d02 consensus state has no leader
I20260505 20:13:27.925634 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1954f3a3b7034c16b51824755e5e357f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.926177 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1954f3a3b7034c16b51824755e5e357f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:27.927409 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22a98da176254eeb896c680fbcb98caa consensus state has no leader
I20260505 20:13:27.927738 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_33086fdd5d3f4ab18212456f90b13f8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.928249 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33086fdd5d3f4ab18212456f90b13f8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.929678 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_af907934b9fa4624acbd348b39f0920b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.929575 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1037f771740d1a094a622d5e49082" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:27.929821 8050 ts_tablet_manager.cc:1950] T 7591290e4ddf4bcc9d4676a2618a346c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:27.930153 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af907934b9fa4624acbd348b39f0920b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:27.930341 7870 leader_election.cc:343] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.930732 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.930998 8050 tablet_replica.cc:333] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:27.931072 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2841214f07b4ae6b8cd7e97493b69d6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:27.931182 8050 raft_consensus.cc:2243] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:27.931243 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8e650b297603425184ad97ddf99ec36d
I20260505 20:13:27.931258 7663 raft_consensus.cc:3060] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.931356 8050 raft_consensus.cc:2272] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.931726 7339 catalog_manager.cc:6741] ReplaceTablet: tablet 8e650b297603425184ad97ddf99ec36d deleted and replaced by tablet f0ca8cc557674992b88f3379cc1db652
I20260505 20:13:27.932041 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b16013449c77418dba5ba880d82d08d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:27.932368 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2faf7c64c3c340ceb8c87e416a32a7ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:27.932555 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b16013449c77418dba5ba880d82d08d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.932833 8050 ts_tablet_manager.cc:1916] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:27.933712 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 089517a7c2214dce9367b21beb555733 consensus state has no leader
I20260505 20:13:27.934401 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 7591290e4ddf4bcc9d4676a2618a346c (table default.Table_3f93bb9d891e4ac6b582689068819e21 [id=def2b4e333d84128b44c8d912afef0a6]) successfully deleted
I20260505 20:13:27.903162 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 1218bd76239540be9a93ca455ba3eb47 (DEFAULT_TABLE table=default.Table_5b66f4e343e14116ab2dc0b7ebce74c1 [id=813ff9cab8554a79a0b9b5a01f63127c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:27.934791 8051 pending_rounds.cc:70] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:27.934765 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e650b297603425184ad97ddf99ec36d with delete_type TABLET_DATA_DELETED (replaced by tablet f0ca8cc557674992b88f3379cc1db652) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.935087 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1218bd76239540be9a93ca455ba3eb47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:27.936110 8054 tablet_bootstrap.cc:492] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.936276 8054 ts_tablet_manager.cc:1403] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.012s
I20260505 20:13:27.937124 8054 raft_consensus.cc:359] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.937307 8054 raft_consensus.cc:385] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.937373 8054 raft_consensus.cc:740] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.937594 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e650b297603425184ad97ddf99ec36d with delete_type TABLET_DATA_DELETED (replaced by tablet f0ca8cc557674992b88f3379cc1db652) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.937595 8054 consensus_queue.cc:260] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.938094 8054 ts_tablet_manager.cc:1434] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:27.940325 8051 pending_rounds.cc:77] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737180904411136 op_type: NO_OP noop_request { }
I20260505 20:13:27.944065 8339 raft_consensus.cc:493] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:27.944245 8339 raft_consensus.cc:515] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.945106 8339 leader_election.cc:290] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:27.945833 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 7214ab77d7904f0e9d37cb8d7a5a53a4
I20260505 20:13:27.948117 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:27.948549 8054 tablet_bootstrap.cc:492] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:27.949522 8051 raft_consensus.cc:2889] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:27.949668 8051 raft_consensus.cc:2272] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:27.950496 8054 tablet_bootstrap.cc:654] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:27.953438 8058 tablet_bootstrap.cc:492] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:27.955528 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f86a888c5e4fb3acbd78f68c81576f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:27.956996 7736 leader_election.cc:343] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:27.957536 8058 ts_tablet_manager.cc:1403] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.330s user 0.008s sys 0.036s
I20260505 20:13:27.960915 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_070bf3473ab74c31b33db173e8f39d20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:27.961573 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_070bf3473ab74c31b33db173e8f39d20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:27.962107 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:27.964349 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_98748ee269264963be11b33de38e1d1e" } modify_external_catalogs: true
I20260505 20:13:27.964592 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_98748ee269264963be11b33de38e1d1e" } modify_external_catalogs: true
I20260505 20:13:27.976090 7663 raft_consensus.cc:2468] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:27.976632 7736 leader_election.cc:304] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:27.978979 8339 raft_consensus.cc:2804] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:27.980203 8339 raft_consensus.cc:697] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:27.980515 8339 consensus_queue.cc:237] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.982041 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ed44127b4c848bf9ed4a49ad8b106fb from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:27.983165 8051 ts_tablet_manager.cc:1916] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:27.983919 8058 raft_consensus.cc:359] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.984200 8058 raft_consensus.cc:385] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.987084 8054 tablet_bootstrap.cc:492] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:27.987262 8054 ts_tablet_manager.cc:1403] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.006s
I20260505 20:13:27.988128 8054 raft_consensus.cc:359] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.988356 8054 raft_consensus.cc:385] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:27.988461 8054 raft_consensus.cc:740] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.990625 8050 ts_tablet_manager.cc:1929] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:27.990720 8054 consensus_queue.cc:260] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.990830 8050 log.cc:1199] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/aa6589a0f15d4f31acc2e49e6c071e6a
I20260505 20:13:27.991371 8054 ts_tablet_manager.cc:1434] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:27.992029 8058 raft_consensus.cc:740] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:27.992419 7982 heartbeater.cc:344] Connected to a master server at 127.7.33.252:42521
I20260505 20:13:27.992455 8058 consensus_queue.cc:260] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:27.993148 8050 ts_tablet_manager.cc:1950] T aa6589a0f15d4f31acc2e49e6c071e6a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:27.995306 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 86840.6us
I20260505 20:13:27.996569 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2841214f07b4ae6b8cd7e97493b69d6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:27.996762 7936 raft_consensus.cc:3060] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:27.999665 7936 raft_consensus.cc:2468] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:28.000276 8050 tablet_replica.cc:333] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:28.000517 8050 raft_consensus.cc:2243] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.000694 8050 raft_consensus.cc:2272] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:28.000881 7869 leader_election.cc:343] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.001024 7869 leader_election.cc:304] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:28.001201 7869 raft_consensus.cc:2686] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:28.001691 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet aa6589a0f15d4f31acc2e49e6c071e6a (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
W20260505 20:13:28.002023 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 64a82a9d144746338b3fc6550aa35d3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a82a9d144746338b3fc6550aa35d3c already in progress: creating tablet
I20260505 20:13:28.002007 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f86a888c5e4fb3acbd78f68c81576f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:28.002199 7936 raft_consensus.cc:2468] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:28.002271 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e041ebc882b14484a51fe3a6589cddd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e041ebc882b14484a51fe3a6589cddd6 already in progress: creating tablet
W20260505 20:13:28.002494 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet cdda1cc266cd47c993b5d1a0a78c7df9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdda1cc266cd47c993b5d1a0a78c7df9 already in progress: creating tablet
I20260505 20:13:28.002979 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.003204 8054 tablet_bootstrap.cc:492] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:28.008327 8054 tablet_bootstrap.cc:654] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.011333 8058 ts_tablet_manager.cc:1434] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.054s user 0.001s sys 0.001s
I20260505 20:13:28.011646 8058 tablet_bootstrap.cc:492] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:28.028146 8050 ts_tablet_manager.cc:1916] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.034139 8052 ts_tablet_manager.cc:1916] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.037829 8512 raft_consensus.cc:493] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.038057 8512 raft_consensus.cc:515] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.038355 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.038584 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.038815 8512 leader_election.cc:290] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.039474 8058 tablet_bootstrap.cc:654] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.039736 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f5bfa086f9422ebda96b2485ad986b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.040086 7663 raft_consensus.cc:2468] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:28.040495 8050 ts_tablet_manager.cc:1929] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.040884 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e650b297603425184ad97ddf99ec36d with delete_type TABLET_DATA_DELETED (replaced by tablet f0ca8cc557674992b88f3379cc1db652) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.041302 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.043306 8053 tablet_bootstrap.cc:492] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:28.044056 7737 leader_election.cc:304] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.047159 8490 raft_consensus.cc:2804] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.047271 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_30eb9a9bb910469a805041e2341c0a4f" } modify_external_catalogs: true
I20260505 20:13:28.047488 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_30eb9a9bb910469a805041e2341c0a4f" } modify_external_catalogs: true
I20260505 20:13:28.047850 8490 raft_consensus.cc:493] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.047953 8490 raft_consensus.cc:3060] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.048384 8053 ts_tablet_manager.cc:1403] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.283s user 0.005s sys 0.001s
I20260505 20:13:28.048960 8051 ts_tablet_manager.cc:1929] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.049109 8051 log.cc:1199] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e80a1674d26c42e5a4884da99ab7918c
I20260505 20:13:28.049510 8051 ts_tablet_manager.cc:1950] T e80a1674d26c42e5a4884da99ab7918c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:28.050583 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_c3df4da03c5b4917b507a2945a453705 [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 2 got 0
I20260505 20:13:28.051892 8490 raft_consensus.cc:515] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.052619 8490 leader_election.cc:290] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.052942 8053 raft_consensus.cc:359] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.053086 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f86a888c5e4fb3acbd78f68c81576f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:28.053249 8053 raft_consensus.cc:385] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.053265 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e80a1674d26c42e5a4884da99ab7918c (table default.Table_d533f0e3c58043698845036dc6f256d4 [id=80b8d26bbec14e7c8f1f108dc281077a]) successfully deleted
I20260505 20:13:28.053437 8053 raft_consensus.cc:740] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.053774 8053 consensus_queue.cc:260] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:28.054121 7736 leader_election.cc:343] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.055202 7628 tablet_service.cc:1511] Processing CreateTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 (DEFAULT_TABLE table=default.Table_30eb9a9bb910469a805041e2341c0a4f [id=f7354a061d874fa293e746426a9fd9c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.055637 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ed7c0220d147c7853c7afc1ef09607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.056397 7636 tablet_service.cc:1511] Processing CreateTablet for tablet ee19f65120184eca9495513b68440b4f (DEFAULT_TABLE table=default.Table_b1105189a66e41bdb0025fcdfdb95313 [id=08ec5e3e61a646439d9cce426e601d16]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:28.056557 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b393bfc209b6461aab958ebf49014d25 consensus state has no leader
I20260505 20:13:28.056883 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 35ada922a36f4f329a5ff8b328dbef5f (DEFAULT_TABLE table=default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.057056 7335 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:28.057286 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ada922a36f4f329a5ff8b328dbef5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.040867 7870 leader_election.cc:304] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:28.059792 7869 leader_election.cc:343] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: a1f5bfa086f9422ebda96b2485ad986b
I20260505 20:13:28.060153 8050 log.cc:1199] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/6ec1037f771740d1a094a622d5e49082
I20260505 20:13:28.060532 8512 raft_consensus.cc:2804] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.060590 8050 ts_tablet_manager.cc:1950] T 6ec1037f771740d1a094a622d5e49082 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:28.060635 8512 raft_consensus.cc:493] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.060758 8512 raft_consensus.cc:3060] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.061986 8050 tablet_replica.cc:333] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:28.061893 7766 tablet_service.cc:1511] Processing CreateTablet for tablet ee19f65120184eca9495513b68440b4f (DEFAULT_TABLE table=default.Table_b1105189a66e41bdb0025fcdfdb95313 [id=08ec5e3e61a646439d9cce426e601d16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.062181 8050 raft_consensus.cc:2243] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:28.062348 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee19f65120184eca9495513b68440b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.062449 8050 pending_rounds.cc:70] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:28.062521 8050 pending_rounds.cc:77] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737183380332544 op_type: NO_OP noop_request { }
I20260505 20:13:28.062666 8050 raft_consensus.cc:2889] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:28.062772 8050 raft_consensus.cc:2272] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.063635 8512 raft_consensus.cc:515] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.064339 7781 tablet_service.cc:1511] Processing CreateTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 (DEFAULT_TABLE table=default.Table_30eb9a9bb910469a805041e2341c0a4f [id=f7354a061d874fa293e746426a9fd9c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.064608 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b6ed7c0220d147c7853c7afc1ef09607
I20260505 20:13:28.064749 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ed7c0220d147c7853c7afc1ef09607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.065244 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 54becbd4690c403e803a7a79f12cb6d5
I20260505 20:13:28.067277 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 6ec1037f771740d1a094a622d5e49082 (table default.Table_efe81e982113463b9ff4f04403f0bac7 [id=c946f532ba074386ac47a7bacd2feeea]) successfully deleted
I20260505 20:13:28.069234 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f5bfa086f9422ebda96b2485ad986b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:28.069295 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 949fecb197084426b5a6adb959f5c886 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949fecb197084426b5a6adb959f5c886 already in progress: creating tablet
I20260505 20:13:28.069443 7663 raft_consensus.cc:3060] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:28.069550 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 56bd0f4254424c979f90da0400e0ec70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56bd0f4254424c979f90da0400e0ec70 already in progress: creating tablet
I20260505 20:13:28.070501 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.070757 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.071046 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f86a888c5e4fb3acbd78f68c81576f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:28.071353 7936 raft_consensus.cc:3060] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.072288 7663 raft_consensus.cc:2468] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:28.073669 7870 leader_election.cc:304] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:28.073987 8447 raft_consensus.cc:2804] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:28.074134 8447 raft_consensus.cc:697] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:28.074371 8447 consensus_queue.cc:237] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.075490 7340 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:28.075870 8512 leader_election.cc:290] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.076786 7936 raft_consensus.cc:2468] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:28.080169 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 2540ed5144664ec0bfe0b548a5386176 (DEFAULT_TABLE table=default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.054777 7915 tablet_service.cc:1511] Processing CreateTablet for tablet ee19f65120184eca9495513b68440b4f (DEFAULT_TABLE table=default.Table_b1105189a66e41bdb0025fcdfdb95313 [id=08ec5e3e61a646439d9cce426e601d16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.080667 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2540ed5144664ec0bfe0b548a5386176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.055419 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 2540ed5144664ec0bfe0b548a5386176 (DEFAULT_TABLE table=default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.055661 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.081024 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2540ed5144664ec0bfe0b548a5386176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.082149 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 2540ed5144664ec0bfe0b548a5386176 (DEFAULT_TABLE table=default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.082276 7737 leader_election.cc:304] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.082564 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2540ed5144664ec0bfe0b548a5386176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.082564 8490 raft_consensus.cc:2804] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:28.082778 8490 raft_consensus.cc:697] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:28.083077 8490 consensus_queue.cc:237] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.055837 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet d2841214f07b4ae6b8cd7e97493b69d6 with delete_type TABLET_DATA_DELETED (replaced by tablet a0d4e198c91c4a0e99d8b798a1dd3433) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.078449 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.078842 7914 tablet_service.cc:1511] Processing CreateTablet for tablet d3cd1b7b0456462a80d653dd442589a6 (DEFAULT_TABLE table=default.Table_50a000f935234ed89d856749b3b17554 [id=59ac3e5d44d149d4b3a35726a6d6aa4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.037815 8054 tablet_bootstrap.cc:492] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:28.086300 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cd1b7b0456462a80d653dd442589a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.086367 8054 ts_tablet_manager.cc:1403] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.011s
I20260505 20:13:28.086386 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.086611 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.087787 7781 tablet_service.cc:1511] Processing CreateTablet for tablet d3cd1b7b0456462a80d653dd442589a6 (DEFAULT_TABLE table=default.Table_50a000f935234ed89d856749b3b17554 [id=59ac3e5d44d149d4b3a35726a6d6aa4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.088266 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cd1b7b0456462a80d653dd442589a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.079133 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet a026a8408ed9462b820b560a98dcabd1 with delete_type TABLET_DATA_DELETED (replaced by tablet ea726cff03664c3d81b5e541ef738d4a) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.090106 8054 raft_consensus.cc:359] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.090293 8054 raft_consensus.cc:385] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.090369 8054 raft_consensus.cc:740] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.090631 8054 consensus_queue.cc:260] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.091207 8054 ts_tablet_manager.cc:1434] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
W20260505 20:13:28.091671 8430 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 2401207823080987553) tablet 00000000000000000000000000000000 cur holder 0x617000051300
I20260505 20:13:28.091851 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 2b64242395794797aaf7a52ba40e0c60 (DEFAULT_TABLE table=default.Table_66c5be236e674e1fb1666d4ed27efc85 [id=f27aae881c8b472080e441818f79d153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.092267 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b64242395794797aaf7a52ba40e0c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.092677 7626 tablet_service.cc:1511] Processing CreateTablet for tablet 2b64242395794797aaf7a52ba40e0c60 (DEFAULT_TABLE table=default.Table_66c5be236e674e1fb1666d4ed27efc85 [id=f27aae881c8b472080e441818f79d153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.093865 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.094491 7641 tablet_service.cc:1511] Processing CreateTablet for tablet f2b0dd5d7870453bb1b771405daeb22f (DEFAULT_TABLE table=default.Table_60314b7c9136475184b40323c1985237 [id=633565e251844b0aa66147472deee05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.094534 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 7447c40ad6914e75a1b1376213218624 (DEFAULT_TABLE table=default.Table_07cd2eeb8ed74e90ac630e511f01ccb5 [id=758c5b8d77d649beb11a2d8a3d40e1e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.094904 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7447c40ad6914e75a1b1376213218624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.094904 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b0dd5d7870453bb1b771405daeb22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.096117 8054 tablet_bootstrap.cc:492] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:28.096370 7912 tablet_service.cc:1511] Processing CreateTablet for tablet b53f88d2e8b34b69bd12f53b046ed4de (DEFAULT_TABLE table=default.Table_b9ccf3e9460f4ba28802602c516ab4af [id=2935a29adff5403aab513a78d1a7faac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.096760 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53f88d2e8b34b69bd12f53b046ed4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.097975 8054 tablet_bootstrap.cc:654] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.098392 7782 tablet_service.cc:1511] Processing CreateTablet for tablet b53f88d2e8b34b69bd12f53b046ed4de (DEFAULT_TABLE table=default.Table_b9ccf3e9460f4ba28802602c516ab4af [id=2935a29adff5403aab513a78d1a7faac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.098778 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53f88d2e8b34b69bd12f53b046ed4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.100896 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5a45becc03e84424944683d29051a244" } modify_external_catalogs: true
I20260505 20:13:28.101104 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5a45becc03e84424944683d29051a244" } modify_external_catalogs: true
I20260505 20:13:28.101171 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 7447c40ad6914e75a1b1376213218624 (DEFAULT_TABLE table=default.Table_07cd2eeb8ed74e90ac630e511f01ccb5 [id=758c5b8d77d649beb11a2d8a3d40e1e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.101678 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7447c40ad6914e75a1b1376213218624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.102281 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 2b64242395794797aaf7a52ba40e0c60 (DEFAULT_TABLE table=default.Table_66c5be236e674e1fb1666d4ed27efc85 [id=f27aae881c8b472080e441818f79d153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.102663 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b64242395794797aaf7a52ba40e0c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.103001 7773 tablet_service.cc:1511] Processing CreateTablet for tablet f2b0dd5d7870453bb1b771405daeb22f (DEFAULT_TABLE table=default.Table_60314b7c9136475184b40323c1985237 [id=633565e251844b0aa66147472deee05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.103431 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b0dd5d7870453bb1b771405daeb22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.103583 7642 tablet_service.cc:1511] Processing CreateTablet for tablet d49e4bb0c885499cbe30f86e15f12989 (DEFAULT_TABLE table=default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 [id=48be793440d142f287ca28d23b4f996a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.104172 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49e4bb0c885499cbe30f86e15f12989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.108405 7767 tablet_service.cc:1511] Processing CreateTablet for tablet f2b2e40635b141c59d3789aca81efba7 (DEFAULT_TABLE table=default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.108850 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b2e40635b141c59d3789aca81efba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.108812 7633 tablet_service.cc:1511] Processing CreateTablet for tablet d3cd1b7b0456462a80d653dd442589a6 (DEFAULT_TABLE table=default.Table_50a000f935234ed89d856749b3b17554 [id=59ac3e5d44d149d4b3a35726a6d6aa4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.109398 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cd1b7b0456462a80d653dd442589a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:28.112860 8532 log.cc:927] Time spent T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260505 20:13:28.113219 8079 raft_consensus.cc:493] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.113369 8079 raft_consensus.cc:515] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.113783 8053 ts_tablet_manager.cc:1434] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.065s user 0.001s sys 0.001s
I20260505 20:13:28.113848 7644 tablet_service.cc:1511] Processing CreateTablet for tablet 004a8e72cab44d31af3369b8df1e434e (DEFAULT_TABLE table=default.Table_d74b7092fc2d4c3aa335636b0905e53f [id=bc7111d081dd4f4ba06f987ca0b9d6a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.114120 8053 tablet_bootstrap.cc:492] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:28.114105 8079 leader_election.cc:290] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.114248 7644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 004a8e72cab44d31af3369b8df1e434e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.114971 8050 ts_tablet_manager.cc:1916] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.118191 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8754580368453aa0aae021d8c665da (DEFAULT_TABLE table=default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.119668 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 9f91a58d306e4dd7ab515498aa6ab32b (DEFAULT_TABLE table=default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.120141 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8754580368453aa0aae021d8c665da (DEFAULT_TABLE table=default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.120549 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8754580368453aa0aae021d8c665da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.121572 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 004a8e72cab44d31af3369b8df1e434e (DEFAULT_TABLE table=default.Table_d74b7092fc2d4c3aa335636b0905e53f [id=bc7111d081dd4f4ba06f987ca0b9d6a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.122359 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8754580368453aa0aae021d8c665da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.122613 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 004a8e72cab44d31af3369b8df1e434e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.123414 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f91a58d306e4dd7ab515498aa6ab32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.125046 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1cb712b418b54251b43b1e21df07376e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.125854 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb712b418b54251b43b1e21df07376e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.129510 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d74b7092fc2d4c3aa335636b0905e53f" } modify_external_catalogs: true
I20260505 20:13:28.129695 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d74b7092fc2d4c3aa335636b0905e53f" } modify_external_catalogs: true
I20260505 20:13:28.131121 8053 tablet_bootstrap.cc:654] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.133890 7334 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
W20260505 20:13:28.135229 7869 leader_election.cc:343] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: a1f5bfa086f9422ebda96b2485ad986b
I20260505 20:13:28.135476 7640 tablet_service.cc:1511] Processing CreateTablet for tablet 9f91a58d306e4dd7ab515498aa6ab32b (DEFAULT_TABLE table=default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.136129 7640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f91a58d306e4dd7ab515498aa6ab32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.136564 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_cc693952864d4827804cf959c57b2435"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.137177 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc693952864d4827804cf959c57b2435 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.137130 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6da35009030241e0a1be14d63f55bcd7" } new_table_name: "default.Table_7b6a139d5f9b4d20a41265ef5910a4ef" modify_external_catalogs: true
I20260505 20:13:28.137550 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_776d125a74a244a89a055dcff3489919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.138114 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_776d125a74a244a89a055dcff3489919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.138332 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_50a000f935234ed89d856749b3b17554" } new_table_name: "default.Table_5dcf10cdc4bc4312b75088ac10f28253" modify_external_catalogs: true
I20260505 20:13:28.138425 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3e927ca3870e46dfac9020afe0c894e5" } new_table_name: "default.Table_d3355f0e778c4b8d86fe948da69b1976" modify_external_catalogs: true
I20260505 20:13:28.138665 7336 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b16013449c77418dba5ba880d82d08d4" } new_table_name: "default.Table_20042b0bea294bc1ad99439fa62373da" modify_external_catalogs: true
I20260505 20:13:28.146941 7775 tablet_service.cc:1511] Processing CreateTablet for tablet d49e4bb0c885499cbe30f86e15f12989 (DEFAULT_TABLE table=default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 [id=48be793440d142f287ca28d23b4f996a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.147428 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49e4bb0c885499cbe30f86e15f12989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.153276 7631 tablet_service.cc:1511] Processing CreateTablet for tablet f2b2e40635b141c59d3789aca81efba7 (DEFAULT_TABLE table=default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.153760 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b2e40635b141c59d3789aca81efba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.154850 7917 tablet_service.cc:1511] Processing CreateTablet for tablet f2b0dd5d7870453bb1b771405daeb22f (DEFAULT_TABLE table=default.Table_60314b7c9136475184b40323c1985237 [id=633565e251844b0aa66147472deee05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.155290 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b0dd5d7870453bb1b771405daeb22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.156606 7908 tablet_service.cc:1511] Processing CreateTablet for tablet f2b2e40635b141c59d3789aca81efba7 (DEFAULT_TABLE table=default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.156976 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b2e40635b141c59d3789aca81efba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.156989 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6de073da4783421daab1910cc27d67f7" } modify_external_catalogs: true
I20260505 20:13:28.157179 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6de073da4783421daab1910cc27d67f7" } modify_external_catalogs: true
I20260505 20:13:28.158077 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8754580368453aa0aae021d8c665da (DEFAULT_TABLE table=default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.158457 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8754580368453aa0aae021d8c665da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.158583 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 004a8e72cab44d31af3369b8df1e434e (DEFAULT_TABLE table=default.Table_d74b7092fc2d4c3aa335636b0905e53f [id=bc7111d081dd4f4ba06f987ca0b9d6a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.158924 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 004a8e72cab44d31af3369b8df1e434e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.162027 7907 tablet_service.cc:1511] Processing CreateTablet for tablet d49e4bb0c885499cbe30f86e15f12989 (DEFAULT_TABLE table=default.Table_3bc5f620994f44e1b9c8ac44f7bd3618 [id=48be793440d142f287ca28d23b4f996a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.162248 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 9f91a58d306e4dd7ab515498aa6ab32b (DEFAULT_TABLE table=default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.162415 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.162917 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b64242395794797aaf7a52ba40e0c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.163256 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.163475 7801 raft_consensus.cc:2468] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:28.164208 7596 leader_election.cc:304] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:28.134107 8052 ts_tablet_manager.cc:1929] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.164700 8052 log.cc:1199] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f32d3ec040604ce7b384c4b6a202707f
I20260505 20:13:28.165133 8052 ts_tablet_manager.cc:1950] T f32d3ec040604ce7b384c4b6a202707f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:28.165616 8052 tablet_replica.cc:333] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:28.165858 8052 raft_consensus.cc:2243] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.166041 8052 raft_consensus.cc:2272] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.166054 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:28.166456 8079 raft_consensus.cc:2804] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.166580 8079 raft_consensus.cc:493] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.166601 8052 ts_tablet_manager.cc:1916] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:28.166664 7598 leader_election.cc:343] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.166716 8079 raft_consensus.cc:3060] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.168392 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 7447c40ad6914e75a1b1376213218624 (DEFAULT_TABLE table=default.Table_07cd2eeb8ed74e90ac630e511f01ccb5 [id=758c5b8d77d649beb11a2d8a3d40e1e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.168907 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7447c40ad6914e75a1b1376213218624. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:28.170114 7336 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6c5c661e8aa4962bb9922b9ead7d784 has no consensus state
I20260505 20:13:28.170181 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f32d3ec040604ce7b384c4b6a202707f (table default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]) successfully deleted
W20260505 20:13:28.170838 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3cd1b7b0456462a80d653dd442589a6 consensus state has no leader
I20260505 20:13:28.172312 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_28a64c3b83d5413c8d946d129380d5a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.173909 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8cc3cc188c8c40d1ac809b3372dca56e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.174157 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28a64c3b83d5413c8d946d129380d5a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:28.174400 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cc3cc188c8c40d1ac809b3372dca56e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.174769 7909 tablet_service.cc:1511] Processing CreateTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 (DEFAULT_TABLE table=default.Table_30eb9a9bb910469a805041e2341c0a4f [id=f7354a061d874fa293e746426a9fd9c4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:28.175472 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c278b516135b47ee96ed61b1ae595f9a consensus state has no leader
I20260505 20:13:28.175843 7911 tablet_service.cc:1511] Processing CreateTablet for tablet 35ada922a36f4f329a5ff8b328dbef5f (DEFAULT_TABLE table=default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.176100 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b1cc6dc2f825478ba2c3ae76861bfb50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.176581 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1cc6dc2f825478ba2c3ae76861bfb50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.176983 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_18b6a5de2149454d876ffde71ee2f43e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.177480 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18b6a5de2149454d876ffde71ee2f43e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.178735 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6d292d45d5d24556b062b5b0fd05a0b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.179201 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d292d45d5d24556b062b5b0fd05a0b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.180084 8079 raft_consensus.cc:515] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.183017 8512 raft_consensus.cc:493] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.183280 8512 raft_consensus.cc:515] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.184547 8512 leader_election.cc:290] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.186872 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f91a58d306e4dd7ab515498aa6ab32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.188593 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ed7c0220d147c7853c7afc1ef09607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.189329 7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ada922a36f4f329a5ff8b328dbef5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.190009 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49e4bb0c885499cbe30f86e15f12989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.191114 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee19f65120184eca9495513b68440b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.206936 8058 tablet_bootstrap.cc:492] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:28.210438 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f2b2e40635b141c59d3789aca81efba7
I20260505 20:13:28.214771 8052 ts_tablet_manager.cc:1929] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.215827 8051 tablet_replica.cc:333] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:28.215986 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.216076 8051 raft_consensus.cc:2243] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.224870 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet 28ce3efe875a43d9b30d40623bf8a385 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.226027 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet b9f684cd880b4a748cab49795de11503 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.227581 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee19f65120184eca9495513b68440b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.232018 8501 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:28.232271 8501 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:28.236055 8051 raft_consensus.cc:2272] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.236590 8433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73028cd481e446daa9432a35522a7967. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:28.236899 8433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:28.237547 8501 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:28.238072 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
W20260505 20:13:28.254768 7329 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 4939dab5a4d54a08a75424bcaabbb8dd (table default.Table_08e74268c74d44938d75f8cdbfb18948 [id=37c852c9b0b446da97b614a5df0187f0], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4939dab5a4d54a08a75424bcaabbb8dd consensus state has no leader
I20260505 20:13:28.259727 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_aa8a97db5d1e46a2afbe7ceeb00c1538"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.261492 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa8a97db5d1e46a2afbe7ceeb00c1538 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.264117 8545 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260505 20:13:28.264544 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_453aeb092a0040998c34044a79fbecfc" } new_table_name: "default.Table_1612c41337614a9c9edcd92892fd1c68" modify_external_catalogs: true
I20260505 20:13:28.216821 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.217149 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:28.265693 7638 tablet_service.cc:1511] Processing CreateTablet for tablet b53f88d2e8b34b69bd12f53b046ed4de (DEFAULT_TABLE table=default.Table_b9ccf3e9460f4ba28802602c516ab4af [id=2935a29adff5403aab513a78d1a7faac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.266075 7800 raft_consensus.cc:3060] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.267081 8052 log.cc:1199] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/7591290e4ddf4bcc9d4676a2618a346c
I20260505 20:13:28.267602 8052 ts_tablet_manager.cc:1950] T 7591290e4ddf4bcc9d4676a2618a346c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:28.268054 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 340) took 1058 ms. Trace:
I20260505 20:13:28.219316 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923ed274fe454cc4a625516769e6b5f3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.269306 7801 raft_consensus.cc:2468] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:28.270263 8079 leader_election.cc:290] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.269726 7800 raft_consensus.cc:2468] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:28.270278 7598 leader_election.cc:343] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.273386 7339 master_service.cc:954] ReplaceTablet: received request to replace tablet d138d27f444f45d28acdc7d72a9649f5 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.274044 8058 ts_tablet_manager.cc:1403] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.196s user 0.002s sys 0.002s
I20260505 20:13:28.268203 8052 rpcz_store.cc:276] 0505 20:13:27.209719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.211146 (+ 1427us) service_pool.cc:224] Handling call
0505 20:13:28.165555 (+954409us) ts_tablet_manager.cc:1151] Deleting tablet 7591290e4ddf4bcc9d4676a2618a346c
0505 20:13:28.165563 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.169597 (+ 4034us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.214689 (+ 45092us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.267980 (+ 53291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954209}
I20260505 20:13:28.278750 8051 ts_tablet_manager.cc:1916] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.279167 8052 tablet_replica.cc:333] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:28.280133 8322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 0) took 1462 ms. Trace:
I20260505 20:13:28.280743 8052 raft_consensus.cc:2243] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.282480 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f3fcc55304b0403ba6e8e01eaad6da3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.283377 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3fcc55304b0403ba6e8e01eaad6da3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.278035 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923ed274fe454cc4a625516769e6b5f3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.284840 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_74b14c0104de480d8de826c45ff1cf37" } modify_external_catalogs: true
I20260505 20:13:28.285048 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_74b14c0104de480d8de826c45ff1cf37" } modify_external_catalogs: true
I20260505 20:13:28.285792 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6560bac418ea4f8aad5c9a8257e5b261" } modify_external_catalogs: true
I20260505 20:13:28.285990 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6560bac418ea4f8aad5c9a8257e5b261" } modify_external_catalogs: true
I20260505 20:13:28.286972 7869 leader_election.cc:304] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:28.287514 8512 raft_consensus.cc:2804] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.287679 8512 raft_consensus.cc:493] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.288129 8512 raft_consensus.cc:3060] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.291184 7342 master_service.cc:954] ReplaceTablet: received request to replace tablet b596f03adbea413b813c9037d4243fae from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.291393 8512 raft_consensus.cc:515] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.291469 8058 raft_consensus.cc:359] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.292450 8512 leader_election.cc:290] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.292865 8052 raft_consensus.cc:2272] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.293160 8050 ts_tablet_manager.cc:1929] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.293484 8052 ts_tablet_manager.cc:1916] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.294302 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.293859 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923ed274fe454cc4a625516769e6b5f3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:28.294353 8053 tablet_bootstrap.cc:492] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:28.295167 7801 raft_consensus.cc:3060] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.295925 8050 log.cc:1199] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/972b5c40369d41739d8c7a5bca22f04e
I20260505 20:13:28.296341 8050 ts_tablet_manager.cc:1950] T 972b5c40369d41739d8c7a5bca22f04e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:28.295190 8053 ts_tablet_manager.cc:1403] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.181s user 0.003s sys 0.006s
I20260505 20:13:28.297277 8050 tablet_replica.cc:333] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:28.297464 8050 raft_consensus.cc:2243] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:28.297488 8053 raft_consensus.cc:359] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.294633 8054 tablet_bootstrap.cc:492] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:28.297902 8054 ts_tablet_manager.cc:1403] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.206s user 0.012s sys 0.015s
I20260505 20:13:28.297910 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53f88d2e8b34b69bd12f53b046ed4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.298079 8053 raft_consensus.cc:385] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.298178 8053 raft_consensus.cc:740] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.298436 8053 consensus_queue.cc:260] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.298815 7801 raft_consensus.cc:2468] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:28.298755 8054 raft_consensus.cc:359] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.298987 8054 raft_consensus.cc:385] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.299883 8054 raft_consensus.cc:740] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.300151 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 972b5c40369d41739d8c7a5bca22f04e (table default.Table_dac15532a6214097912a12004f5f2bef [id=478a9f35ab9d462c9c46020a04784934]) successfully deleted
I20260505 20:13:28.300562 8054 consensus_queue.cc:260] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.301146 7869 leader_election.cc:304] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:28.301117 7596 leader_election.cc:304] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:28.301517 8447 raft_consensus.cc:2804] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:28.301658 8447 raft_consensus.cc:697] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:28.301934 8447 consensus_queue.cc:237] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.303938 8054 ts_tablet_manager.cc:1434] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:28.304260 8054 tablet_bootstrap.cc:492] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:28.306083 8054 tablet_bootstrap.cc:654] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.307402 8058 raft_consensus.cc:385] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.307555 8058 raft_consensus.cc:740] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.297709 8050 pending_rounds.cc:70] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:28.308171 8050 pending_rounds.cc:77] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737184151527424 op_type: NO_OP noop_request { }
I20260505 20:13:28.308316 8050 raft_consensus.cc:2889] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:28.308410 8053 ts_tablet_manager.cc:1434] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:28.308435 8050 raft_consensus.cc:2272] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.308801 8053 tablet_bootstrap.cc:492] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:28.309556 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 608bffbbc10141e8bd19f475b95bdc65 consensus state has no leader
I20260505 20:13:28.312383 8058 consensus_queue.cc:260] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.313609 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923ed274fe454cc4a625516769e6b5f3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:28.317000 8053 tablet_bootstrap.cc:654] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.323799 7664 raft_consensus.cc:2468] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:28.332131 8079 raft_consensus.cc:2804] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:28.332160 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 004a8e72cab44d31af3369b8df1e434e
I20260505 20:13:28.333384 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 004a8e72cab44d31af3369b8df1e434e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.334080 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 004a8e72cab44d31af3369b8df1e434e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.335585 8053 tablet_bootstrap.cc:492] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:28.335788 8053 ts_tablet_manager.cc:1403] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260505 20:13:28.336692 8053 raft_consensus.cc:359] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.336902 8053 raft_consensus.cc:385] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.336998 8053 raft_consensus.cc:740] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.348762 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 19720f3a29f34515a952e50f4fec9f97
I20260505 20:13:28.350242 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 19720f3a29f34515a952e50f4fec9f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.343178 8050 ts_tablet_manager.cc:1916] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.355239 8053 consensus_queue.cc:260] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.359591 7629 tablet_service.cc:1511] Processing CreateTablet for tablet 35ada922a36f4f329a5ff8b328dbef5f (DEFAULT_TABLE table=default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.360852 7338 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_d940540a0f0347a396258cd69ee109ec [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 3 got 0
I20260505 20:13:28.365998 7338 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_d940540a0f0347a396258cd69ee109ec [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 3 got 0
I20260505 20:13:28.366899 8053 ts_tablet_manager.cc:1434] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260505 20:13:28.372227 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ada922a36f4f329a5ff8b328dbef5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.379066 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 4628e33d204c452ab12acf76f754f2ad
I20260505 20:13:28.379735 8558 tablet.cc:1724] T b9b375a4bbec4527af704aa6cd08acec P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:28.382050 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.382241 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 534726d2291044d78740896ff9031fca (DEFAULT_TABLE table=default.Table_070bf3473ab74c31b33db173e8f39d20 [id=12eca25cabd8420aa872cd90cdc4dc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.382637 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534726d2291044d78740896ff9031fca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:28.383386 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.386669 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_809c498b516844ba9571d7f1e7b17e05" } new_table_name: "default.Table_aa714545b11e4ed3a0e546cddc77be98" modify_external_catalogs: true
I20260505 20:13:28.388967 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 19720f3a29f34515a952e50f4fec9f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.388931 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1cb712b418b54251b43b1e21df07376e" } new_table_name: "default.Table_76da2dbee8874c39a6c5c0726eefda6b" modify_external_catalogs: true
I20260505 20:13:28.389469 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5ff2080bf4fe485eb6d9dd8ed4db9998" } new_table_name: "default.Table_ef4d447e4d3746c6a2206a578a98fed9" modify_external_catalogs: true
I20260505 20:13:28.390228 7915 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.393059 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_fd8e9fdcf5bc46618c60ae7d28d7a2d5" } new_table_name: "default.Table_a65a6e246b6348ce8bf48dc0d2b13c86" modify_external_catalogs: true
I20260505 20:13:28.394825 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 6375582031e0445086c58402e8b189c0 (DEFAULT_TABLE table=default.Table_af907934b9fa4624acbd348b39f0920b [id=838329ded2324129b0955e7cd2d9a662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.395586 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6375582031e0445086c58402e8b189c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.399115 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 534726d2291044d78740896ff9031fca (DEFAULT_TABLE table=default.Table_070bf3473ab74c31b33db173e8f39d20 [id=12eca25cabd8420aa872cd90cdc4dc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.402499 8559 tablet.cc:1724] T b9b375a4bbec4527af704aa6cd08acec P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:28.403647 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.405095 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f3b3c646af9843048382e77b138aea44
I20260505 20:13:28.406405 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b9f684cd880b4a748cab49795de11503
I20260505 20:13:28.406841 7334 catalog_manager.cc:6741] ReplaceTablet: tablet b9f684cd880b4a748cab49795de11503 deleted and replaced by tablet 663d16be712b40859aa92277eab0c4a2
I20260505 20:13:28.407419 8304 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" instance_seqno: 1778012000454248) as {username='slave'} at 127.7.33.194:46665; Asking this server to re-register.
I20260505 20:13:28.408952 7847 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:28.412070 8304 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" instance_seqno: 1778012000949582) as {username='slave'} at 127.7.33.195:55181; Asking this server to re-register.
I20260505 20:13:28.414866 8304 ts_manager.cc:194] Registered new tserver with Master: c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.415495 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1d0db71b969c4ec3b297f64b2d0c71e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.416095 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d0db71b969c4ec3b297f64b2d0c71e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.416621 8053 tablet_bootstrap.cc:492] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:28.418514 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3f1f3578e45142bd8308041182d62265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.419076 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f1f3578e45142bd8308041182d62265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.419509 7982 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:28.420442 7915 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.421554 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 944eaa335fcf49be975baee21c715642 (DEFAULT_TABLE table=default.Table_1954f3a3b7034c16b51824755e5e357f [id=20fc114e5acb483c98a375c3eacc59e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.422048 8054 tablet_bootstrap.cc:492] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:28.422258 8054 ts_tablet_manager.cc:1403] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.118s user 0.008s sys 0.016s
I20260505 20:13:28.422305 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae (DEFAULT_TABLE table=default.Table_6407eb94904a4c3db461964a5e97fe89 [id=131ffbf3ae28484d9a4f408397dbe11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.422672 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.423846 8052 ts_tablet_manager.cc:1929] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.423982 8052 log.cc:1199] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/ef996218e8b14e3b80eeab3397edec57
I20260505 20:13:28.424388 8052 ts_tablet_manager.cc:1950] T ef996218e8b14e3b80eeab3397edec57 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:28.424722 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 341) took 1214 ms. Trace:
I20260505 20:13:28.424827 8052 rpcz_store.cc:276] 0505 20:13:27.209870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.211428 (+ 1558us) service_pool.cc:224] Handling call
0505 20:13:28.279067 (+1067639us) ts_tablet_manager.cc:1151] Deleting tablet ef996218e8b14e3b80eeab3397edec57
0505 20:13:28.279082 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.320569 (+ 41487us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.423741 (+103172us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.424683 (+ 942us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1067414}
W20260505 20:13:28.426646 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 089517a7c2214dce9367b21beb555733 consensus state has no leader
W20260505 20:13:28.427060 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae8bd19470294a1db91855afe49be6a5 has no consensus state
I20260505 20:13:28.427317 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944eaa335fcf49be975baee21c715642. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:28.427407 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 944bc61fe79c4f94bb280dae8e3cee59 consensus state has no leader
W20260505 20:13:28.429375 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47720452d3f44e18b16a06ae296b4c51 consensus state has no leader
I20260505 20:13:28.430485 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cfbc6470d8d34b93a3d1434dfa9df8cf" } modify_external_catalogs: true
I20260505 20:13:28.430748 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_cfbc6470d8d34b93a3d1434dfa9df8cf" } modify_external_catalogs: true
I20260505 20:13:28.433457 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_0f1a1d7075f84270a8c989ffdfc15f6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.434347 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f1a1d7075f84270a8c989ffdfc15f6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.439164 8052 tablet_replica.cc:333] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:28.439421 8052 raft_consensus.cc:2243] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.439589 8052 raft_consensus.cc:2272] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.440145 8052 ts_tablet_manager.cc:1916] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.441922 8512 raft_consensus.cc:493] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.442087 8512 raft_consensus.cc:515] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.442675 8512 leader_election.cc:290] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.446336 8053 tablet_bootstrap.cc:654] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.448447 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a026a8408ed9462b820b560a98dcabd1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:28.449077 7869 leader_election.cc:343] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.453723 8051 ts_tablet_manager.cc:1929] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.453919 8051 log.cc:1199] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/aa6589a0f15d4f31acc2e49e6c071e6a
I20260505 20:13:28.454747 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_de020072b593488985be61cca360d781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.455340 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de020072b593488985be61cca360d781 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.458724 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9ee9fc9d6bc948fd90db78cd1670d21f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.459266 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ee9fc9d6bc948fd90db78cd1670d21f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.461983 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e9946c00ab714ea2b40bf99ce829d482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.462494 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9946c00ab714ea2b40bf99ce829d482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.463841 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.465096 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1bd6d826ee3e43e49cc3f1cde7ee0db4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.465583 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bd6d826ee3e43e49cc3f1cde7ee0db4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.465916 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.466722 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 944eaa335fcf49be975baee21c715642 (DEFAULT_TABLE table=default.Table_1954f3a3b7034c16b51824755e5e357f [id=20fc114e5acb483c98a375c3eacc59e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.467365 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534726d2291044d78740896ff9031fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.467600 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 1218bd76239540be9a93ca455ba3eb47 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.470981 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944eaa335fcf49be975baee21c715642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.474144 8304 ts_manager.cc:194] Registered new tserver with Master: 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.477159 8052 ts_tablet_manager.cc:1929] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.477320 8052 log.cc:1199] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/972b5c40369d41739d8c7a5bca22f04e
I20260505 20:13:28.480659 8054 raft_consensus.cc:359] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.480877 8054 raft_consensus.cc:385] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.480952 8054 raft_consensus.cc:740] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.481184 8054 consensus_queue.cc:260] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.482856 8054 ts_tablet_manager.cc:1434] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20260505 20:13:28.483162 8054 tablet_bootstrap.cc:492] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:28.483883 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 1218bd76239540be9a93ca455ba3eb47
I20260505 20:13:28.485024 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.485455 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 4628e33d204c452ab12acf76f754f2ad from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.489411 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.490489 8050 ts_tablet_manager.cc:1929] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.490974 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.491837 8050 log.cc:1199] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e17b17089792450bbc4dba372076af9a
I20260505 20:13:28.495784 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae (DEFAULT_TABLE table=default.Table_6407eb94904a4c3db461964a5e97fe89 [id=131ffbf3ae28484d9a4f408397dbe11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.495965 8050 ts_tablet_manager.cc:1950] T e17b17089792450bbc4dba372076af9a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:28.496243 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.497200 8050 tablet_replica.cc:333] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:28.497391 8050 raft_consensus.cc:2243] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:28.497653 8050 pending_rounds.cc:70] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:28.497711 8050 pending_rounds.cc:77] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737185075970048 op_type: NO_OP noop_request { }
I20260505 20:13:28.497860 8050 raft_consensus.cc:2889] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:28.497967 8050 raft_consensus.cc:2272] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.498333 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e17b17089792450bbc4dba372076af9a (table default.Table_8f662bf9642940d19389e4fe4f0a5e18 [id=a950b5c2d6ae401ca441ec76000e8084]) successfully deleted
I20260505 20:13:28.499539 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 (DEFAULT_TABLE table=default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.499943 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f27847d940e46778ad10a2f4cf40d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.504999 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_38d192fd0ccf420588d860dddcd2394c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.505640 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38d192fd0ccf420588d860dddcd2394c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.506778 8447 raft_consensus.cc:493] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.506963 8447 raft_consensus.cc:515] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.508718 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 004a8e72cab44d31af3369b8df1e434e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.508802 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 19720f3a29f34515a952e50f4fec9f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.508423 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.509195 7800 raft_consensus.cc:2393] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:28.509196 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 534726d2291044d78740896ff9031fca (DEFAULT_TABLE table=default.Table_070bf3473ab74c31b33db173e8f39d20 [id=12eca25cabd8420aa872cd90cdc4dc03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.509487 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 6375582031e0445086c58402e8b189c0 (DEFAULT_TABLE table=default.Table_af907934b9fa4624acbd348b39f0920b [id=838329ded2324129b0955e7cd2d9a662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.509701 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.509881 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf77f6323af4263852853e10003faee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.510129 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534726d2291044d78740896ff9031fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.510094 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 944eaa335fcf49be975baee21c715642 (DEFAULT_TABLE table=default.Table_1954f3a3b7034c16b51824755e5e357f [id=20fc114e5acb483c98a375c3eacc59e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.510126 7906 tablet_service.cc:1511] Processing CreateTablet for tablet d5f27d918f0945208e780bd9583f529e (DEFAULT_TABLE table=default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4 [id=7ae883240f114c1f96e48ac234286977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.510434 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944eaa335fcf49be975baee21c715642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.510386 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.510515 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f27d918f0945208e780bd9583f529e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.510747 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6375582031e0445086c58402e8b189c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.510703 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.510926 8447 leader_election.cc:290] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.510960 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae (DEFAULT_TABLE table=default.Table_6407eb94904a4c3db461964a5e97fe89 [id=131ffbf3ae28484d9a4f408397dbe11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.511264 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.500025 8053 tablet_bootstrap.cc:492] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:28.518769 8053 ts_tablet_manager.cc:1403] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.001s
I20260505 20:13:28.518889 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.519356 8050 ts_tablet_manager.cc:1916] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:28.519567 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.520903 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_60314b7c9136475184b40323c1985237" } new_table_name: "default.Table_2eea1b3e5bd0460fa46985db456f790d" modify_external_catalogs: true
I20260505 20:13:28.522686 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.523222 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 (DEFAULT_TABLE table=default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.523753 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f27847d940e46778ad10a2f4cf40d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.526286 7422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 2 candidate_status { last_received { term: 1 index: 363 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:28.528290 7340 master_service.cc:954] ReplaceTablet: received request to replace tablet 22a98da176254eeb896c680fbcb98caa from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.520646 8053 raft_consensus.cc:359] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.530094 8053 raft_consensus.cc:385] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.530174 8053 raft_consensus.cc:740] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.530480 8053 consensus_queue.cc:260] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.533118 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a026a8408ed9462b820b560a98dcabd1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:28.534726 7870 leader_election.cc:343] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.534888 7870 leader_election.cc:304] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.535221 8053 ts_tablet_manager.cc:1434] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260505 20:13:28.535517 8512 raft_consensus.cc:2749] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.535593 8053 tablet_bootstrap.cc:492] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:28.537415 8053 tablet_bootstrap.cc:654] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.537454 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ae5f3f820d7a408eb8027c6556b44309" } modify_external_catalogs: true
I20260505 20:13:28.537675 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ae5f3f820d7a408eb8027c6556b44309" } modify_external_catalogs: true
I20260505 20:13:28.540467 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6da3130e724445b0d1f3c20e4e3d02" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.541682 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 6375582031e0445086c58402e8b189c0 (DEFAULT_TABLE table=default.Table_af907934b9fa4624acbd348b39f0920b [id=838329ded2324129b0955e7cd2d9a662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.541996 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 7f34a3f1f30b4165a0c60fab482dce36 (DEFAULT_TABLE table=default.Table_33086fdd5d3f4ab18212456f90b13f8b [id=935ce41925944dffab526cf8d8ea98d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.542171 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6375582031e0445086c58402e8b189c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.542414 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f34a3f1f30b4165a0c60fab482dce36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.544163 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 (DEFAULT_TABLE table=default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.544459 8054 tablet_bootstrap.cc:654] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.544772 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f27847d940e46778ad10a2f4cf40d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.546123 7915 tablet_service.cc:1511] Processing CreateTablet for tablet f0ca8cc557674992b88f3379cc1db652 (DEFAULT_TABLE table=default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.546535 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ca8cc557674992b88f3379cc1db652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.547052 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 7f34a3f1f30b4165a0c60fab482dce36 (DEFAULT_TABLE table=default.Table_33086fdd5d3f4ab18212456f90b13f8b [id=935ce41925944dffab526cf8d8ea98d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.477721 8052 ts_tablet_manager.cc:1950] T 972b5c40369d41739d8c7a5bca22f04e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:28.549836 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f34a3f1f30b4165a0c60fab482dce36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.551470 7642 tablet_service.cc:1511] Processing CreateTablet for tablet f0ca8cc557674992b88f3379cc1db652 (DEFAULT_TABLE table=default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.552212 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ca8cc557674992b88f3379cc1db652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.555601 7628 tablet_service.cc:1511] Processing CreateTablet for tablet d5f27d918f0945208e780bd9583f529e (DEFAULT_TABLE table=default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4 [id=7ae883240f114c1f96e48ac234286977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.556799 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 343) took 1331 ms. Trace:
I20260505 20:13:28.557272 8052 rpcz_store.cc:276] 0505 20:13:27.218205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.218355 (+ 150us) service_pool.cc:224] Handling call
0505 20:13:28.439082 (+1220727us) ts_tablet_manager.cc:1151] Deleting tablet 972b5c40369d41739d8c7a5bca22f04e
0505 20:13:28.439096 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.474100 (+ 35004us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.477067 (+ 2967us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.549681 (+ 72614us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1220467}
I20260505 20:13:28.561122 8052 tablet_replica.cc:333] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:28.562654 7640 tablet_service.cc:1511] Processing CreateTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 (DEFAULT_TABLE table=default.Table_20042b0bea294bc1ad99439fa62373da [id=bea129294980408ea07ab3a19804d918]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.562929 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b1cc6dc2f825478ba2c3ae76861bfb50" } modify_external_catalogs: true
I20260505 20:13:28.563205 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b1cc6dc2f825478ba2c3ae76861bfb50" } modify_external_catalogs: true
I20260505 20:13:28.563612 8052 raft_consensus.cc:2243] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:28.564852 8052 pending_rounds.cc:70] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:28.564975 8052 pending_rounds.cc:77] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737185111846912 op_type: NO_OP noop_request { }
I20260505 20:13:28.565160 8052 raft_consensus.cc:2889] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:28.565305 8052 raft_consensus.cc:2272] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.567830 8052 ts_tablet_manager.cc:1916] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.569217 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f27d918f0945208e780bd9583f529e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.569577 8051 ts_tablet_manager.cc:1950] T aa6589a0f15d4f31acc2e49e6c071e6a P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:28.569720 8058 ts_tablet_manager.cc:1434] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.256s user 0.005s sys 0.009s
I20260505 20:13:28.570276 8447 raft_consensus.cc:493] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.570539 8447 raft_consensus.cc:515] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.573091 7640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c5c661e8aa4962bb9922b9ead7d784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.574815 7914 tablet_service.cc:1511] Processing CreateTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 (DEFAULT_TABLE table=default.Table_20042b0bea294bc1ad99439fa62373da [id=bea129294980408ea07ab3a19804d918]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.577540 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 4e6da3130e724445b0d1f3c20e4e3d02 (table default.Table_7ddae9d794cb4fc8bdd97ec5db7a246c [id=af669dc2fb6848f0ba9899d2dd7344f7]). Expected version 1 got 0
I20260505 20:13:28.578328 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 7591290e4ddf4bcc9d4676a2618a346c (table default.Table_3f93bb9d891e4ac6b582689068819e21 [id=def2b4e333d84128b44c8d912afef0a6]) successfully deleted
I20260505 20:13:28.578675 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet ef996218e8b14e3b80eeab3397edec57 (table default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]) successfully deleted
I20260505 20:13:28.579641 7915 tablet_service.cc:1511] Processing CreateTablet for tablet feef367085954816b312d4f1cdd80b1d (DEFAULT_TABLE table=default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e [id=bb29d0a7cf114a8296a5af3e56dddf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.580008 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c5c661e8aa4962bb9922b9ead7d784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.580274 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feef367085954816b312d4f1cdd80b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.586521 7338 master_service.cc:954] ReplaceTablet: received request to replace tablet 3d74dbab83b840d9b2bd103e946d3032 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.588841 8050 ts_tablet_manager.cc:1929] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.593268 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 972b5c40369d41739d8c7a5bca22f04e (table default.Table_dac15532a6214097912a12004f5f2bef [id=478a9f35ab9d462c9c46020a04784934]) successfully deleted
I20260505 20:13:28.594172 7780 tablet_service.cc:1511] Processing CreateTablet for tablet d5f27d918f0945208e780bd9583f529e (DEFAULT_TABLE table=default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4 [id=7ae883240f114c1f96e48ac234286977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.597014 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f27d918f0945208e780bd9583f529e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.595045 7767 tablet_service.cc:1511] Processing CreateTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 (DEFAULT_TABLE table=default.Table_20042b0bea294bc1ad99439fa62373da [id=bea129294980408ea07ab3a19804d918]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.602593 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c5c661e8aa4962bb9922b9ead7d784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.604267 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 22a98da176254eeb896c680fbcb98caa
W20260505 20:13:28.604362 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2b0dd5d7870453bb1b771405daeb22f consensus state has no leader
I20260505 20:13:28.604681 7337 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_d3355f0e778c4b8d86fe948da69b1976 [id=7e050176e69345a8ba527b6fa0d49da3] alter complete (version 3)
I20260505 20:13:28.604913 7334 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet e140b28eecfc49079bd9959c55e52c5f
I20260505 20:13:28.595543 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 86c9aaca827442cc8cc605f56c222860 (DEFAULT_TABLE table=default.Table_7ddda7425d0f44d18fe52b4af466e35c [id=d030dcbee7ac4ba5b1317a173ba9ad48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.606353 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c9aaca827442cc8cc605f56c222860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.606814 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 168d9a40a69d4beab8e79a97e7723e69
I20260505 20:13:28.607715 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 3d74dbab83b840d9b2bd103e946d3032
I20260505 20:13:28.608172 7338 catalog_manager.cc:6741] ReplaceTablet: tablet 3d74dbab83b840d9b2bd103e946d3032 deleted and replaced by tablet 359ab1033ccf4445862867f3f8b78ecd
I20260505 20:13:28.604722 7340 catalog_manager.cc:6741] ReplaceTablet: tablet 22a98da176254eeb896c680fbcb98caa deleted and replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb
I20260505 20:13:28.595857 7781 tablet_service.cc:1511] Processing CreateTablet for tablet feef367085954816b312d4f1cdd80b1d (DEFAULT_TABLE table=default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e [id=bb29d0a7cf114a8296a5af3e56dddf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.610285 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feef367085954816b312d4f1cdd80b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.611755 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7ddae9d794cb4fc8bdd97ec5db7a246c" } modify_external_catalogs: true
I20260505 20:13:28.611984 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7ddae9d794cb4fc8bdd97ec5db7a246c" } modify_external_catalogs: true
I20260505 20:13:28.615000 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_20042b0bea294bc1ad99439fa62373da" } modify_external_catalogs: true
I20260505 20:13:28.615181 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_20042b0bea294bc1ad99439fa62373da" } modify_external_catalogs: true
I20260505 20:13:28.596276 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3595eb9b1144d9b802f1f563d01461 (DEFAULT_TABLE table=default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.592227 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 316) took 1365 ms. Trace:
I20260505 20:13:28.616539 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3595eb9b1144d9b802f1f563d01461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.616415 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 86c9aaca827442cc8cc605f56c222860 (DEFAULT_TABLE table=default.Table_7ddda7425d0f44d18fe52b4af466e35c [id=d030dcbee7ac4ba5b1317a173ba9ad48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.616863 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c9aaca827442cc8cc605f56c222860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.617431 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.618559 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet a026a8408ed9462b820b560a98dcabd1 with delete_type TABLET_DATA_DELETED (replaced by tablet ea726cff03664c3d81b5e541ef738d4a) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.620884 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3595eb9b1144d9b802f1f563d01461 (DEFAULT_TABLE table=default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.621279 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3595eb9b1144d9b802f1f563d01461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.621373 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.596562 7768 tablet_service.cc:1511] Processing CreateTablet for tablet f0ca8cc557674992b88f3379cc1db652 (DEFAULT_TABLE table=default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.621949 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.622175 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ca8cc557674992b88f3379cc1db652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.594681 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 7f34a3f1f30b4165a0c60fab482dce36 (DEFAULT_TABLE table=default.Table_33086fdd5d3f4ab18212456f90b13f8b [id=935ce41925944dffab526cf8d8ea98d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.624954 8053 tablet_bootstrap.cc:492] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:28.625108 8053 ts_tablet_manager.cc:1403] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.007s
I20260505 20:13:28.625156 7352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 2 candidate_status { last_received { term: 1 index: 363 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:28.625264 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 86c9aaca827442cc8cc605f56c222860 (DEFAULT_TABLE table=default.Table_7ddda7425d0f44d18fe52b4af466e35c [id=d030dcbee7ac4ba5b1317a173ba9ad48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.625641 7634 tablet_service.cc:1511] Processing CreateTablet for tablet feef367085954816b312d4f1cdd80b1d (DEFAULT_TABLE table=default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e [id=bb29d0a7cf114a8296a5af3e56dddf0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.626060 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feef367085954816b312d4f1cdd80b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.626451 8261 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98; no voters: 73028cd481e446daa9432a35522a7967, f4615fa5639440fc820498f897adf17d
I20260505 20:13:28.627331 8501 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:28.628499 8051 rpcz_store.cc:276] 0505 20:13:27.207468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.208198 (+ 730us) service_pool.cc:224] Handling call
0505 20:13:28.193598 (+985400us) ts_tablet_manager.cc:1151] Deleting tablet aa6589a0f15d4f31acc2e49e6c071e6a
0505 20:13:28.193614 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.393557 (+199943us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.397820 (+ 4263us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.572950 (+175130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985227}
I20260505 20:13:28.629627 8051 tablet_replica.cc:333] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:28.629874 8051 raft_consensus.cc:2243] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.630045 8051 raft_consensus.cc:2272] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.630645 8051 ts_tablet_manager.cc:1916] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.633852 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f34a3f1f30b4165a0c60fab482dce36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.634541 8079 raft_consensus.cc:697] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:28.636395 8079 consensus_queue.cc:237] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.281018 8322 rpcz_store.cc:276] 0505 20:13:26.817415 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:26.817470 (+ 55us) service_pool.cc:224] Handling call
0505 20:13:26.825073 (+ 7603us) raft_consensus.cc:1471] Updating replica for 349 ops
0505 20:13:26.848924 (+ 23851us) raft_consensus.cc:1534] Early marking committed up to index 14
0505 20:13:27.059197 (+210273us) raft_consensus.cc:1539] Triggering prepare for 349 ops
0505 20:13:27.059816 (+ 619us) write_op.cc:270] Start()
0505 20:13:27.059881 (+ 65us) write_op.cc:276] Timestamp: P: 1778012001093540 usec, L: 0
0505 20:13:27.060243 (+ 362us) write_op.cc:270] Start()
0505 20:13:27.060293 (+ 50us) write_op.cc:276] Timestamp: P: 1778012001094504 usec, L: 0
0505 20:13:27.060527 (+ 234us) write_op.cc:270] Start()
0505 20:13:27.060552 (+ 25us) write_op.cc:276] Timestamp: P: 1778012001131286 usec, L: 0
0505 20:13:27.060717 (+ 165us) write_op.cc:270] Start()
0505 20:13:27.060737 (+ 20us) write_op.cc:276] Timestamp: P: 1778012001139986 usec, L: 0
0505 20:13:27.060868 (+ 131us) write_op.cc:270] Start()
0505 20:13:27.060885 (+ 17us) write_op.cc:276] Timestamp: P: 1778012001140875 usec, L: 0
0505 20:13:27.061020 (+ 135us) write_op.cc:270] Start()
0505 20:13:27.061042 (+ 22us) write_op.cc:276] Timestamp: P: 1778012001141517 usec, L: 0
0505 20:13:27.061177 (+ 135us) write_op.cc:270] Start()
0505 20:13:27.061219 (+ 42us) write_op.cc:276] Timestamp: P: 1778012001144332 usec, L: 0
0505 20:13:27.061338 (+ 119us) write_op.cc:270] Start()
0505 20:13:27.061355 (+ 17us) write_op.cc:276] Timestamp: P: 1778012001157672 usec, L: 0
0505 20:13:27.061533 (+ 178us) write_op.cc:270] Start()
0505 20:13:27.061561 (+ 28us) write_op.cc:276] Timestamp: P: 1778012001168733 usec, L: 0
0505 20:13:27.061823 (+ 262us) write_op.cc:270] Start()
0505 20:13:27.061857 (+ 34us) write_op.cc:276] Timestamp: P: 1778012001169488 usec, L: 0
0505 20:13:27.062008 (+ 151us) write_op.cc:270] Start()
0505 20:13:27.062027 (+ 19us) write_op.cc:276] Timestamp: P: 1778012001170104 usec, L: 0
0505 20:13:27.062165 (+ 138us) write_op.cc:270] Start()
0505 20:13:27.062191 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001170690 usec, L: 0
0505 20:13:27.062343 (+ 152us) write_op.cc:270] Start()
0505 20:13:27.062363 (+ 20us) write_op.cc:276] Timestamp: P: 1778012001189465 usec, L: 0
0505 20:13:27.062521 (+ 158us) write_op.cc:270] Start()
0505 20:13:27.062547 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001294740 usec, L: 0
0505 20:13:27.062710 (+ 163us) write_op.cc:270] Start()
0505 20:13:27.062735 (+ 25us) write_op.cc:276] Timestamp: P: 1778012001302611 usec, L: 0
0505 20:13:27.063015 (+ 280us) write_op.cc:270] Start()
0505 20:13:27.063058 (+ 43us) write_op.cc:276] Timestamp: P: 1778012001308605 usec, L: 0
0505 20:13:27.063282 (+ 224us) write_op.cc:270] Start()
0505 20:13:27.063310 (+ 28us) write_op.cc:276] Timestamp: P: 1778012001314816 usec, L: 0
0505 20:13:27.063487 (+ 177us) write_op.cc:270] Start()
0505 20:13:27.063513 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001319785 usec, L: 0
0505 20:13:27.063684 (+ 171us) write_op.cc:270] Start()
0505 20:13:27.063703 (+ 19us) write_op.cc:276] Timestamp: P: 1778012001320403 usec, L: 0
0505 20:13:27.063883 (+ 180us) write_op.cc:270] Start()
0505 20:13:27.063905 (+ 22us) write_op.cc:276] Timestamp: P: 1778012001329466 usec, L: 0
0505 20:13:27.064081 (+ 176us) write_op.cc:270] Start()
0505 20:13:27.064102 (+ 21us) write_op.cc:276] Timestamp: P: 1778012001330097 usec, L: 0
0505 20:13:27.064322 (+ 220us) write_op.cc:270] Start()
0505 20:13:27.064341 (+ 19us) write_op.cc:276] Timestamp: P: 1778012001330607 usec, L: 0
0505 20:13:27.064467 (+ 126us) write_op.cc:270] Start()
0505 20:13:27.064484 (+ 17us) write_op.cc:276] Timestamp: P: 1778012001331172 usec, L: 0
0505 20:13:27.064594 (+ 110us) write_op.cc:270] Start()
0505 20:13:27.064615 (+ 21us) write_op.cc:276] Timestamp: P: 1778012001347316 usec, L: 0
0505 20:13:27.064845 (+ 230us) write_op.cc:270] Start()
0505 20:13:27.064869 (+ 24us) write_op.cc:276] Timestamp: P: 1778012001350378 usec, L: 0
0505 20:13:27.065030 (+ 161us) write_op.cc:270] Start()
0505 20:13:27.065049 (+ 19us) write_op.cc:276] Timestamp: P: 1778012001353453 usec, L: 0
0505 20:13:27.065157 (+ 108us) write_op.cc:270] Start()
0505 20:13:27.065173 (+ 16us) write_op.cc:276] Timestamp: P: 1778012001356271 usec, L: 0
0505 20:13:27.065314 (+ 141us) write_op.cc:270] Start()
0505 20:13:27.065331 (+ 17us) write_op.cc:276] Timestamp: P: 1778012001392554 usec, L: 0
0505 20:13:27.065453 (+ 122us) write_op.cc:270] Start()
0505 20:13:27.065471 (+ 18us) write_op.cc:276] Timestamp: P: 1778012001393235 usec, L: 0
0505 20:13:27.065592 (+ 121us) write_op.cc:270] Start()
0505 20:13:27.065608 (+ 16us) write_op.cc:276] Timestamp: P: 1778012001393750 usec, L: 0
0505 20:13:27.065735 (+ 127us) write_op.cc:270] Start()
0505 20:13:27.097961 (+ 32226us) write_op.cc:276] Timestamp: P: 1778012001394305 usec, L: 0
0505 20:13:27.098273 (+ 312us) write_op.cc:270] Start()
0505 20:13:27.098301 (+ 28us) write_op.cc:276] Timestamp: P: 1778012001394951 usec, L: 0
0505 20:13:27.098552 (+ 251us) write_op.cc:270] Start()
0505 20:13:27.098575 (+ 23us) write_op.cc:276] Timestamp: P: 1778012001395831 usec, L: 0
0505 20:13:27.098751 (+ 176us) write_op.cc:270] Start()
0505 20:13:27.098773 (+ 22us) write_op.cc:276] Timestamp: P: 1778012001396757 usec, L: 0
0505 20:13:27.098936 (+ 163us) write_op.cc:270] Start()
0505 20:13:27.098962 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001397693 usec, L: 0
0505 20:13:27.099138 (+ 176us) write_op.cc:270] Start()
0505 20:13:27.099193 (+ 55us) write_op.cc:276] Timestamp: P: 1778012001400254 usec, L: 0
0505 20:13:27.099362 (+ 169us) write_op.cc:270] Start()
0505 20:13:27.099385 (+ 23us) write_op.cc:276] Timestamp: P: 1778012001422429 usec, L: 0
0505 20:13:27.099558 (+ 173us) write_op.cc:270] Start()
0505 20:13:27.099582 (+ 24us) write_op.cc:276] Timestamp: P: 1778012001456826 usec, L: 0
0505 20:13:27.099744 (+ 162us) write_op.cc:270] Start()
0505 20:13:27.099773 (+ 29us) write_op.cc:276] Timestamp: P: 1778012001478491 usec, L: 0
0505 20:13:27.099971 (+ 198us) write_op.cc:270] Start()
0505 20:13:27.099995 (+ 24us) write_op.cc:276] Timestamp: P: 1778012001483517 usec, L: 0
0505 20:13:27.100186 (+ 191us) write_op.cc:270] Start()
0505 20:13:27.100211 (+ 25us) write_op.cc:276] Timestamp: P: 1778012001641463 usec, L: 0
0505 20:13:27.100378 (+ 167us) write_op.cc:270] Start()
0505 20:13:27.100400 (+ 22us) write_op.cc:276] Timestamp: P: 1778012001645531 usec, L: 0
0505 20:13:27.100571 (+ 171us) write_op.cc:270] Start()
0505 20:13:27.100596 (+ 25us) write_op.cc:276] Timestamp: P: 1778012001646173 usec, L: 0
0505 20:13:27.100737 (+ 141us) write_op.cc:270] Start()
0505 20:13:27.100751 (+ 14us) write_op.cc:276] Timestamp: P: 1778012001646753 usec, L: 0
0505 20:13:27.100838 (+ 87us) write_op.cc:270] Start()
0505 20:13:27.100851 (+ 13us) write_op.cc:276] Timestamp: P: 1778012001647242 usec, L: 0
0505 20:13:27.100975 (+ 124us) write_op.cc:270] Start()
0505 20:13:27.100989 (+ 14us) write_op.cc:276] Timestamp: P: 1778012001648381 usec, L: 0
0505 20:13:27.101079 (+ 90us) write_op.cc:270] Start()
0505 20:13:27.101091 (+ 12us) write_op.cc:276] Timestamp: P: 1778012001650651 usec, L: 0
0505 20:13:27.101168 (+ 77us) write_op.cc:270] Start()
0505 20:13:27.101180 (+ 12us) write_op.cc:276] Timestamp: P: 1778012001651353 usec, L: 0
0505 20:13:27.101322 (+ 142us) write_op.cc:270] Start()
0505 20:13:27.101344 (+ 22us) write_op.cc:276] Timestamp: P: 1778012001652003 usec, L: 0
0505 20:13:27.101631 (+ 287us) write_op.cc:270] Start()
0505 20:13:27.101657 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001671300 usec, L: 0
0505 20:13:27.115576 (+ 13919us) write_op.cc:270] Start()
0505 20:13:27.115613 (+ 37us) write_op.cc:276] Timestamp: P: 1778012001692342 usec, L: 0
0505 20:13:27.115827 (+ 214us) write_op.cc:270] Start()
0505 20:13:27.115848 (+ 21us) write_op.cc:276] Timestamp: P: 1778012001693341 usec, L: 0
0505 20:13:27.115966 (+ 118us) write_op.cc:270] Start()
0505 20:13:27.116014 (+ 48us) write_op.cc:276] Timestamp: P: 1778012001711198 usec, L: 0
0505 20:13:27.116151 (+ 137us) write_op.cc:270] Start()
0505 20:13:27.116173 (+ 22us) write_op.cc:276] Timestamp: P: 1778012001714865 usec, L: 0
0505 20:13:27.116325 (+ 152us) write_op.cc:270] Start()
0505 20:13:27.116352 (+ 27us) write_op.cc:276] Timestamp: P: 1778012001715621 usec, L: 0
0505 20:13:27.116454 (+ 102us) write_op.cc:270] Start()
0505 20:13:27.116467 (+ 13us) write_op.cc:276] Timestamp: P: 1778012001797395 usec, L: 0
0505 20:13:27.116568 (+ 101us) write_op.cc:270] Start()
0505 20:13:27.116580 (+ 12us) write_op.cc:276] Timestamp: P: 1778012001798245 usec, L: 0
0505 20:13:27.116674 (+ 94us) write_op.cc:270] Start()
0505 20:13:27.116685 (+ 11us) write_op.cc:276] Timestamp: P: 1778012001798870 usec, L: 0
0505 20:13:27.116827 (+ 142us) write_op.cc:270] Start()
0505 20:13:27.116852 (+ 25us) write_op.cc:276] Timestamp: P: 1778012001860487 usec, L: 0
0505 20:13:27.117007 (+ 155us) write_op.cc:270] Start()
0505 20:13:27.117054 (+ 47us) write_op.cc:276] Timestamp: P: 1778012001862206 usec, L: 0
0505 20:13:27.117153 (+ 99us) write_op.cc:270] Start()
0505 20:13:27.117166 (+ 13us) write_op.cc:276] Timestamp: P: 1778012001863107 usec, L: 0
0505 20:13:27.117289 (+ 123us) write_op.cc:270] Start()
0505 20:13:27.117309 (+ 20us) write_op.cc:276] Timestamp: P: 1778012001920429 usec, L: 0
0505 20:13:27.117506 (+ 197us) write_op.cc:270] Start()
0505 20:13:27.117533 (+ 27us) write_op.cc:276] Timestamp: P: 1778012001921470 usec, L: 0
0505 20:13:27.117684 (+ 151us) write_op.cc:270] Start()
0505 20:13:27.117699 (+ 15us) write_op.cc:276] Timestamp: P: 1778012001932186 usec, L: 0
0505 20:13:27.150801 (+ 33102us) write_op.cc:270] Start()
0505 20:13:27.150858 (+ 57us) write_op.cc:276] Timestamp: P: 1778012001940304 usec, L: 0
0505 20:13:27.151086 (+ 228us) write_op.cc:270] Start()
0505 20:13:27.151112 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001986372 usec, L: 0
0505 20:13:27.151241 (+ 129us) write_op.cc:270] Start()
0505 20:13:27.151262 (+ 21us) write_op.cc:276] Timestamp: P: 1778012001994296 usec, L: 0
0505 20:13:27.151438 (+ 176us) write_op.cc:270] Start()
0505 20:13:27.151464 (+ 26us) write_op.cc:276] Timestamp: P: 1778012001998057 usec, L: 0
0505 20:13:27.151648 (+ 184us) write_op.cc:270] Start()
0505 20:13:27.151673 (+ 25us) write_op.cc:276] Timestamp: P: 1778012002003969 usec, L: 0
0505 20:13:27.151843 (+ 170us) write_op.cc:270] Start()
0505 20:13:27.171649 (+ 19806us) write_op.cc:276] Timestamp: P: 1778012002004980 usec, L: 0
0505 20:13:27.174212 (+ 2563us) write_op.cc:270] Start()
0505 20:13:27.174246 (+ 34us) write_op.cc:276] Timestamp: P: 1778012002008586 usec, L: 0
0505 20:13:27.174435 (+ 189us) write_op.cc:270] Start()
0505 20:13:27.174459 (+ 24us) write_op.cc:276] Timestamp: P: 1778012002009423 usec, L: 0
0505 20:13:27.174642 (+ 183us) write_op.cc:270] Start()
0505 20:13:27.174664 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002013117 usec, L: 0
0505 20:13:27.178441 (+ 3777us) write_op.cc:270] Start()
0505 20:13:27.178486 (+ 45us) write_op.cc:276] Timestamp: P: 1778012002013653 usec, L: 0
0505 20:13:27.178663 (+ 177us) write_op.cc:270] Start()
0505 20:13:27.178688 (+ 25us) write_op.cc:276] Timestamp: P: 1778012002014218 usec, L: 0
0505 20:13:27.178829 (+ 141us) write_op.cc:270] Start()
0505 20:13:27.178850 (+ 21us) write_op.cc:276] Timestamp: P: 1778012002052616 usec, L: 0
0505 20:13:27.178995 (+ 145us) write_op.cc:270] Start()
0505 20:13:27.179013 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002151686 usec, L: 0
0505 20:13:27.179137 (+ 124us) write_op.cc:270] Start()
0505 20:13:27.179159 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002159241 usec, L: 0
0505 20:13:27.179306 (+ 147us) write_op.cc:270] Start()
0505 20:13:27.179352 (+ 46us) write_op.cc:276] Timestamp: P: 1778012002164051 usec, L: 0
0505 20:13:27.179542 (+ 190us) write_op.cc:270] Start()
0505 20:13:27.179563 (+ 21us) write_op.cc:276] Timestamp: P: 1778012002166507 usec, L: 0
0505 20:13:27.179709 (+ 146us) write_op.cc:270] Start()
0505 20:13:27.179729 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002167371 usec, L: 0
0505 20:13:27.179847 (+ 118us) write_op.cc:270] Start()
0505 20:13:27.179865 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002195843 usec, L: 0
0505 20:13:27.180008 (+ 143us) write_op.cc:270] Start()
0505 20:13:27.180028 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002203510 usec, L: 0
0505 20:13:27.180155 (+ 127us) write_op.cc:270] Start()
0505 20:13:27.180175 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002206283 usec, L: 0
0505 20:13:27.180315 (+ 140us) write_op.cc:270] Start()
0505 20:13:27.180333 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002262132 usec, L: 0
0505 20:13:27.180490 (+ 157us) write_op.cc:270] Start()
0505 20:13:27.180512 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002264014 usec, L: 0
0505 20:13:27.180676 (+ 164us) write_op.cc:270] Start()
0505 20:13:27.180698 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002264922 usec, L: 0
0505 20:13:27.180836 (+ 138us) write_op.cc:270] Start()
0505 20:13:27.180867 (+ 31us) write_op.cc:276] Timestamp: P: 1778012002301868 usec, L: 0
0505 20:13:27.181026 (+ 159us) write_op.cc:270] Start()
0505 20:13:27.181048 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002303437 usec, L: 0
0505 20:13:27.181178 (+ 130us) write_op.cc:270] Start()
0505 20:13:27.181197 (+ 19us) write_op.cc:276] Timestamp: P: 1778012002304451 usec, L: 0
0505 20:13:27.181338 (+ 141us) write_op.cc:270] Start()
0505 20:13:27.181360 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002314561 usec, L: 0
0505 20:13:27.181530 (+ 170us) write_op.cc:270] Start()
0505 20:13:27.181555 (+ 25us) write_op.cc:276] Timestamp: P: 1778012002370671 usec, L: 0
0505 20:13:27.181714 (+ 159us) write_op.cc:270] Start()
0505 20:13:27.197911 (+ 16197us) write_op.cc:276] Timestamp: P: 1778012002375365 usec, L: 0
0505 20:13:27.202172 (+ 4261us) write_op.cc:270] Start()
0505 20:13:27.202227 (+ 55us) write_op.cc:276] Timestamp: P: 1778012002377515 usec, L: 0
0505 20:13:27.202433 (+ 206us) write_op.cc:270] Start()
0505 20:13:27.202465 (+ 32us) write_op.cc:276] Timestamp: P: 1778012002404296 usec, L: 0
0505 20:13:27.202632 (+ 167us) write_op.cc:270] Start()
0505 20:13:27.202653 (+ 21us) write_op.cc:276] Timestamp: P: 1778012002406658 usec, L: 0
0505 20:13:27.202792 (+ 139us) write_op.cc:270] Start()
0505 20:13:27.202810 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002417329 usec, L: 0
0505 20:13:27.202938 (+ 128us) write_op.cc:270] Start()
0505 20:13:27.202958 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002423288 usec, L: 0
0505 20:13:27.203084 (+ 126us) write_op.cc:270] Start()
0505 20:13:27.203101 (+ 17us) write_op.cc:276] Timestamp: P: 1778012002430388 usec, L: 0
0505 20:13:27.203213 (+ 112us) write_op.cc:270] Start()
0505 20:13:27.203231 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002431248 usec, L: 0
0505 20:13:27.203393 (+ 162us) write_op.cc:270] Start()
0505 20:13:27.203416 (+ 23us) write_op.cc:276] Timestamp: P: 1778012002435605 usec, L: 0
0505 20:13:27.222598 (+ 19182us) write_op.cc:270] Start()
0505 20:13:27.222640 (+ 42us) write_op.cc:276] Timestamp: P: 1778012002509237 usec, L: 0
0505 20:13:27.222850 (+ 210us) write_op.cc:270] Start()
0505 20:13:27.222872 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002511008 usec, L: 0
0505 20:13:27.223023 (+ 151us) write_op.cc:270] Start()
0505 20:13:27.223048 (+ 25us) write_op.cc:276] Timestamp: P: 1778012002554897 usec, L: 0
0505 20:13:27.223202 (+ 154us) write_op.cc:270] Start()
0505 20:13:27.223222 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002556214 usec, L: 0
0505 20:13:27.223353 (+ 131us) write_op.cc:270] Start()
0505 20:13:27.223387 (+ 34us) write_op.cc:276] Timestamp: P: 1778012002557567 usec, L: 0
0505 20:13:27.223536 (+ 149us) write_op.cc:270] Start()
0505 20:13:27.223555 (+ 19us) write_op.cc:276] Timestamp: P: 1778012002558465 usec, L: 0
0505 20:13:27.223696 (+ 141us) write_op.cc:270] Start()
0505 20:13:27.223716 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002601872 usec, L: 0
0505 20:13:27.223852 (+ 136us) write_op.cc:270] Start()
0505 20:13:27.223870 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002603410 usec, L: 0
0505 20:13:27.223995 (+ 125us) write_op.cc:270] Start()
0505 20:13:27.224012 (+ 17us) write_op.cc:276] Timestamp: P: 1778012002635259 usec, L: 0
0505 20:13:27.224158 (+ 146us) write_op.cc:270] Start()
0505 20:13:27.224179 (+ 21us) write_op.cc:276] Timestamp: P: 1778012002638661 usec, L: 0
0505 20:13:27.224334 (+ 155us) write_op.cc:270] Start()
0505 20:13:27.224358 (+ 24us) write_op.cc:276] Timestamp: P: 1778012002639812 usec, L: 0
0505 20:13:27.224506 (+ 148us) write_op.cc:270] Start()
0505 20:13:27.224526 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002654794 usec, L: 0
0505 20:13:27.224659 (+ 133us) write_op.cc:270] Start()
0505 20:13:27.224680 (+ 21us) write_op.cc:276] Timestamp: P: 1778012002656929 usec, L: 0
0505 20:13:27.224840 (+ 160us) write_op.cc:270] Start()
0505 20:13:27.224860 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002657995 usec, L: 0
0505 20:13:27.224999 (+ 139us) write_op.cc:270] Start()
0505 20:13:27.225046 (+ 47us) write_op.cc:276] Timestamp: P: 1778012002697337 usec, L: 0
0505 20:13:27.225207 (+ 161us) write_op.cc:270] Start()
0505 20:13:27.225227 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002699071 usec, L: 0
0505 20:13:27.225355 (+ 128us) write_op.cc:270] Start()
0505 20:13:27.225374 (+ 19us) write_op.cc:276] Timestamp: P: 1778012002703869 usec, L: 0
0505 20:13:27.225522 (+ 148us) write_op.cc:270] Start()
0505 20:13:27.225542 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002705302 usec, L: 0
0505 20:13:27.225719 (+ 177us) write_op.cc:270] Start()
0505 20:13:27.225763 (+ 44us) write_op.cc:276] Timestamp: P: 1778012002706241 usec, L: 0
0505 20:13:27.225935 (+ 172us) write_op.cc:270] Start()
0505 20:13:27.225957 (+ 22us) write_op.cc:276] Timestamp: P: 1778012002740244 usec, L: 0
0505 20:13:27.226151 (+ 194us) write_op.cc:270] Start()
0505 20:13:27.226181 (+ 30us) write_op.cc:276] Timestamp: P: 1778012002752212 usec, L: 0
0505 20:13:27.226545 (+ 364us) write_op.cc:270] Start()
0505 20:13:27.226570 (+ 25us) write_op.cc:276] Timestamp: P: 1778012002756453 usec, L: 0
0505 20:13:27.226722 (+ 152us) write_op.cc:270] Start()
0505 20:13:27.226749 (+ 27us) write_op.cc:276] Timestamp: P: 1778012002757978 usec, L: 0
0505 20:13:27.226902 (+ 153us) write_op.cc:270] Start()
0505 20:13:27.226923 (+ 21us) write_op.cc:276] Timestamp: P: 1778012002761657 usec, L: 0
0505 20:13:27.227049 (+ 126us) write_op.cc:270] Start()
0505 20:13:27.227091 (+ 42us) write_op.cc:276] Timestamp: P: 1778012002763619 usec, L: 0
0505 20:13:27.279410 (+ 52319us) write_op.cc:270] Start()
0505 20:13:27.279452 (+ 42us) write_op.cc:276] Timestamp: P: 1778012002765250 usec, L: 0
0505 20:13:27.279650 (+ 198us) write_op.cc:270] Start()
0505 20:13:27.279670 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002766847 usec, L: 0
0505 20:13:27.279839 (+ 169us) write_op.cc:270] Start()
0505 20:13:27.279859 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002892088 usec, L: 0
0505 20:13:27.279990 (+ 131us) write_op.cc:270] Start()
0505 20:13:27.280009 (+ 19us) write_op.cc:276] Timestamp: P: 1778012002893731 usec, L: 0
0505 20:13:27.280118 (+ 109us) write_op.cc:270] Start()
0505 20:13:27.280181 (+ 63us) write_op.cc:276] Timestamp: P: 1778012002904606 usec, L: 0
0505 20:13:27.280354 (+ 173us) write_op.cc:270] Start()
0505 20:13:27.280390 (+ 36us) write_op.cc:276] Timestamp: P: 1778012002905483 usec, L: 0
0505 20:13:27.280538 (+ 148us) write_op.cc:270] Start()
0505 20:13:27.280558 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002906211 usec, L: 0
0505 20:13:27.280692 (+ 134us) write_op.cc:270] Start()
0505 20:13:27.280712 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002907120 usec, L: 0
0505 20:13:27.280857 (+ 145us) write_op.cc:270] Start()
0505 20:13:27.280876 (+ 19us) write_op.cc:276] Timestamp: P: 1778012002907884 usec, L: 0
0505 20:13:27.281008 (+ 132us) write_op.cc:270] Start()
0505 20:13:27.281027 (+ 19us) write_op.cc:276] Timestamp: P: 1778012002926601 usec, L: 0
0505 20:13:27.281148 (+ 121us) write_op.cc:270] Start()
0505 20:13:27.281168 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002929816 usec, L: 0
0505 20:13:27.281297 (+ 129us) write_op.cc:270] Start()
0505 20:13:27.281315 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002934496 usec, L: 0
0505 20:13:27.281459 (+ 144us) write_op.cc:270] Start()
0505 20:13:27.281477 (+ 18us) write_op.cc:276] Timestamp: P: 1778012002942315 usec, L: 0
0505 20:13:27.281599 (+ 122us) write_op.cc:270] Start()
0505 20:13:27.281619 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002949831 usec, L: 0
0505 20:13:27.281736 (+ 117us) write_op.cc:270] Start()
0505 20:13:27.303283 (+ 21547us) write_op.cc:276] Timestamp: P: 1778012002950471 usec, L: 0
0505 20:13:27.303554 (+ 271us) write_op.cc:270] Start()
0505 20:13:27.303581 (+ 27us) write_op.cc:276] Timestamp: P: 1778012002951006 usec, L: 0
0505 20:13:27.303743 (+ 162us) write_op.cc:270] Start()
0505 20:13:27.303763 (+ 20us) write_op.cc:276] Timestamp: P: 1778012002951682 usec, L: 0
0505 20:13:27.303895 (+ 132us) write_op.cc:270] Start()
0505 20:13:27.303912 (+ 17us) write_op.cc:276] Timestamp: P: 1778012002977586 usec, L: 0
0505 20:13:27.304011 (+ 99us) write_op.cc:270] Start()
0505 20:13:27.304027 (+ 16us) write_op.cc:276] Timestamp: P: 1778012002989846 usec, L: 0
0505 20:13:27.304163 (+ 136us) write_op.cc:270] Start()
0505 20:13:27.304181 (+ 18us) write_op.cc:276] Timestamp: P: 1778012003022389 usec, L: 0
0505 20:13:27.304284 (+ 103us) write_op.cc:270] Start()
0505 20:13:27.304300 (+ 16us) write_op.cc:276] Timestamp: P: 1778012003047808 usec, L: 0
0505 20:13:27.304445 (+ 145us) write_op.cc:270] Start()
0505 20:13:27.304468 (+ 23us) write_op.cc:276] Timestamp: P: 1778012003048920 usec, L: 0
0505 20:13:27.304612 (+ 144us) write_op.cc:270] Start()
0505 20:13:27.304631 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003049549 usec, L: 0
0505 20:13:27.304779 (+ 148us) write_op.cc:270] Start()
0505 20:13:27.304799 (+ 20us) write_op.cc:276] Timestamp: P: 1778012003050119 usec, L: 0
0505 20:13:27.305273 (+ 474us) write_op.cc:270] Start()
0505 20:13:27.305299 (+ 26us) write_op.cc:276] Timestamp: P: 1778012003105429 usec, L: 0
0505 20:13:27.305481 (+ 182us) write_op.cc:270] Start()
0505 20:13:27.305503 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003192271 usec, L: 0
0505 20:13:27.305625 (+ 122us) write_op.cc:270] Start()
0505 20:13:27.305643 (+ 18us) write_op.cc:276] Timestamp: P: 1778012003193624 usec, L: 0
0505 20:13:27.305812 (+ 169us) write_op.cc:270] Start()
0505 20:13:27.305832 (+ 20us) write_op.cc:276] Timestamp: P: 1778012003194593 usec, L: 0
0505 20:13:27.305953 (+ 121us) write_op.cc:270] Start()
0505 20:13:27.305969 (+ 16us) write_op.cc:276] Timestamp: P: 1778012003196700 usec, L: 0
0505 20:13:27.306102 (+ 133us) write_op.cc:270] Start()
0505 20:13:27.306119 (+ 17us) write_op.cc:276] Timestamp: P: 1778012003220271 usec, L: 0
0505 20:13:27.306229 (+ 110us) write_op.cc:270] Start()
0505 20:13:27.306245 (+ 16us) write_op.cc:276] Timestamp: P: 1778012003223088 usec, L: 0
0505 20:13:27.306391 (+ 146us) write_op.cc:270] Start()
0505 20:13:27.306413 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003236444 usec, L: 0
0505 20:13:27.306568 (+ 155us) write_op.cc:270] Start()
0505 20:13:27.306591 (+ 23us) write_op.cc:276] Timestamp: P: 1778012003240903 usec, L: 0
0505 20:13:27.306764 (+ 173us) write_op.cc:270] Start()
0505 20:13:27.306787 (+ 23us) write_op.cc:276] Timestamp: P: 1778012003247928 usec, L: 0
0505 20:13:27.306917 (+ 130us) write_op.cc:270] Start()
0505 20:13:27.306940 (+ 23us) write_op.cc:276] Timestamp: P: 1778012003263716 usec, L: 0
0505 20:13:27.307100 (+ 160us) write_op.cc:270] Start()
0505 20:13:27.307119 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003282930 usec, L: 0
0505 20:13:27.307259 (+ 140us) write_op.cc:270] Start()
0505 20:13:27.307279 (+ 20us) write_op.cc:276] Timestamp: P: 1778012003298896 usec, L: 0
0505 20:13:27.307415 (+ 136us) write_op.cc:270] Start()
0505 20:13:27.307434 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003302592 usec, L: 0
0505 20:13:27.307559 (+ 125us) write_op.cc:270] Start()
0505 20:13:27.307576 (+ 17us) write_op.cc:276] Timestamp: P: 1778012003304038 usec, L: 0
0505 20:13:27.307685 (+ 109us) write_op.cc:270] Start()
0505 20:13:27.307702 (+ 17us) write_op.cc:276] Timestamp: P: 1778012003306954 usec, L: 0
0505 20:13:27.307852 (+ 150us) write_op.cc:270] Start()
0505 20:13:27.307908 (+ 56us) write_op.cc:276] Timestamp: P: 1778012003309403 usec, L: 0
0505 20:13:27.308105 (+ 197us) write_op.cc:270] Start()
0505 20:13:27.308125 (+ 20us) write_op.cc:276] Timestamp: P: 1778012003314193 usec, L: 0
0505 20:13:27.308262 (+ 137us) write_op.cc:270] Start()
0505 20:13:27.308281 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003315153 usec, L: 0
0505 20:13:27.308408 (+ 127us) write_op.cc:270] Start()
0505 20:13:27.308426 (+ 18us) write_op.cc:276] Timestamp: P: 1778012003405292 usec, L: 0
0505 20:13:27.308539 (+ 113us) write_op.cc:270] Start()
0505 20:13:27.308557 (+ 18us) write_op.cc:276] Timestamp: P: 1778012003413507 usec, L: 0
0505 20:13:27.308677 (+ 120us) write_op.cc:270] Start()
0505 20:13:27.308694 (+ 17us) write_op.cc:276] Timestamp: P: 1778012003420579 usec, L: 0
0505 20:13:27.308819 (+ 125us) write_op.cc:270] Start()
0505 20:13:27.308836 (+ 17us) write_op.cc:276] Timestamp: P: 1778012003425416 usec, L: 0
0505 20:13:27.503559 (+194723us) write_op.cc:270] Start()
0505 20:13:27.503599 (+ 40us) write_op.cc:276] Timestamp: P: 1778012003428566 usec, L: 0
0505 20:13:27.504569 (+ 970us) write_op.cc:270] Start()
0505 20:13:27.504598 (+ 29us) write_op.cc:276] Timestamp: P: 1778012003442434 usec, L: 0
0505 20:13:27.504763 (+ 165us) write_op.cc:270] Start()
0505 20:13:27.504785 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003466800 usec, L: 0
0505 20:13:27.504914 (+ 129us) write_op.cc:270] Start()
0505 20:13:27.504933 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003467482 usec, L: 0
0505 20:13:27.505103 (+ 170us) write_op.cc:270] Start()
0505 20:13:27.505125 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003468085 usec, L: 0
0505 20:13:27.505271 (+ 146us) write_op.cc:270] Start()
0505 20:13:27.505304 (+ 33us) write_op.cc:276] Timestamp: P: 1778012003468663 usec, L: 0
0505 20:13:27.505458 (+ 154us) write_op.cc:270] Start()
0505 20:13:27.505478 (+ 20us) write_op.cc:276] Timestamp: P: 1778012003474589 usec, L: 0
0505 20:13:27.505615 (+ 137us) write_op.cc:270] Start()
0505 20:13:27.505635 (+ 20us) write_op.cc:276] Timestamp: P: 1778012003529868 usec, L: 0
0505 20:13:27.505818 (+ 183us) write_op.cc:270] Start()
0505 20:13:27.505842 (+ 24us) write_op.cc:276] Timestamp: P: 1778012003530581 usec, L: 0
0505 20:13:27.505981 (+ 139us) write_op.cc:270] Start()
0505 20:13:27.506002 (+ 21us) write_op.cc:276] Timestamp: P: 1778012003531132 usec, L: 0
0505 20:13:27.506173 (+ 171us) write_op.cc:270] Start()
0505 20:13:27.506195 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003538227 usec, L: 0
0505 20:13:27.506345 (+ 150us) write_op.cc:270] Start()
0505 20:13:27.506381 (+ 36us) write_op.cc:276] Timestamp: P: 1778012003565721 usec, L: 0
0505 20:13:27.506530 (+ 149us) write_op.cc:270] Start()
0505 20:13:27.506551 (+ 21us) write_op.cc:276] Timestamp: P: 1778012003580196 usec, L: 0
0505 20:13:27.506688 (+ 137us) write_op.cc:270] Start()
0505 20:13:27.506710 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003598501 usec, L: 0
0505 20:13:27.506849 (+ 139us) write_op.cc:270] Start()
0505 20:13:27.506867 (+ 18us) write_op.cc:276] Timestamp: P: 1778012003600681 usec, L: 0
0505 20:13:27.507025 (+ 158us) write_op.cc:270] Start()
0505 20:13:27.507044 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003614077 usec, L: 0
0505 20:13:27.507198 (+ 154us) write_op.cc:270] Start()
0505 20:13:27.507220 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003614696 usec, L: 0
0505 20:13:27.507379 (+ 159us) write_op.cc:270] Start()
0505 20:13:27.507402 (+ 23us) write_op.cc:276] Timestamp: P: 1778012003615232 usec, L: 0
0505 20:13:27.507546 (+ 144us) write_op.cc:270] Start()
0505 20:13:27.507568 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003615846 usec, L: 0
0505 20:13:27.507716 (+ 148us) write_op.cc:270] Start()
0505 20:13:27.507738 (+ 22us) write_op.cc:276] Timestamp: P: 1778012003616499 usec, L: 0
0505 20:13:27.507869 (+ 131us) write_op.cc:270] Start()
0505 20:13:27.507888 (+ 19us) write_op.cc:276] Timestamp: P: 1778012003617127 usec, L: 0
0505 20:13:27.508027 (+ 139us) write_op.cc:270] Start()
0505 20:13:27.508045 (+ 18us) write_op.cc:276] Timestamp: P: 1778012003621428 usec, L: 0
0505 20:13:27.508167 (+ 122us) write_op.cc:270] Start()
0505 20:13:27.508184 (+ 17us) write_op.cc:276] Timestamp: P: 1778012003628180 usec, L: 0
0505 20:13:27.527836 (+ 19652us) write_op.cc:270] Start()
0505 20:13:27.527886 (+ 50us) write_op.cc:276] Timestamp: P: 1778012
I20260505 20:13:28.638608 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3c329f8225c0482ba66b8cb2bece4f84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.639164 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c329f8225c0482ba66b8cb2bece4f84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.639432 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b1105189a66e41bdb0025fcdfdb95313" } new_table_name: "default.Table_5e1f5308c918489ba8d124bd3752d9b3" modify_external_catalogs: true
I20260505 20:13:28.640138 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_743988c08e634a86b20fea79e4c3a340" } new_table_name: "default.Table_d4c051042c544a609b797ef905f8d285" modify_external_catalogs: true
I20260505 20:13:28.639086 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_33086fdd5d3f4ab18212456f90b13f8b" } new_table_name: "default.Table_e621645c928d4718bda596265ef8ab3f" modify_external_catalogs: true
I20260505 20:13:28.646625 8058 tablet_bootstrap.cc:492] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:28.649397 8050 log.cc:1199] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/a1f5bfa086f9422ebda96b2485ad986b
I20260505 20:13:28.649977 8050 ts_tablet_manager.cc:1950] T a1f5bfa086f9422ebda96b2485ad986b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:28.651412 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c6739319907248c5a2b1f0bc5c1afd77" } new_table_name: "default.Table_a8cef891e16545e2839c4d00a91de994" modify_external_catalogs: true
I20260505 20:13:28.653240 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.653185 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3595eb9b1144d9b802f1f563d01461 (DEFAULT_TABLE table=default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:28.653520 8561 log.cc:927] Time spent T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260505 20:13:28.653789 8512 raft_consensus.cc:493] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.654021 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596f03adbea413b813c9037d4243fae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.654783 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_6d4b2501aefb48ae90019d3bfdb71a24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.654850 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_45b02f2afbda4ad88bfc9c41c987aa4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.655412 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45b02f2afbda4ad88bfc9c41c987aa4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.655588 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.656383 7640 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:28.655424 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d4b2501aefb48ae90019d3bfdb71a24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.657805 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.658041 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.658996 8058 tablet_bootstrap.cc:654] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:28.659718 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee19f65120184eca9495513b68440b4f consensus state has no leader
I20260505 20:13:28.659759 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 349) took 1010 ms. Trace:
W20260505 20:13:28.660015 7869 leader_election.cc:343] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:28.661090 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 880cbba188144dd795873186f8cda1e9 consensus state has no leader
I20260505 20:13:28.661887 8054 tablet_bootstrap.cc:492] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:28.661954 8490 raft_consensus.cc:493] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.662039 8054 ts_tablet_manager.cc:1403] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.179s user 0.003s sys 0.002s
I20260505 20:13:28.662351 8490 raft_consensus.cc:515] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.660588 8512 raft_consensus.cc:515] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.662907 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3595eb9b1144d9b802f1f563d01461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.664439 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf77f6323af4263852853e10003faee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.665024 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.665254 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596f03adbea413b813c9037d4243fae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.665481 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.666692 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c9aaca827442cc8cc605f56c222860. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:28.669082 7870 leader_election.cc:343] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.669212 7870 leader_election.cc:304] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.670825 8443 raft_consensus.cc:2749] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.677524 8512 leader_election.cc:290] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.679401 8054 raft_consensus.cc:359] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.679622 8054 raft_consensus.cc:385] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.681097 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.659875 8050 rpcz_store.cc:276] 0505 20:13:27.648910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.648974 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:28.497113 (+848139us) ts_tablet_manager.cc:1151] Deleting tablet a1f5bfa086f9422ebda96b2485ad986b
0505 20:13:28.497125 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.550188 (+ 53063us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.562859 (+ 12671us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.659692 (+ 96833us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":847930}
I20260505 20:13:28.682821 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet a1f5bfa086f9422ebda96b2485ad986b (table default.Table_381e5521f71b4d388d6643fb24a3bc27 [id=6606be420f5c424f93d731dfa574a5e7]) successfully deleted
I20260505 20:13:28.686934 8557 raft_consensus.cc:493] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:28.687711 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f34a3f1f30b4165a0c60fab482dce36 consensus state has no leader
I20260505 20:13:28.687110 8557 raft_consensus.cc:515] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.691725 8447 leader_election.cc:290] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.692145 7663 raft_consensus.cc:2468] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:28.693480 8557 leader_election.cc:290] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.694621 7870 leader_election.cc:304] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:28.696835 8054 raft_consensus.cc:740] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.698719 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_08e74268c74d44938d75f8cdbfb18948" } modify_external_catalogs: true
I20260505 20:13:28.698931 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_08e74268c74d44938d75f8cdbfb18948" } modify_external_catalogs: true
I20260505 20:13:28.699590 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d6c96dbb361b457684823113cd6727ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.700222 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6c96dbb361b457684823113cd6727ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.701634 8050 tablet_replica.cc:333] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:28.702023 8050 raft_consensus.cc:2243] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:28.702627 8050 pending_rounds.cc:70] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:28.702726 8050 pending_rounds.cc:77] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737186007425024 op_type: NO_OP noop_request { }
I20260505 20:13:28.702999 8447 raft_consensus.cc:2804] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.703213 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:28.706812 8447 raft_consensus.cc:493] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.706947 8447 raft_consensus.cc:3060] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.706110 8054 consensus_queue.cc:260] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:28.708146 7598 consensus_peers.cc:597] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef996218e8b14e3b80eeab3397edec57. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:28.709704 8050 raft_consensus.cc:2889] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:28.709968 8054 ts_tablet_manager.cc:1434] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.046s user 0.001s sys 0.001s
I20260505 20:13:28.711249 8054 tablet_bootstrap.cc:492] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:28.712061 8050 raft_consensus.cc:2272] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.713002 8050 ts_tablet_manager.cc:1916] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:28.713325 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6166653cbc58470c8ba4926048ba1384 consensus state has no leader
I20260505 20:13:28.719627 8051 ts_tablet_manager.cc:1929] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.725956 8447 raft_consensus.cc:515] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.727456 8051 log.cc:1199] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c104bd9c39af48449718b0c7f327f6ec
I20260505 20:13:28.728221 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.728650 8051 ts_tablet_manager.cc:1950] T c104bd9c39af48449718b0c7f327f6ec P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:28.728881 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_318c908c4ab241c09ed344cd15203aea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.729049 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 317) took 1521 ms. Trace:
I20260505 20:13:28.729136 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.729146 8051 rpcz_store.cc:276] 0505 20:13:27.207590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.208391 (+ 801us) service_pool.cc:224] Handling call
0505 20:13:28.629560 (+1421169us) ts_tablet_manager.cc:1151] Deleting tablet c104bd9c39af48449718b0c7f327f6ec
0505 20:13:28.629570 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.715307 (+ 85737us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.719545 (+ 4238us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.728995 (+ 9450us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420979}
W20260505 20:13:28.729424 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_318c908c4ab241c09ed344cd15203aea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:28.729519 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.729534 8051 tablet_replica.cc:333] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:28.729718 8051 raft_consensus.cc:2243] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.729935 8051 raft_consensus.cc:2272] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.730378 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c104bd9c39af48449718b0c7f327f6ec (table default.Table_0dd057d830894bc0a635f56b257151d7 [id=7517daa10e164e339a320e44a40bebda]) successfully deleted
I20260505 20:13:28.730474 8051 ts_tablet_manager.cc:1916] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.730850 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_fb996331a7e24a51a33fa182ef600060"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.731369 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:28.731940 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb996331a7e24a51a33fa182ef600060 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:28.750964 7736 leader_election.cc:343] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.752228 8053 raft_consensus.cc:359] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.752381 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.752499 8053 raft_consensus.cc:385] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.752259 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.754566 8053 raft_consensus.cc:740] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.755084 8490 leader_election.cc:290] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.755498 7801 raft_consensus.cc:2468] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
W20260505 20:13:28.755818 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 80990.3us
I20260505 20:13:28.757131 7596 leader_election.cc:304] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:28.757489 8557 raft_consensus.cc:2804] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.757609 8557 raft_consensus.cc:493] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.757692 8557 raft_consensus.cc:3060] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.760416 7936 raft_consensus.cc:2393] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
W20260505 20:13:28.760434 7737 leader_election.cc:343] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 6cf77f6323af4263852853e10003faee
I20260505 20:13:28.762249 8447 leader_election.cc:290] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.736828 8054 tablet_bootstrap.cc:654] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.763015 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:28.754882 8053 consensus_queue.cc:260] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.763868 7737 leader_election.cc:304] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:28.765170 7596 consensus_peers.cc:597] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef996218e8b14e3b80eeab3397edec57. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:28.768668 8557 raft_consensus.cc:515] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.769654 7663 raft_consensus.cc:2393] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:28.770047 8557 leader_election.cc:290] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.770568 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:28.770802 7936 raft_consensus.cc:2393] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:28.772045 8490 raft_consensus.cc:2749] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.774494 8053 ts_tablet_manager.cc:1434] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.149s user 0.003s sys 0.000s
I20260505 20:13:28.774884 8053 tablet_bootstrap.cc:492] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:28.782847 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:28.783142 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "983ad31892394f67a7a9a727dc2bef1b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:28.785347 7596 leader_election.cc:304] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:28.785925 8557 raft_consensus.cc:2749] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.791627 7801 raft_consensus.cc:3060] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.792254 8053 tablet_bootstrap.cc:654] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.798296 7801 raft_consensus.cc:2468] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:28.800767 7869 leader_election.cc:304] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.803308 8447 raft_consensus.cc:2804] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:28.804111 8447 raft_consensus.cc:697] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:28.804502 8447 consensus_queue.cc:237] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.811990 8052 ts_tablet_manager.cc:1929] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.817512 8050 ts_tablet_manager.cc:1929] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:28.817819 8050 log.cc:1199] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/923ed274fe454cc4a625516769e6b5f3
I20260505 20:13:28.818434 8050 ts_tablet_manager.cc:1950] T 923ed274fe454cc4a625516769e6b5f3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:28.820297 8052 log.cc:1199] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e0f86a888c5e4fb3acbd78f68c81576f
I20260505 20:13:28.820925 8052 ts_tablet_manager.cc:1950] T e0f86a888c5e4fb3acbd78f68c81576f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:28.825918 8566 tablet.cc:1724] T b9b375a4bbec4527af704aa6cd08acec P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:28.826313 8512 raft_consensus.cc:493] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.826488 8512 raft_consensus.cc:515] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.827209 8512 leader_election.cc:290] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.828197 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e800dfb0354beab9c835cbed9dceb4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.828301 8054 tablet_bootstrap.cc:492] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:28.828469 8054 ts_tablet_manager.cc:1403] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.006s
W20260505 20:13:28.829295 7870 leader_election.cc:343] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.829850 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e800dfb0354beab9c835cbed9dceb4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:28.831022 7869 leader_election.cc:343] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.831166 7869 leader_election.cc:304] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.831652 8512 raft_consensus.cc:2749] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:28.834117 7327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.253:39345, user_credentials={real_user=slave}} blocked reactor thread for 93174.7us
I20260505 20:13:28.836211 8531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "73028cd481e446daa9432a35522a7967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:28.836424 8531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:28.836601 8053 tablet_bootstrap.cc:492] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:28.836825 8053 ts_tablet_manager.cc:1403] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.005s
I20260505 20:13:28.837670 8053 raft_consensus.cc:359] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.837951 8053 raft_consensus.cc:385] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.838073 8053 raft_consensus.cc:740] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.838364 8053 consensus_queue.cc:260] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.839229 8053 ts_tablet_manager.cc:1434] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:28.839615 8053 tablet_bootstrap.cc:492] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:28.841156 7736 consensus_peers.cc:597] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:28.841455 8053 tablet_bootstrap.cc:654] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.821669 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 342) took 1603 ms. Trace:
W20260505 20:13:28.841470 7329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.252:42521, user_credentials={real_user=slave}} blocked reactor thread for 198840us
I20260505 20:13:28.829289 8054 raft_consensus.cc:359] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.847647 8054 raft_consensus.cc:385] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.847697 7870 leader_election.cc:304] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.847764 8054 raft_consensus.cc:740] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.848102 8054 consensus_queue.cc:260] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.849900 8512 raft_consensus.cc:3060] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.853057 8512 raft_consensus.cc:2749] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.856549 8054 ts_tablet_manager.cc:1434] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260505 20:13:28.820324 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 350) took 1166 ms. Trace:
I20260505 20:13:28.860919 8050 rpcz_store.cc:276] 0505 20:13:27.654146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.654199 (+ 53us) service_pool.cc:224] Handling call
0505 20:13:28.682499 (+1028300us) ts_tablet_manager.cc:1151] Deleting tablet 923ed274fe454cc4a625516769e6b5f3
0505 20:13:28.682514 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.757411 (+ 74897us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.817422 (+ 60011us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.820252 (+ 2830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1028125}
I20260505 20:13:28.861653 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 923ed274fe454cc4a625516769e6b5f3 (table default.Table_b8dc23a61d1044d387ba34de22f570cb [id=580de9a798e54694a39a898d5fe4ab1b]) successfully deleted
I20260505 20:13:28.862633 8054 tablet_bootstrap.cc:492] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:28.862887 8050 tablet_replica.cc:333] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:28.863325 8050 raft_consensus.cc:2243] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.863657 8050 raft_consensus.cc:2272] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.864265 8050 ts_tablet_manager.cc:1916] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.865460 8051 ts_tablet_manager.cc:1929] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:28.865607 8051 log.cc:1199] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/d2841214f07b4ae6b8cd7e97493b69d6
I20260505 20:13:28.869609 8058 tablet_bootstrap.cc:492] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:28.869802 8058 ts_tablet_manager.cc:1403] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.300s user 0.008s sys 0.007s
I20260505 20:13:28.870508 8512 raft_consensus.cc:493] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.870718 8512 raft_consensus.cc:515] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.871770 8512 leader_election.cc:290] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:28.872766 8058 raft_consensus.cc:359] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.873006 8058 raft_consensus.cc:385] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.873142 8058 raft_consensus.cc:740] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.873445 8058 consensus_queue.cc:260] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.874105 8058 ts_tablet_manager.cc:1434] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:28.874548 8058 tablet_bootstrap.cc:492] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:28.873697 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1f7a0fefa74f45a1cf3ffeac2c33fb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:28.876586 7870 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.878461 8079 raft_consensus.cc:493] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.878676 8079 raft_consensus.cc:515] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:28.880483 7598 leader_election.cc:343] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f32d3ec040604ce7b384c4b6a202707f
I20260505 20:13:28.882129 8079 leader_election.cc:290] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.882485 8051 ts_tablet_manager.cc:1950] T d2841214f07b4ae6b8cd7e97493b69d6 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:28.882867 8568 raft_consensus.cc:493] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:28.883046 8568 raft_consensus.cc:515] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.884053 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 318) took 1676 ms. Trace:
I20260505 20:13:28.884168 8051 rpcz_store.cc:276] 0505 20:13:27.207729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.208626 (+ 897us) service_pool.cc:224] Handling call
0505 20:13:28.729446 (+1520820us) ts_tablet_manager.cc:1151] Deleting tablet d2841214f07b4ae6b8cd7e97493b69d6
0505 20:13:28.729456 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.748682 (+ 19226us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.865356 (+116674us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.884020 (+ 18664us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1520584}
I20260505 20:13:28.884609 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet d2841214f07b4ae6b8cd7e97493b69d6 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]) successfully deleted
I20260505 20:13:28.886508 8058 tablet_bootstrap.cc:654] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.891574 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2036d69d672348c0b08335df0c49d801"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.892113 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2036d69d672348c0b08335df0c49d801 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.893452 7334 master_service.cc:954] ReplaceTablet: received request to replace tablet 8c8754580368453aa0aae021d8c665da from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.893852 8050 ts_tablet_manager.cc:1929] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:28.894011 8050 log.cc:1199] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/74a5d442f25242ea8371fca8643f4ce6
I20260505 20:13:28.894078 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1cd5f89bd70c4112b673b1a54ce5dc61" } new_table_name: "default.Table_5bb1f646bb2b47d8a6a36d6964937b3d" modify_external_catalogs: true
I20260505 20:13:28.894492 8050 ts_tablet_manager.cc:1950] T 74a5d442f25242ea8371fca8643f4ce6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:28.894609 7596 leader_election.cc:343] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: f32d3ec040604ce7b384c4b6a202707f
I20260505 20:13:28.894752 7596 leader_election.cc:304] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:28.895156 8079 raft_consensus.cc:2749] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.895304 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 353) took 1134 ms. Trace:
I20260505 20:13:28.895408 8050 rpcz_store.cc:276] 0505 20:13:27.761124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.762160 (+ 1036us) service_pool.cc:224] Handling call
0505 20:13:28.862718 (+1100558us) ts_tablet_manager.cc:1151] Deleting tablet 74a5d442f25242ea8371fca8643f4ce6
0505 20:13:28.862804 (+ 86us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.890658 (+ 27854us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.893733 (+ 3075us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.895253 (+ 1520us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100347}
I20260505 20:13:28.895509 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_471e002676d8465fb3a2af7b858cd2c0" } modify_external_catalogs: true
I20260505 20:13:28.895668 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_471e002676d8465fb3a2af7b858cd2c0" } modify_external_catalogs: true
I20260505 20:13:28.896441 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6407eb94904a4c3db461964a5e97fe89" } modify_external_catalogs: true
I20260505 20:13:28.896588 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6407eb94904a4c3db461964a5e97fe89" } modify_external_catalogs: true
I20260505 20:13:28.896973 8051 tablet_replica.cc:333] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:28.898615 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4ea5fcb558489097e518a28ad967dd" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:28.900662 8051 raft_consensus.cc:2243] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.900852 8051 raft_consensus.cc:2272] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.903451 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1f7a0fefa74f45a1cf3ffeac2c33fb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:28.905376 8052 rpcz_store.cc:276] 0505 20:13:27.218055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.219224 (+ 1169us) service_pool.cc:224] Handling call
0505 20:13:28.561012 (+1341788us) ts_tablet_manager.cc:1151] Deleting tablet e0f86a888c5e4fb3acbd78f68c81576f
0505 20:13:28.561023 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.778737 (+217714us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.811910 (+ 33173us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:28.821612 (+ 9702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341579}
W20260505 20:13:28.906733 7736 leader_election.cc:343] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.907044 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (DEFAULT_TABLE table=default.Table_1bd6d826ee3e43e49cc3f1cde7ee0db4 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.907317 7782 tablet_service.cc:1511] Processing CreateTablet for tablet a25cb36420534396a0850aef61706ae1 (DEFAULT_TABLE table=default.Table_9ee9fc9d6bc948fd90db78cd1670d21f [id=9a219602b64942a8af58f84cf59a5cdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.907526 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.910949 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e0f86a888c5e4fb3acbd78f68c81576f (table default.Table_99c224cd93784af1a21c3c3260971518 [id=e0008576d3f44c03b0244b28e61ccdc8]) successfully deleted
I20260505 20:13:28.911387 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25cb36420534396a0850aef61706ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.916877 7632 tablet_service.cc:1511] Processing CreateTablet for tablet a25cb36420534396a0850aef61706ae1 (DEFAULT_TABLE table=default.Table_9ee9fc9d6bc948fd90db78cd1670d21f [id=9a219602b64942a8af58f84cf59a5cdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.917378 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25cb36420534396a0850aef61706ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.922389 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 010c399e14624550bf02ea248d653538 (DEFAULT_TABLE table=default.Table_de020072b593488985be61cca360d781 [id=15b05f0bcd1b404b96dd77363daecb84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.922776 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010c399e14624550bf02ea248d653538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.923803 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_89dfd83915c249d2bfd6edc8f86c2acf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:28.921485 8568 leader_election.cc:290] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.929044 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 010c399e14624550bf02ea248d653538 (DEFAULT_TABLE table=default.Table_de020072b593488985be61cca360d781 [id=15b05f0bcd1b404b96dd77363daecb84]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:28.929169 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89dfd83915c249d2bfd6edc8f86c2acf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.929478 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010c399e14624550bf02ea248d653538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.931695 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (DEFAULT_TABLE table=default.Table_1bd6d826ee3e43e49cc3f1cde7ee0db4 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.932051 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:28.932458 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 359ab1033ccf4445862867f3f8b78ecd has no consensus state
I20260505 20:13:28.932865 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d4c051042c544a609b797ef905f8d285" } new_table_name: "default.Table_845141420b9849e2ad45bce8bf2b9ddc" modify_external_catalogs: true
I20260505 20:13:28.933048 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 92ed62f9b81e48459c6d55664ddf1cc6 (DEFAULT_TABLE table=default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4 [id=89d7fca8e0d64a81964d8dca6676cbb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.933290 8058 tablet_bootstrap.cc:492] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:28.933382 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ed62f9b81e48459c6d55664ddf1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.933456 8058 ts_tablet_manager.cc:1403] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20260505 20:13:28.934135 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 71a30738cb354b2c839f76b5d3b3be96 (DEFAULT_TABLE table=default.Table_0f1a1d7075f84270a8c989ffdfc15f6a [id=94c086eb9e3f415086757ebb469ca6c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.934296 8058 raft_consensus.cc:359] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.934464 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a30738cb354b2c839f76b5d3b3be96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.934497 8058 raft_consensus.cc:385] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:28.934582 8058 raft_consensus.cc:740] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:28.934830 8058 consensus_queue.cc:260] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.936156 8051 ts_tablet_manager.cc:1916] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.942656 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 71a30738cb354b2c839f76b5d3b3be96 (DEFAULT_TABLE table=default.Table_0f1a1d7075f84270a8c989ffdfc15f6a [id=94c086eb9e3f415086757ebb469ca6c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.943199 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a30738cb354b2c839f76b5d3b3be96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.944098 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 353) took 1451 ms. Trace:
I20260505 20:13:28.955564 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 92ed62f9b81e48459c6d55664ddf1cc6 (DEFAULT_TABLE table=default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4 [id=89d7fca8e0d64a81964d8dca6676cbb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.956017 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ed62f9b81e48459c6d55664ddf1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.956243 8566 tablet.cc:1724] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:28.952173 8052 rpcz_store.cc:276] 0505 20:13:27.456757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.489777 (+ 33020us) service_pool.cc:224] Handling call
0505 20:13:28.905943 (+1416166us) ts_tablet_manager.cc:1151] Deleting tablet 64a82a9d144746338b3fc6550aa35d3c
0505 20:13:28.905953 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.907859 (+ 1906us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415719}
W20260505 20:13:28.956974 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 64a82a9d144746338b3fc6550aa35d3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a82a9d144746338b3fc6550aa35d3c already in progress: creating tablet
I20260505 20:13:28.957607 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 354) took 1449 ms. Trace:
I20260505 20:13:28.957700 8052 rpcz_store.cc:276] 0505 20:13:27.508256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.508315 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:28.957288 (+1448973us) ts_tablet_manager.cc:1151] Deleting tablet e041ebc882b14484a51fe3a6589cddd6
0505 20:13:28.957300 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.957553 (+ 253us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1448723}
W20260505 20:13:28.958187 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e041ebc882b14484a51fe3a6589cddd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e041ebc882b14484a51fe3a6589cddd6 already in progress: creating tablet
I20260505 20:13:28.958531 8052 tablet_replica.cc:333] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:28.958755 8052 raft_consensus.cc:2243] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:28.958940 8052 raft_consensus.cc:2272] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:28.959486 8052 ts_tablet_manager.cc:1916] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:28.966915 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 4816f1ccb82e4641b2dcfe9ce9b55fae
I20260505 20:13:28.967120 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet bcd289ce979940ae96554d5756d140d7
I20260505 20:13:28.967830 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bf62bacfeaa24c4ca237490e17c20ad8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:28.968458 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf62bacfeaa24c4ca237490e17c20ad8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:28.968900 7339 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:28.969933 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e6c5c661e8aa4962bb9922b9ead7d784
I20260505 20:13:28.970208 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_72dc9ef65e1442a8ac2e33e7ca75b20d" } new_table_name: "default.Table_133f54e3650c43b59175c563864bd932" modify_external_catalogs: true
I20260505 20:13:28.970618 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1897c19ad8a941ec9278d5f5fd46a14c" } new_table_name: "default.Table_6e7bc0332ed94714b743dec41811c5d6" modify_external_catalogs: true
I20260505 20:13:28.972718 7342 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]). Expected version 1 got 0
I20260505 20:13:28.972921 7342 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_08e8ff8899e844538e9421366d07e8a4 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 1 got 0
I20260505 20:13:28.973614 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 4e6da3130e724445b0d1f3c20e4e3d02
I20260505 20:13:28.974256 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.974434 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.966935 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 8c8754580368453aa0aae021d8c665da
I20260505 20:13:28.975018 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.975236 7334 catalog_manager.cc:6741] ReplaceTablet: tablet 8c8754580368453aa0aae021d8c665da deleted and replaced by tablet 59f5348c229744ab98f0de3da40de6c5
I20260505 20:13:28.975580 7335 master_service.cc:954] ReplaceTablet: received request to replace tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:28.975581 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_179af68819324947a142bb734a25e38c" } new_table_name: "default.Table_51fcf065d7704d8c9a54e578cce315d4" modify_external_catalogs: true
I20260505 20:13:28.978094 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.978138 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.978201 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c8754580368453aa0aae021d8c665da with delete_type TABLET_DATA_DELETED (replaced by tablet 59f5348c229744ab98f0de3da40de6c5) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.978094 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6da3130e724445b0d1f3c20e4e3d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.978334 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.978840 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6da3130e724445b0d1f3c20e4e3d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.979197 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.864444 8054 tablet_bootstrap.cc:654] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:28.902772 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4ea5fcb558489097e518a28ad967dd" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:28.979570 7936 raft_consensus.cc:2468] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:28.904017 7869 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.979869 7869 leader_election.cc:304] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:28.980233 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 76256.3us
I20260505 20:13:28.910458 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (DEFAULT_TABLE table=default.Table_1bd6d826ee3e43e49cc3f1cde7ee0db4 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.980820 8447 raft_consensus.cc:2749] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:28.910815 7914 tablet_service.cc:1511] Processing CreateTablet for tablet a25cb36420534396a0850aef61706ae1 (DEFAULT_TABLE table=default.Table_9ee9fc9d6bc948fd90db78cd1670d21f [id=9a219602b64942a8af58f84cf59a5cdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.919117 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 010c399e14624550bf02ea248d653538 (DEFAULT_TABLE table=default.Table_de020072b593488985be61cca360d781 [id=15b05f0bcd1b404b96dd77363daecb84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.981293 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.983156 7737 leader_election.cc:304] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:28.984422 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:28.985872 8568 raft_consensus.cc:2804] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:28.985991 8568 raft_consensus.cc:493] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:28.986094 8568 raft_consensus.cc:3060] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:28.986243 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_d940540a0f0347a396258cd69ee109ec [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 3 got 0
I20260505 20:13:28.986518 7338 catalog_manager.cc:5671] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:28.986992 7338 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:28.988965 8568 raft_consensus.cc:515] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:28.920599 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 71a30738cb354b2c839f76b5d3b3be96 (DEFAULT_TABLE table=default.Table_0f1a1d7075f84270a8c989ffdfc15f6a [id=94c086eb9e3f415086757ebb469ca6c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.939333 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 92ed62f9b81e48459c6d55664ddf1cc6 (DEFAULT_TABLE table=default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4 [id=89d7fca8e0d64a81964d8dca6676cbb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:28.954119 8558 tablet.cc:1724] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:28.990124 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4ea5fcb558489097e518a28ad967dd" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:28.972496 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.972666 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.972820 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.974886 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e6da3130e724445b0d1f3c20e4e3d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.976624 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c8754580368453aa0aae021d8c665da with delete_type TABLET_DATA_DELETED (replaced by tablet 59f5348c229744ab98f0de3da40de6c5) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.979046 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 923ed274fe454cc4a625516769e6b5f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:28.991019 7736 leader_election.cc:343] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:28.991202 8568 leader_election.cc:290] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:28.992007 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:28.991995 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:28.992455 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010c399e14624550bf02ea248d653538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:28.994343 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 74a5d442f25242ea8371fca8643f4ce6 (table default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8]) successfully deleted
I20260505 20:13:28.996109 8304 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "cab133462c2f46309dc8f0792122bad9" instance_seqno: 1778011999975983) as {username='slave'} at 127.7.33.193:45035; Asking this server to re-register.
I20260505 20:13:28.996383 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c8754580368453aa0aae021d8c665da with delete_type TABLET_DATA_DELETED (replaced by tablet 59f5348c229744ab98f0de3da40de6c5) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:28.997352 7709 heartbeater.cc:461] Registering TS with master...
W20260505 20:13:29.000814 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 880cbba188144dd795873186f8cda1e9 consensus state has no leader
I20260505 20:13:29.005781 8304 ts_manager.cc:194] Registered new tserver with Master: cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:29.005808 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25cb36420534396a0850aef61706ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.008868 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4ea5fcb558489097e518a28ad967dd" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:29.009078 7936 raft_consensus.cc:3060] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:29.009802 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a30738cb354b2c839f76b5d3b3be96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.010659 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ed62f9b81e48459c6d55664ddf1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.013586 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:29.017244 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 506b421a774c4929813205dba0fac32b consensus state has no leader
W20260505 20:13:29.017865 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 consensus state has no leader
W20260505 20:13:29.020439 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65003660c44547cc8674baeca370e395 consensus state has no leader
I20260505 20:13:29.020437 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.021036 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0
I20260505 20:13:29.021664 7336 catalog_manager.cc:6741] ReplaceTablet: tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 deleted and replaced by tablet f5dfabb36fa5499780b0d15c71404307
I20260505 20:13:29.022343 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.025833 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.033186 7936 raft_consensus.cc:2468] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:29.041967 7737 leader_election.cc:304] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:29.044034 7336 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1] alter complete (version 1)
I20260505 20:13:29.046149 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 9845d42fafa14457bd6c54d7477786aa (DEFAULT_TABLE table=default.Table_8cc3cc188c8c40d1ac809b3372dca56e [id=8615ba1d02294f9fa642bd1336064950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.046778 8568 raft_consensus.cc:2804] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:29.046989 8568 raft_consensus.cc:697] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:29.047394 8568 consensus_queue.cc:237] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.047911 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 9845d42fafa14457bd6c54d7477786aa (DEFAULT_TABLE table=default.Table_8cc3cc188c8c40d1ac809b3372dca56e [id=8615ba1d02294f9fa642bd1336064950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.048393 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9845d42fafa14457bd6c54d7477786aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.055536 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9845d42fafa14457bd6c54d7477786aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.060839 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 367) took 1260 ms. Trace:
I20260505 20:13:29.061080 8050 rpcz_store.cc:276] 0505 20:13:27.800828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.809620 (+ 8792us) service_pool.cc:224] Handling call
0505 20:13:28.994756 (+1185136us) ts_tablet_manager.cc:1151] Deleting tablet e69bdfc75a494635837178cb16c08c1c
0505 20:13:28.994766 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.060788 (+ 66022us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1184872}
W20260505 20:13:29.062182 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e69bdfc75a494635837178cb16c08c1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69bdfc75a494635837178cb16c08c1c already in progress: creating tablet
W20260505 20:13:29.063526 7327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.253:39345, user_credentials={real_user=slave}} blocked reactor thread for 66261.4us
I20260505 20:13:29.064179 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.065267 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet f32d3ec040604ce7b384c4b6a202707f with delete_type TABLET_DATA_DELETED (replaced by tablet bda4fd8b0f214da7a1e8b944e1820c0c) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.073345 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 364) took 1272 ms. Trace:
I20260505 20:13:29.073607 8050 rpcz_store.cc:276] 0505 20:13:27.800460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.809794 (+ 9334us) service_pool.cc:224] Handling call
0505 20:13:29.061684 (+1251890us) ts_tablet_manager.cc:1151] Deleting tablet 0d5ed062508b411eb0fa5a14637830ea
0505 20:13:29.061694 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.073281 (+ 11587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251669}
W20260505 20:13:29.074358 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 0d5ed062508b411eb0fa5a14637830ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d5ed062508b411eb0fa5a14637830ea already in progress: creating tablet
I20260505 20:13:29.077072 8058 ts_tablet_manager.cc:1434] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.144s user 0.003s sys 0.000s
I20260505 20:13:29.077440 8058 tablet_bootstrap.cc:492] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:29.079427 8058 tablet_bootstrap.cc:654] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.080201 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdd0cf6cefa43388b22cbd1cee820b6 (DEFAULT_TABLE table=default.Table_776d125a74a244a89a055dcff3489919 [id=33fc6a636c5649dba50f235c90a0019d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.080678 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdd0cf6cefa43388b22cbd1cee820b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.085390 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 1d417bb8f3ac4343807e9ff4971eb2ad (DEFAULT_TABLE table=default.Table_f3fcc55304b0403ba6e8e01eaad6da3d [id=d0bbfeb85a1348a284c8fba1e1a17969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.085870 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d417bb8f3ac4343807e9ff4971eb2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.087610 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 368) took 1250 ms. Trace:
I20260505 20:13:29.087777 8447 raft_consensus.cc:493] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:29.087976 8447 raft_consensus.cc:515] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.088637 8447 leader_election.cc:290] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:29.090296 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034852d91c26434f8a3c7fd8100c49ac" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:29.090824 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034852d91c26434f8a3c7fd8100c49ac" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:29.090950 7870 leader_election.cc:343] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:29.091526 8052 ts_tablet_manager.cc:1929] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.091677 8052 log.cc:1199] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/6ec1037f771740d1a094a622d5e49082
I20260505 20:13:29.092048 8052 ts_tablet_manager.cc:1950] T 6ec1037f771740d1a094a622d5e49082 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:29.092918 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 355) took 1576 ms. Trace:
W20260505 20:13:29.093310 7869 leader_election.cc:343] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:29.093448 7869 leader_election.cc:304] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:29.093863 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdd0cf6cefa43388b22cbd1cee820b6 (DEFAULT_TABLE table=default.Table_776d125a74a244a89a055dcff3489919 [id=33fc6a636c5649dba50f235c90a0019d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.093933 8447 raft_consensus.cc:2749] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:29.094308 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdd0cf6cefa43388b22cbd1cee820b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.087805 8050 rpcz_store.cc:276] 0505 20:13:27.836983 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.841287 (+ 4304us) service_pool.cc:224] Handling call
0505 20:13:29.087411 (+1246124us) ts_tablet_manager.cc:1151] Deleting tablet 8f1505e592e543cca92d8949bdae007e
0505 20:13:29.087422 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.087552 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245859}
I20260505 20:13:29.095590 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 369) took 1258 ms. Trace:
I20260505 20:13:29.095691 8050 rpcz_store.cc:276] 0505 20:13:27.837087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.845153 (+ 8066us) service_pool.cc:224] Handling call
0505 20:13:29.095424 (+1250271us) ts_tablet_manager.cc:1151] Deleting tablet d138d27f444f45d28acdc7d72a9649f5
0505 20:13:29.095438 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.095550 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1247373}
I20260505 20:13:29.096169 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 371) took 1161 ms. Trace:
I20260505 20:13:29.096334 8050 rpcz_store.cc:276] 0505 20:13:27.934544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.934616 (+ 72us) service_pool.cc:224] Handling call
0505 20:13:29.096039 (+1161423us) ts_tablet_manager.cc:1151] Deleting tablet 8e650b297603425184ad97ddf99ec36d
0505 20:13:29.096052 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.096141 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161109}
I20260505 20:13:29.097117 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 372) took 1149 ms. Trace:
I20260505 20:13:29.097396 8050 rpcz_store.cc:276] 0505 20:13:27.947959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.948023 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:29.096649 (+1148626us) ts_tablet_manager.cc:1151] Deleting tablet 7214ab77d7904f0e9d37cb8d7a5a53a4
0505 20:13:29.096657 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.097084 (+ 427us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148375}
I20260505 20:13:29.097517 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 1d417bb8f3ac4343807e9ff4971eb2ad (DEFAULT_TABLE table=default.Table_f3fcc55304b0403ba6e8e01eaad6da3d [id=d0bbfeb85a1348a284c8fba1e1a17969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.097980 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d417bb8f3ac4343807e9ff4971eb2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.098261 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.099645 8051 ts_tablet_manager.cc:1929] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.099781 8051 log.cc:1199] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/862e865d406c4d95b97b579e9fe07df0
I20260505 20:13:29.100111 8051 ts_tablet_manager.cc:1950] T 862e865d406c4d95b97b579e9fe07df0 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.101235 8058 tablet_bootstrap.cc:492] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:29.101397 8058 ts_tablet_manager.cc:1403] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260505 20:13:29.102079 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 370) took 1181 ms. Trace:
I20260505 20:13:29.102217 8050 rpcz_store.cc:276] 0505 20:13:27.920645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.002719 (+ 82074us) service_pool.cc:224] Handling call
0505 20:13:29.101871 (+1099152us) ts_tablet_manager.cc:1151] Deleting tablet c720fc66db36402a83a7690d70a40353
0505 20:13:29.101882 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.102025 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1098760}
I20260505 20:13:29.103286 8058 raft_consensus.cc:359] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.103490 8058 raft_consensus.cc:385] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.103579 8058 raft_consensus.cc:740] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.103824 8058 consensus_queue.cc:260] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.104512 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 380) took 1034 ms. Trace:
I20260505 20:13:29.104627 8050 rpcz_store.cc:276] 0505 20:13:28.070210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.070408 (+ 198us) service_pool.cc:224] Handling call
0505 20:13:29.104360 (+1033952us) ts_tablet_manager.cc:1151] Deleting tablet b6ed7c0220d147c7853c7afc1ef09607
0505 20:13:29.104372 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.104477 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033709}
I20260505 20:13:29.093045 8052 rpcz_store.cc:276] 0505 20:13:27.516232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.516296 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:28.958447 (+1442151us) ts_tablet_manager.cc:1151] Deleting tablet 6ec1037f771740d1a094a622d5e49082
0505 20:13:28.958458 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.017154 (+ 58696us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.091419 (+ 74265us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.092870 (+ 1451us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1441918}
I20260505 20:13:29.105595 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 356) took 1589 ms. Trace:
I20260505 20:13:29.105727 8052 rpcz_store.cc:276] 0505 20:13:27.516442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.516566 (+ 124us) service_pool.cc:224] Handling call
0505 20:13:29.105416 (+1588850us) ts_tablet_manager.cc:1151] Deleting tablet 949fecb197084426b5a6adb959f5c886
0505 20:13:29.105427 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.105548 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588696}
I20260505 20:13:29.106262 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 381) took 1035 ms. Trace:
I20260505 20:13:29.106361 8050 rpcz_store.cc:276] 0505 20:13:28.070357 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.070688 (+ 331us) service_pool.cc:224] Handling call
0505 20:13:29.106100 (+1035412us) ts_tablet_manager.cc:1151] Deleting tablet 54becbd4690c403e803a7a79f12cb6d5
0505 20:13:29.106112 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.106229 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035253}
I20260505 20:13:29.106978 8585 tablet.cc:1724] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:29.107872 8053 tablet_bootstrap.cc:492] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:29.107899 8557 raft_consensus.cc:493] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:29.108011 8053 ts_tablet_manager.cc:1403] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.269s user 0.002s sys 0.004s
I20260505 20:13:29.108057 8557 raft_consensus.cc:515] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.108790 8557 leader_election.cc:290] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:29.109102 8053 raft_consensus.cc:359] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.109333 8053 raft_consensus.cc:385] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.109457 8053 raft_consensus.cc:740] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.109440 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f86a888c5e4fb3acbd78f68c81576f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:29.109691 7936 raft_consensus.cc:2393] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:29.109728 8053 consensus_queue.cc:260] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:29.110116 7596 leader_election.cc:343] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: e0f86a888c5e4fb3acbd78f68c81576f
I20260505 20:13:29.110560 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 319) took 1902 ms. Trace:
I20260505 20:13:29.110636 8053 ts_tablet_manager.cc:1434] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:29.110652 8051 rpcz_store.cc:276] 0505 20:13:27.207859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.208880 (+ 1021us) service_pool.cc:224] Handling call
0505 20:13:28.896899 (+1688019us) ts_tablet_manager.cc:1151] Deleting tablet 862e865d406c4d95b97b579e9fe07df0
0505 20:13:28.896911 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:28.939273 (+ 42362us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.099565 (+160292us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.110497 (+ 10932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5819,"tablet-delete.queue_time_us":1687842}
I20260505 20:13:29.111049 8051 tablet_replica.cc:333] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.111274 8051 raft_consensus.cc:2243] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.111464 8051 raft_consensus.cc:2272] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.111613 7598 leader_election.cc:304] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:29.112229 8557 raft_consensus.cc:3060] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:29.112471 8050 tablet_replica.cc:333] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.112682 8050 raft_consensus.cc:2243] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.112843 8050 raft_consensus.cc:2272] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.113411 8050 ts_tablet_manager.cc:1916] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:29.113972 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8f1505e592e543cca92d8949bdae007e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f1505e592e543cca92d8949bdae007e already in progress: creating tablet
W20260505 20:13:29.114488 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet d138d27f444f45d28acdc7d72a9649f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d138d27f444f45d28acdc7d72a9649f5 already in progress: creating tablet
W20260505 20:13:29.114775 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8e650b297603425184ad97ddf99ec36d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e650b297603425184ad97ddf99ec36d already in progress: creating tablet
W20260505 20:13:29.115015 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 already in progress: creating tablet
W20260505 20:13:29.115249 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet c720fc66db36402a83a7690d70a40353 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c720fc66db36402a83a7690d70a40353 already in progress: creating tablet
W20260505 20:13:29.115480 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b6ed7c0220d147c7853c7afc1ef09607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6ed7c0220d147c7853c7afc1ef09607 already in progress: creating tablet
W20260505 20:13:29.115765 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 54becbd4690c403e803a7a79f12cb6d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54becbd4690c403e803a7a79f12cb6d5 already in progress: creating tablet
I20260505 20:13:29.116246 8054 tablet_bootstrap.cc:492] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.116641 8054 ts_tablet_manager.cc:1403] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.254s user 0.003s sys 0.006s
I20260505 20:13:29.118515 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 6ec1037f771740d1a094a622d5e49082 (table default.Table_efe81e982113463b9ff4f04403f0bac7 [id=c946f532ba074386ac47a7bacd2feeea]) successfully deleted
W20260505 20:13:29.119026 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 949fecb197084426b5a6adb959f5c886 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949fecb197084426b5a6adb959f5c886 already in progress: creating tablet
I20260505 20:13:29.120615 7336 master_service.cc:954] ReplaceTablet: received request to replace tablet 1e453fdf9a424fe8974076fac3ad74bf from {username='slave'} at 127.0.0.1:58274
I20260505 20:13:29.121251 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_1f4c5959987145b594d24feb4eb6a4d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.123574 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 9845d42fafa14457bd6c54d7477786aa (DEFAULT_TABLE table=default.Table_8cc3cc188c8c40d1ac809b3372dca56e [id=8615ba1d02294f9fa642bd1336064950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.124948 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_9892374ca24c4ab9a063de4b525033be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.126227 8053 tablet_bootstrap.cc:492] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:29.127216 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 357) took 1595 ms. Trace:
I20260505 20:13:29.127295 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2734568ba0294940a39a4c8768564f53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.129364 8568 consensus_queue.cc:1048] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260505 20:13:29.132422 7335 master_service.cc:954] ReplaceTablet: received request to replace tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:29.132741 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2734568ba0294940a39a4c8768564f53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.136901 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2818c22c9c4d486ea6a43294e850d902"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.137959 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f4c5959987145b594d24feb4eb6a4d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.138623 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 862e865d406c4d95b97b579e9fe07df0 (table default.Table_7c4d921cc7404bab95415fb55b417bc8 [id=c7a48b7bdb6d411794fc792531c3bd26]) successfully deleted
I20260505 20:13:29.139611 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_ac5b74d3d36f45ec9885c20f92938f45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.140714 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac5b74d3d36f45ec9885c20f92938f45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.142132 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9892374ca24c4ab9a063de4b525033be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.144536 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e52550e2986d463d9ee1c6f63903b9db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.145361 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e52550e2986d463d9ee1c6f63903b9db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.146600 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2818c22c9c4d486ea6a43294e850d902 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.148470 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_848180169f224c6b9abf96c5088933ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.149003 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_848180169f224c6b9abf96c5088933ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.131165 8054 raft_consensus.cc:359] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.150992 7337 catalog_manager.cc:5671] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:29.150442 8054 raft_consensus.cc:385] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.151652 8054 raft_consensus.cc:740] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.152230 8054 consensus_queue.cc:260] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.153349 8054 ts_tablet_manager.cc:1434] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
I20260505 20:13:29.153707 8054 tablet_bootstrap.cc:492] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.156646 8054 tablet_bootstrap.cc:654] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.162500 8050 ts_tablet_manager.cc:1929] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.162667 8050 log.cc:1199] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e0f86a888c5e4fb3acbd78f68c81576f
I20260505 20:13:29.163017 8050 ts_tablet_manager.cc:1950] T e0f86a888c5e4fb3acbd78f68c81576f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.163847 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 378) took 1109 ms. Trace:
I20260505 20:13:29.164414 7337 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_d940540a0f0347a396258cd69ee109ec [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 3 got 0
I20260505 20:13:29.169325 8050 rpcz_store.cc:276] 0505 20:13:28.054619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.055568 (+ 949us) service_pool.cc:224] Handling call
0505 20:13:29.112405 (+1056837us) ts_tablet_manager.cc:1151] Deleting tablet e0f86a888c5e4fb3acbd78f68c81576f
0505 20:13:29.112416 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.156147 (+ 43731us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.162423 (+ 6276us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.163790 (+ 1367us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031436}
I20260505 20:13:29.170171 8050 tablet_replica.cc:333] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.170476 8050 raft_consensus.cc:2243] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.170735 8050 pending_rounds.cc:70] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:29.170859 8050 pending_rounds.cc:77] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737184693006336 op_type: NO_OP noop_request { }
I20260505 20:13:29.171069 8050 raft_consensus.cc:2889] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:29.171324 8050 raft_consensus.cc:2272] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.172521 8050 ts_tablet_manager.cc:1916] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.175293 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e0f86a888c5e4fb3acbd78f68c81576f (table default.Table_99c224cd93784af1a21c3c3260971518 [id=e0008576d3f44c03b0244b28e61ccdc8]) successfully deleted
I20260505 20:13:29.175969 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7ef38a3fc00f4cdca3666e9359a5fb38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.178712 8568 raft_consensus.cc:493] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:29.179847 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ef38a3fc00f4cdca3666e9359a5fb38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.182086 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 3535f0c31ad5451ea5bceeb50f756eef (DEFAULT_TABLE table=default.Table_1d0db71b969c4ec3b297f64b2d0c71e8 [id=9ad5a74e0c2343c6b0781cf8dbe76f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.182677 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3535f0c31ad5451ea5bceeb50f756eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.185357 8568 raft_consensus.cc:515] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.192616 8050 ts_tablet_manager.cc:1929] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:29.126121 8051 ts_tablet_manager.cc:1916] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.126791 8058 ts_tablet_manager.cc:1434] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260505 20:13:29.128230 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f86a888c5e4fb3acbd78f68c81576f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.196801 8058 tablet_bootstrap.cc:492] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:29.196869 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 1d417bb8f3ac4343807e9ff4971eb2ad (DEFAULT_TABLE table=default.Table_f3fcc55304b0403ba6e8e01eaad6da3d [id=d0bbfeb85a1348a284c8fba1e1a17969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.196899 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 3535f0c31ad5451ea5bceeb50f756eef (DEFAULT_TABLE table=default.Table_1d0db71b969c4ec3b297f64b2d0c71e8 [id=9ad5a74e0c2343c6b0781cf8dbe76f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.197292 8050 log.cc:1199] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/d2841214f07b4ae6b8cd7e97493b69d6
I20260505 20:13:29.199491 8050 ts_tablet_manager.cc:1950] T d2841214f07b4ae6b8cd7e97493b69d6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.202838 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 379) took 1147 ms. Trace:
I20260505 20:13:29.203303 8050 rpcz_store.cc:276] 0505 20:13:28.054716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.055778 (+ 1062us) service_pool.cc:224] Handling call
0505 20:13:29.170084 (+1114306us) ts_tablet_manager.cc:1151] Deleting tablet d2841214f07b4ae6b8cd7e97493b69d6
0505 20:13:29.170095 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.189349 (+ 19254us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.192531 (+ 3182us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.202589 (+ 10058us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1084229}
I20260505 20:13:29.195863 8557 raft_consensus.cc:2749] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:29.205200 8050 tablet_replica.cc:333] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.206050 8050 raft_consensus.cc:2243] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.206765 8050 raft_consensus.cc:2272] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.195835 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 5bdd0cf6cefa43388b22cbd1cee820b6 (DEFAULT_TABLE table=default.Table_776d125a74a244a89a055dcff3489919 [id=33fc6a636c5649dba50f235c90a0019d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.196281 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9845d42fafa14457bd6c54d7477786aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.208528 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d417bb8f3ac4343807e9ff4971eb2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.210505 8058 tablet_bootstrap.cc:654] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.214069 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3535f0c31ad5451ea5bceeb50f756eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.218067 8050 ts_tablet_manager.cc:1916] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.222054 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdd0cf6cefa43388b22cbd1cee820b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.228108 8058 tablet_bootstrap.cc:492] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:29.228317 8058 ts_tablet_manager.cc:1403] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.005s
I20260505 20:13:29.229276 8058 raft_consensus.cc:359] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.229507 8058 raft_consensus.cc:385] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.229588 8058 raft_consensus.cc:740] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.229914 8058 consensus_queue.cc:260] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.233860 8058 ts_tablet_manager.cc:1434] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:29.234251 8058 tablet_bootstrap.cc:492] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:29.236119 8058 tablet_bootstrap.cc:654] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.241904 8050 ts_tablet_manager.cc:1929] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.242988 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2cdd70905bf04e9da6c310c3df99d628" } modify_external_catalogs: true
I20260505 20:13:29.243328 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2cdd70905bf04e9da6c310c3df99d628" } modify_external_catalogs: true
I20260505 20:13:29.245270 8050 log.cc:1199] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b596f03adbea413b813c9037d4243fae
I20260505 20:13:29.245903 8050 ts_tablet_manager.cc:1950] T b596f03adbea413b813c9037d4243fae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.246779 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 384) took 1168 ms. Trace:
I20260505 20:13:29.250166 8050 rpcz_store.cc:276] 0505 20:13:28.078208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.078363 (+ 155us) service_pool.cc:224] Handling call
0505 20:13:29.204829 (+1126466us) ts_tablet_manager.cc:1151] Deleting tablet b596f03adbea413b813c9037d4243fae
0505 20:13:29.204845 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.221687 (+ 16842us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.241790 (+ 20103us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.246741 (+ 4951us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118797}
I20260505 20:13:29.250454 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_de020072b593488985be61cca360d781" } new_table_name: "default.Table_04fbe642f303409aa1460277282bd5ef" modify_external_catalogs: true
I20260505 20:13:29.250785 8050 tablet_replica.cc:333] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.250995 8050 raft_consensus.cc:2243] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.251178 8050 raft_consensus.cc:2272] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.253165 8050 ts_tablet_manager.cc:1916] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.253729 7628 tablet_service.cc:1511] Processing CreateTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b (DEFAULT_TABLE table=default.Table_18b6a5de2149454d876ffde71ee2f43e [id=7c8b32a27dad4b07b76e53e77fbfa282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.254233 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32ff17c39f04bc2b1c9c37a1165399b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.264437 8050 ts_tablet_manager.cc:1929] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.264678 8050 log.cc:1199] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/a026a8408ed9462b820b560a98dcabd1
I20260505 20:13:29.265618 8050 ts_tablet_manager.cc:1950] T a026a8408ed9462b820b560a98dcabd1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.266974 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 383) took 1188 ms. Trace:
I20260505 20:13:29.267060 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1dd7483dde8948a787cb771f42d23f8e" } modify_external_catalogs: true
I20260505 20:13:29.267138 8050 rpcz_store.cc:276] 0505 20:13:28.078113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.079048 (+ 935us) service_pool.cc:224] Handling call
0505 20:13:29.250711 (+1171663us) ts_tablet_manager.cc:1151] Deleting tablet a026a8408ed9462b820b560a98dcabd1
0505 20:13:29.250723 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.260489 (+ 9766us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.264353 (+ 3864us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.266918 (+ 2565us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161405}
I20260505 20:13:29.268329 8050 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47490 (request call id 395) took 1056 ms. Trace:
I20260505 20:13:29.268510 8050 rpcz_store.cc:276] 0505 20:13:28.211478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.215872 (+ 4394us) service_pool.cc:224] Handling call
0505 20:13:29.267686 (+1051814us) ts_tablet_manager.cc:1151] Deleting tablet f2b2e40635b141c59d3789aca81efba7
0505 20:13:29.267701 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.268261 (+ 560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1051544}
I20260505 20:13:29.272384 8050 tablet_replica.cc:333] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.272660 8050 raft_consensus.cc:2243] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.272883 8050 raft_consensus.cc:2272] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.273438 8050 ts_tablet_manager.cc:1916] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.276738 7341 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4236c5f7709145e588050eb7b3d4ae44" } modify_external_catalogs: true
I20260505 20:13:29.276899 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5dcf10cdc4bc4312b75088ac10f28253" } modify_external_catalogs: true
I20260505 20:13:29.277280 7341 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4236c5f7709145e588050eb7b3d4ae44" } modify_external_catalogs: true
I20260505 20:13:29.275022 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet d2841214f07b4ae6b8cd7e97493b69d6 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]) successfully deleted
W20260505 20:13:29.277905 7328 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 73092.8us
I20260505 20:13:29.278863 7912 tablet_service.cc:1511] Processing CreateTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b (DEFAULT_TABLE table=default.Table_18b6a5de2149454d876ffde71ee2f43e [id=7c8b32a27dad4b07b76e53e77fbfa282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.279286 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32ff17c39f04bc2b1c9c37a1165399b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.280630 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1dd7483dde8948a787cb771f42d23f8e" } modify_external_catalogs: true
I20260505 20:13:29.283401 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbc2221555e4f598d65835ae640fe4a (DEFAULT_TABLE table=default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.283880 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbc2221555e4f598d65835ae640fe4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:29.285542 7328 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet b393bfc209b6461aab958ebf49014d25 (table default.Table_1dd7483dde8948a787cb771f42d23f8e [id=fd2ae4ccfffd4eb5b7aa1bb5e0613015], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b393bfc209b6461aab958ebf49014d25 consensus state has no leader
I20260505 20:13:29.179104 8052 rpcz_store.cc:276] 0505 20:13:27.521996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.522060 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:29.112238 (+1590178us) ts_tablet_manager.cc:1151] Deleting tablet 56bd0f4254424c979f90da0400e0ec70
0505 20:13:29.112250 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.117340 (+ 5090us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1589923}
I20260505 20:13:29.295439 8568 leader_election.cc:290] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:29.295594 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 3535f0c31ad5451ea5bceeb50f756eef (DEFAULT_TABLE table=default.Table_1d0db71b969c4ec3b297f64b2d0c71e8 [id=9ad5a74e0c2343c6b0781cf8dbe76f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.296180 7780 tablet_service.cc:1511] Processing CreateTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b (DEFAULT_TABLE table=default.Table_18b6a5de2149454d876ffde71ee2f43e [id=7c8b32a27dad4b07b76e53e77fbfa282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.296299 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbc2221555e4f598d65835ae640fe4a (DEFAULT_TABLE table=default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.296617 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a026a8408ed9462b820b560a98dcabd1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:29.296855 7662 raft_consensus.cc:2468] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:29.285709 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b596f03adbea413b813c9037d4243fae (table default.Table_557af34712374a3e925b6b5308c0545c [id=b4f5e0b1bf67487e86d6f9af9dc16088]) successfully deleted
I20260505 20:13:29.299386 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 358) took 1777 ms. Trace:
I20260505 20:13:29.299574 7736 leader_election.cc:304] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:29.300813 8567 raft_consensus.cc:2804] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:29.300930 8567 raft_consensus.cc:493] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:29.301544 8567 raft_consensus.cc:3060] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:29.301549 8050 ts_tablet_manager.cc:1929] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.301687 8050 log.cc:1199] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/4e6da3130e724445b0d1f3c20e4e3d02
I20260505 20:13:29.301788 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3535f0c31ad5451ea5bceeb50f756eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.301790 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5dcf10cdc4bc4312b75088ac10f28253" } modify_external_catalogs: true
I20260505 20:13:29.302151 8050 ts_tablet_manager.cc:1950] T 4e6da3130e724445b0d1f3c20e4e3d02 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.303831 8050 tablet_replica.cc:333] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.304042 8050 raft_consensus.cc:2243] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.304201 8050 raft_consensus.cc:2272] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.304752 8050 ts_tablet_manager.cc:1916] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:29.306159 7737 leader_election.cc:343] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a026a8408ed9462b820b560a98dcabd1
I20260505 20:13:29.307250 8053 tablet_bootstrap.cc:654] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.309865 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet a026a8408ed9462b820b560a98dcabd1 (table default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]) successfully deleted
W20260505 20:13:29.310138 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f2b2e40635b141c59d3789aca81efba7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b2e40635b141c59d3789aca81efba7 already in progress: creating tablet
W20260505 20:13:29.311064 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 004a8e72cab44d31af3369b8df1e434e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 004a8e72cab44d31af3369b8df1e434e already in progress: creating tablet
I20260505 20:13:29.311149 8052 rpcz_store.cc:276] 0505 20:13:27.522218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.522353 (+ 135us) service_pool.cc:224] Handling call
0505 20:13:29.294603 (+1772250us) ts_tablet_manager.cc:1151] Deleting tablet cdda1cc266cd47c993b5d1a0a78c7df9
0505 20:13:29.297492 (+ 2889us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.299335 (+ 1843us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1772038}
W20260505 20:13:29.311365 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 19720f3a29f34515a952e50f4fec9f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19720f3a29f34515a952e50f4fec9f97 already in progress: creating tablet
W20260505 20:13:29.311982 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 4628e33d204c452ab12acf76f754f2ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4628e33d204c452ab12acf76f754f2ad already in progress: creating tablet
W20260505 20:13:29.312287 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b9f684cd880b4a748cab49795de11503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9f684cd880b4a748cab49795de11503 already in progress: creating tablet
W20260505 20:13:29.313457 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 1218bd76239540be9a93ca455ba3eb47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1218bd76239540be9a93ca455ba3eb47 already in progress: creating tablet
W20260505 20:13:29.313844 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f3b3c646af9843048382e77b138aea44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3b3c646af9843048382e77b138aea44 already in progress: creating tablet
I20260505 20:13:29.314271 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32ff17c39f04bc2b1c9c37a1165399b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.314347 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 22b7c02a4bd84e788d9fc92781c161a1 (DEFAULT_TABLE table=default.Table_28a64c3b83d5413c8d946d129380d5a1 [id=272374ee2a7a45c5ba51d6dd477f4f86]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:29.315129 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 22a98da176254eeb896c680fbcb98caa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22a98da176254eeb896c680fbcb98caa already in progress: creating tablet
W20260505 20:13:29.317198 7737 consensus_peers.cc:597] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2841214f07b4ae6b8cd7e97493b69d6. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:29.317972 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 296494f478244052971e12a09f0b15b4 (DEFAULT_TABLE table=default.Table_3f1f3578e45142bd8308041182d62265 [id=629d3a81e86945f48e462550aa1b1fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.318511 7764 tablet_service.cc:1511] Processing CreateTablet for tablet a5fcaee384c440bcb3307cba455e2ffa (DEFAULT_TABLE table=default.Table_6d292d45d5d24556b062b5b0fd05a0b1 [id=2b4a4163adc847139f13c1221f58d86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.319928 7775 tablet_service.cc:1511] Processing CreateTablet for tablet ab52fb4e7c73420fa58cb6da23372adc (DEFAULT_TABLE table=default.Table_aa8a97db5d1e46a2afbe7ceeb00c1538 [id=49136339e3bb4afda5cdcc665309b087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.320479 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbc2221555e4f598d65835ae640fe4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:29.315649 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 56bd0f4254424c979f90da0400e0ec70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56bd0f4254424c979f90da0400e0ec70 already in progress: creating tablet
I20260505 20:13:29.322575 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 22b7c02a4bd84e788d9fc92781c161a1 (DEFAULT_TABLE table=default.Table_28a64c3b83d5413c8d946d129380d5a1 [id=272374ee2a7a45c5ba51d6dd477f4f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.323009 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b7c02a4bd84e788d9fc92781c161a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.323326 7334 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_17eda505104c417ba34f71dbb19633f5" } modify_external_catalogs: true
I20260505 20:13:29.325381 7631 tablet_service.cc:1511] Processing CreateTablet for tablet a5fcaee384c440bcb3307cba455e2ffa (DEFAULT_TABLE table=default.Table_6d292d45d5d24556b062b5b0fd05a0b1 [id=2b4a4163adc847139f13c1221f58d86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.325505 7626 tablet_service.cc:1511] Processing CreateTablet for tablet ab52fb4e7c73420fa58cb6da23372adc (DEFAULT_TABLE table=default.Table_aa8a97db5d1e46a2afbe7ceeb00c1538 [id=49136339e3bb4afda5cdcc665309b087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.325855 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fcaee384c440bcb3307cba455e2ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.326010 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 296494f478244052971e12a09f0b15b4 (DEFAULT_TABLE table=default.Table_3f1f3578e45142bd8308041182d62265 [id=629d3a81e86945f48e462550aa1b1fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.326432 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296494f478244052971e12a09f0b15b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.327351 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab52fb4e7c73420fa58cb6da23372adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.327458 7625 tablet_service.cc:1511] Processing CreateTablet for tablet ae8bd19470294a1db91855afe49be6a5 (DEFAULT_TABLE table=default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.327885 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8bd19470294a1db91855afe49be6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.333424 7334 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_17eda505104c417ba34f71dbb19633f5" } modify_external_catalogs: true
I20260505 20:13:29.334825 8050 ts_tablet_manager.cc:1929] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:29.335620 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 010c399e14624550bf02ea248d653538 consensus state has no leader
I20260505 20:13:29.335781 7335 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
W20260505 20:13:29.336203 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 168d9a40a69d4beab8e79a97e7723e69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 168d9a40a69d4beab8e79a97e7723e69 already in progress: creating tablet
I20260505 20:13:29.341920 8050 log.cc:1199] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:29.342388 8050 ts_tablet_manager.cc:1950] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.343140 7336 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6e7bc0332ed94714b743dec41811c5d6" } new_table_name: "default.Table_e0642656a8e54729b28f94bc1f16502b" modify_external_catalogs: true
I20260505 20:13:29.343866 8052 tablet_replica.cc:333] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:29.345459 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab52fb4e7c73420fa58cb6da23372adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.345804 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296494f478244052971e12a09f0b15b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.346144 8052 raft_consensus.cc:2243] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.346426 8052 raft_consensus.cc:2272] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.346912 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 611bba6267194d058cd08a27cdd2af49
I20260505 20:13:29.347107 8052 ts_tablet_manager.cc:1916] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.346171 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b7c02a4bd84e788d9fc92781c161a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:29.353991 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 3d74dbab83b840d9b2bd103e946d3032 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d74dbab83b840d9b2bd103e946d3032 already in progress: creating tablet
W20260505 20:13:29.354359 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bcd289ce979940ae96554d5756d140d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcd289ce979940ae96554d5756d140d7 already in progress: creating tablet
I20260505 20:13:29.363135 8545 catalog_manager.cc:1269] Loaded cluster ID: 8e14917c53ec4295b4e8c6dc8fd1b1e5
I20260505 20:13:29.363268 8545 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: loading cluster ID for follower catalog manager: success
I20260505 20:13:29.363652 8054 tablet_bootstrap.cc:492] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.363953 8054 ts_tablet_manager.cc:1403] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.210s user 0.039s sys 0.035s
I20260505 20:13:29.364883 8054 raft_consensus.cc:359] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.365010 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fcaee384c440bcb3307cba455e2ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.365175 8054 raft_consensus.cc:385] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.365302 8054 raft_consensus.cc:740] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.365602 8054 consensus_queue.cc:260] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.368548 8054 ts_tablet_manager.cc:1434] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:29.368939 8054 tablet_bootstrap.cc:492] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.370955 8054 tablet_bootstrap.cc:654] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.375135 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_3bc5f620994f44e1b9c8ac44f7bd3618" } new_table_name: "default.Table_c1053ca6e76b45f4a7da074bbd43d129" modify_external_catalogs: true
I20260505 20:13:29.377256 7341 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b8d50ceda0ff4bb6b49920c922dfee9e
I20260505 20:13:29.379475 8054 tablet_bootstrap.cc:492] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.380177 8054 ts_tablet_manager.cc:1403] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260505 20:13:29.380226 8053 tablet_bootstrap.cc:492] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:29.380438 8053 ts_tablet_manager.cc:1403] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.270s user 0.002s sys 0.006s
I20260505 20:13:29.381296 8053 raft_consensus.cc:359] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.381551 8053 raft_consensus.cc:385] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.381639 8053 raft_consensus.cc:740] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.382171 8545 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: acquiring CA information for follower catalog manager: success
I20260505 20:13:29.383252 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 4860b4f80ef34a799fa9f9607aac844a (DEFAULT_TABLE table=default.Table_e9946c00ab714ea2b40bf99ce829d482 [id=646b864647ff42838a8cdc969b72bf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.381313 8054 raft_consensus.cc:359] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.384089 8054 raft_consensus.cc:385] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.384156 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 611bba6267194d058cd08a27cdd2af49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.384337 8054 raft_consensus.cc:740] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.385543 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2eea1b3e5bd0460fa46985db456f790d" } new_table_name: "default.Table_cd598a32a4d2447fa0f086a3982ced52" modify_external_catalogs: true
I20260505 20:13:29.381951 8053 consensus_queue.cc:260] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:29.387275 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4816f1ccb82e4641b2dcfe9ce9b55fae already in progress: creating tablet
I20260505 20:13:29.388147 8054 consensus_queue.cc:260] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.389192 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_5cb3708c35b247e2b4ee66f2c5d616d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.392319 8054 ts_tablet_manager.cc:1434] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260505 20:13:29.393959 8054 tablet_bootstrap.cc:492] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:29.394125 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e6c5c661e8aa4962bb9922b9ead7d784 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6c5c661e8aa4962bb9922b9ead7d784 already in progress: creating tablet
I20260505 20:13:29.397635 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_8b63051c976146d3aff15ec0f7360e15" } new_table_name: "default.Table_bb8322b408f541c991f0a30d92464b28" modify_external_catalogs: true
I20260505 20:13:29.399048 7340 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet d3cd1b7b0456462a80d653dd442589a6
I20260505 20:13:29.399995 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_144b1826c7b54532bd72768c533adc7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.400589 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_144b1826c7b54532bd72768c533adc7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.401587 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_da0af39636524879aa8f97b1af853f45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.402253 8054 tablet_bootstrap.cc:654] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:29.402472 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da0af39636524879aa8f97b1af853f45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.408272 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cb3708c35b247e2b4ee66f2c5d616d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.408872 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3b4a78f1dba2415d8d85b7dea798ed28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.409639 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b4a78f1dba2415d8d85b7dea798ed28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.411482 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 4e6da3130e724445b0d1f3c20e4e3d02 (table default.Table_7ddae9d794cb4fc8bdd97ec5db7a246c [id=af669dc2fb6848f0ba9899d2dd7344f7]) successfully deleted
W20260505 20:13:29.411911 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 8c8754580368453aa0aae021d8c665da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c8754580368453aa0aae021d8c665da already in progress: creating tablet
W20260505 20:13:29.412200 7328 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 923ed274fe454cc4a625516769e6b5f3 because the tablet was not found. No further retry: Not found: Tablet not found: 923ed274fe454cc4a625516769e6b5f3
W20260505 20:13:29.412422 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 4939dab5a4d54a08a75424bcaabbb8dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4939dab5a4d54a08a75424bcaabbb8dd already in progress: creating tablet
I20260505 20:13:29.412742 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb (table default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 [id=e51e3514b22840c391a0e2f929547557]) successfully deleted
W20260505 20:13:29.412961 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 already in progress: creating tablet
I20260505 20:13:29.414672 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 22b7c02a4bd84e788d9fc92781c161a1 (DEFAULT_TABLE table=default.Table_28a64c3b83d5413c8d946d129380d5a1 [id=272374ee2a7a45c5ba51d6dd477f4f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.414767 7916 tablet_service.cc:1511] Processing CreateTablet for tablet ab52fb4e7c73420fa58cb6da23372adc (DEFAULT_TABLE table=default.Table_aa8a97db5d1e46a2afbe7ceeb00c1538 [id=49136339e3bb4afda5cdcc665309b087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.415107 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b7c02a4bd84e788d9fc92781c161a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.415243 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 4860b4f80ef34a799fa9f9607aac844a (DEFAULT_TABLE table=default.Table_e9946c00ab714ea2b40bf99ce829d482 [id=646b864647ff42838a8cdc969b72bf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.415251 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 3dbc2221555e4f598d65835ae640fe4a (DEFAULT_TABLE table=default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.415369 7900 tablet_service.cc:1511] Processing CreateTablet for tablet a5fcaee384c440bcb3307cba455e2ffa (DEFAULT_TABLE table=default.Table_6d292d45d5d24556b062b5b0fd05a0b1 [id=2b4a4163adc847139f13c1221f58d86a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.415621 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4860b4f80ef34a799fa9f9607aac844a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.415625 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dbc2221555e4f598d65835ae640fe4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.415855 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fcaee384c440bcb3307cba455e2ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.416251 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 296494f478244052971e12a09f0b15b4 (DEFAULT_TABLE table=default.Table_3f1f3578e45142bd8308041182d62265 [id=629d3a81e86945f48e462550aa1b1fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.416679 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296494f478244052971e12a09f0b15b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.417510 7914 tablet_service.cc:1511] Processing CreateTablet for tablet ae8bd19470294a1db91855afe49be6a5 (DEFAULT_TABLE table=default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.418393 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab52fb4e7c73420fa58cb6da23372adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.419209 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8bd19470294a1db91855afe49be6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.422264 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 663d16be712b40859aa92277eab0c4a2 (DEFAULT_TABLE table=default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.424338 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b393bfc209b6461aab958ebf49014d25
I20260505 20:13:29.424813 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.425011 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663d16be712b40859aa92277eab0c4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.425350 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet a026a8408ed9462b820b560a98dcabd1 with delete_type TABLET_DATA_DELETED (replaced by tablet ea726cff03664c3d81b5e541ef738d4a) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.428896 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_3a544b60f38745948e6026aeaa005366"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.423264 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 611bba6267194d058cd08a27cdd2af49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:29.430969 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a544b60f38745948e6026aeaa005366 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.431543 8050 tablet_replica.cc:333] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.431746 8050 raft_consensus.cc:2243] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.432408 8050 raft_consensus.cc:2272] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.433058 8050 ts_tablet_manager.cc:1916] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.441352 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 663d16be712b40859aa92277eab0c4a2 (DEFAULT_TABLE table=default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.441910 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663d16be712b40859aa92277eab0c4a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:29.443920 7336 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65003660c44547cc8674baeca370e395 consensus state has no leader
I20260505 20:13:29.444379 7334 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 883ec65f15604346813e5f87d55802fc
I20260505 20:13:29.448145 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 611bba6267194d058cd08a27cdd2af49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.448320 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 4860b4f80ef34a799fa9f9607aac844a (DEFAULT_TABLE table=default.Table_e9946c00ab714ea2b40bf99ce829d482 [id=646b864647ff42838a8cdc969b72bf7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.448745 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4860b4f80ef34a799fa9f9607aac844a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.449497 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.449676 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.451296 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet d2676078f47c4bc19391227d9643c15f with delete_type TABLET_DATA_DELETED (replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.451470 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.451618 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet d3cd1b7b0456462a80d653dd442589a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:29.451843 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d49e4bb0c885499cbe30f86e15f12989 consensus state has no leader
I20260505 20:13:29.452445 8051 ts_tablet_manager.cc:1929] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.452636 8051 log.cc:1199] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/972b5c40369d41739d8c7a5bca22f04e
I20260505 20:13:29.453088 8051 ts_tablet_manager.cc:1950] T 972b5c40369d41739d8c7a5bca22f04e P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.454190 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 327) took 2178 ms. Trace:
I20260505 20:13:29.456900 8050 ts_tablet_manager.cc:1929] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260505 20:13:29.457020 8050 log.cc:1199] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/611bba6267194d058cd08a27cdd2af49
I20260505 20:13:29.457442 8050 ts_tablet_manager.cc:1950] T 611bba6267194d058cd08a27cdd2af49 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:29.458994 7327 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.253:39345, user_credentials={real_user=slave}} blocked reactor thread for 61644.7us
I20260505 20:13:29.461882 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.459717 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet d3cd1b7b0456462a80d653dd442589a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.464442 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.465873 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.469138 8051 rpcz_store.cc:276] 0505 20:13:27.276005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.276067 (+ 62us) service_pool.cc:224] Handling call
0505 20:13:29.110956 (+1834889us) ts_tablet_manager.cc:1151] Deleting tablet 972b5c40369d41739d8c7a5bca22f04e
0505 20:13:29.110967 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.383096 (+272129us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.452361 (+ 69265us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.454150 (+ 1789us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1834631}
I20260505 20:13:29.476835 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_2cdd70905bf04e9da6c310c3df99d628 [id=25578717c43d40dfb1999130c1208d98]) successfully deleted
W20260505 20:13:29.477478 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b8d50ceda0ff4bb6b49920c922dfee9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8d50ceda0ff4bb6b49920c922dfee9e already in progress: creating tablet
I20260505 20:13:29.477821 8050 tablet_replica.cc:333] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.478049 8050 raft_consensus.cc:2243] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.478246 8050 raft_consensus.cc:2272] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.479161 8050 ts_tablet_manager.cc:1916] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.479723 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 972b5c40369d41739d8c7a5bca22f04e (table default.Table_dac15532a6214097912a12004f5f2bef [id=478a9f35ab9d462c9c46020a04784934]) successfully deleted
I20260505 20:13:29.480026 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 329) took 2008 ms. Trace:
I20260505 20:13:29.480216 8051 rpcz_store.cc:276] 0505 20:13:27.471129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.471653 (+ 524us) service_pool.cc:224] Handling call
0505 20:13:29.479616 (+2007963us) ts_tablet_manager.cc:1151] Deleting tablet 64a82a9d144746338b3fc6550aa35d3c
0505 20:13:29.479627 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.479758 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2007217}
I20260505 20:13:29.480827 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 330) took 1954 ms. Trace:
I20260505 20:13:29.480995 8051 rpcz_store.cc:276] 0505 20:13:27.526025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.526083 (+ 58us) service_pool.cc:224] Handling call
0505 20:13:29.480698 (+1954615us) ts_tablet_manager.cc:1151] Deleting tablet e041ebc882b14484a51fe3a6589cddd6
0505 20:13:29.480707 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.480798 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954345}
I20260505 20:13:29.481532 8051 tablet_replica.cc:333] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.482376 8058 tablet_bootstrap.cc:492] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:29.482590 8058 ts_tablet_manager.cc:1403] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.248s user 0.015s sys 0.039s
I20260505 20:13:29.483560 8058 raft_consensus.cc:359] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.483816 8058 raft_consensus.cc:385] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.483944 8058 raft_consensus.cc:740] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.484261 8058 consensus_queue.cc:260] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.486172 8050 ts_tablet_manager.cc:1929] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.486344 8050 log.cc:1199] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:29.486706 8050 ts_tablet_manager.cc:1950] T beb404fa927641f48f28c6bdaa297db3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.486837 8058 ts_tablet_manager.cc:1434] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:29.487196 8058 tablet_bootstrap.cc:492] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:29.487844 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet beb404fa927641f48f28c6bdaa297db3 (table default.Table_c6fb56a940914efea745a3928384c125 [id=88907f7bed654b0a9e35b82d3667bc11]) successfully deleted
W20260505 20:13:29.488550 7338 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a46c981a27ac4527a40d49714356185e consensus state has no leader
I20260505 20:13:29.490335 8545 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260505 20:13:29.492617 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2b0dd5d7870453bb1b771405daeb22f consensus state has no leader
I20260505 20:13:29.493042 8051 raft_consensus.cc:2243] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.493249 8051 raft_consensus.cc:2272] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.494021 8051 ts_tablet_manager.cc:1916] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.496001 8050 tablet_replica.cc:333] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.496212 8050 raft_consensus.cc:2243] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.496986 8054 tablet_bootstrap.cc:492] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.497165 8054 ts_tablet_manager.cc:1403] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.103s user 0.004s sys 0.008s
I20260505 20:13:29.497989 8054 raft_consensus.cc:359] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.498198 8054 raft_consensus.cc:385] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.498276 8054 raft_consensus.cc:740] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.498570 8054 consensus_queue.cc:260] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.501658 8054 ts_tablet_manager.cc:1434] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:29.502024 8054 tablet_bootstrap.cc:492] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.503100 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.503958 8054 tablet_bootstrap.cc:654] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.504932 8050 raft_consensus.cc:2272] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.505693 8050 ts_tablet_manager.cc:1916] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.506023 8058 tablet_bootstrap.cc:654] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:29.512815 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 64a82a9d144746338b3fc6550aa35d3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a82a9d144746338b3fc6550aa35d3c already in progress: creating tablet
I20260505 20:13:29.516613 7781 tablet_service.cc:1511] Processing CreateTablet for tablet ae8bd19470294a1db91855afe49be6a5 (DEFAULT_TABLE table=default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:29.517086 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e041ebc882b14484a51fe3a6589cddd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e041ebc882b14484a51fe3a6589cddd6 already in progress: creating tablet
I20260505 20:13:29.513305 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b0068351f518498c8eee7ad99db7fec6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.513682 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_aa427cba6f1643a9a1e198aa07362d05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.511821 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:29.518324 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa427cba6f1643a9a1e198aa07362d05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.519052 8490 raft_consensus.cc:493] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:29.519601 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0068351f518498c8eee7ad99db7fec6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.521840 8490 raft_consensus.cc:515] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.522030 8053 ts_tablet_manager.cc:1434] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.141s user 0.002s sys 0.002s
I20260505 20:13:29.522620 8490 leader_election.cc:290] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:29.523123 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cce2fd271641ad83c9b3e4beeb12ee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:29.526365 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_430a72f510b94509ba858aa261923638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.527395 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_aeba5817c6974912bf3e49da09fdf85f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.528201 8568 raft_consensus.cc:493] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:29.528692 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d6ce8f7d9fd1457790462b4950bcee3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.529446 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ce8f7d9fd1457790462b4950bcee3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.531519 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aeba5817c6974912bf3e49da09fdf85f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.533881 8568 raft_consensus.cc:515] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.534663 8568 leader_election.cc:290] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:29.535346 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_430a72f510b94509ba858aa261923638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.536113 8051 ts_tablet_manager.cc:1929] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.536283 8051 log.cc:1199] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/6ec1037f771740d1a094a622d5e49082
I20260505 20:13:29.536666 8051 ts_tablet_manager.cc:1950] T 6ec1037f771740d1a094a622d5e49082 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:29.540127 7736 leader_election.cc:343] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:29.540558 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_ef4d447e4d3746c6a2206a578a98fed9" } new_table_name: "default.Table_1417634859e24df0a5944012b79d7673" modify_external_catalogs: true
I20260505 20:13:29.542083 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 331) took 2015 ms. Trace:
I20260505 20:13:29.542707 8051 rpcz_store.cc:276] 0505 20:13:27.526834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.526915 (+ 81us) service_pool.cc:224] Handling call
0505 20:13:29.481473 (+1954558us) ts_tablet_manager.cc:1151] Deleting tablet 6ec1037f771740d1a094a622d5e49082
0505 20:13:29.481482 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.503515 (+ 22033us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.536015 (+ 32500us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.542005 (+ 5990us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954245}
I20260505 20:13:29.543812 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 332) took 2016 ms. Trace:
I20260505 20:13:29.544302 8051 rpcz_store.cc:276] 0505 20:13:27.527719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.527774 (+ 55us) service_pool.cc:224] Handling call
0505 20:13:29.543634 (+2015860us) ts_tablet_manager.cc:1151] Deleting tablet 949fecb197084426b5a6adb959f5c886
0505 20:13:29.543645 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.543761 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2015691}
I20260505 20:13:29.544400 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.544639 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet d3cd1b7b0456462a80d653dd442589a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.545125 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 333) took 2016 ms. Trace:
I20260505 20:13:29.545532 8051 rpcz_store.cc:276] 0505 20:13:27.528492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.528539 (+ 47us) service_pool.cc:224] Handling call
0505 20:13:29.544958 (+2016419us) ts_tablet_manager.cc:1151] Deleting tablet 56bd0f4254424c979f90da0400e0ec70
0505 20:13:29.544968 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.545078 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016246}
I20260505 20:13:29.546154 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4860b4f80ef34a799fa9f9607aac844a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.546257 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 334) took 2016 ms. Trace:
I20260505 20:13:29.546335 8051 rpcz_store.cc:276] 0505 20:13:27.529289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.529343 (+ 54us) service_pool.cc:224] Handling call
0505 20:13:29.546121 (+2016778us) ts_tablet_manager.cc:1151] Deleting tablet cdda1cc266cd47c993b5d1a0a78c7df9
0505 20:13:29.546130 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.546210 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016561}
I20260505 20:13:29.548730 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 6ec1037f771740d1a094a622d5e49082 (table default.Table_efe81e982113463b9ff4f04403f0bac7 [id=c946f532ba074386ac47a7bacd2feeea]) successfully deleted
I20260505 20:13:29.549432 8051 tablet_replica.cc:333] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.549630 8051 raft_consensus.cc:2243] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.549868 8051 raft_consensus.cc:2272] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:29.550408 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 949fecb197084426b5a6adb959f5c886 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 949fecb197084426b5a6adb959f5c886 already in progress: creating tablet
W20260505 20:13:29.552717 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47720452d3f44e18b16a06ae296b4c51 consensus state has no leader
W20260505 20:13:29.553584 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 56bd0f4254424c979f90da0400e0ec70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56bd0f4254424c979f90da0400e0ec70 already in progress: creating tablet
I20260505 20:13:29.557709 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f1c1f40aa3044bdbbaa23ae22445214b" } modify_external_catalogs: true
I20260505 20:13:29.557950 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f1c1f40aa3044bdbbaa23ae22445214b" } modify_external_catalogs: true
I20260505 20:13:29.559691 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 663d16be712b40859aa92277eab0c4a2 (DEFAULT_TABLE table=default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.570626 8054 tablet_bootstrap.cc:492] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.570852 8054 ts_tablet_manager.cc:1403] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.000s
I20260505 20:13:29.572016 8054 raft_consensus.cc:359] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.572327 8054 raft_consensus.cc:385] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.572443 8054 raft_consensus.cc:740] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.572731 8054 consensus_queue.cc:260] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.574918 8054 ts_tablet_manager.cc:1434] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260505 20:13:29.575871 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.577708 8054 tablet_bootstrap.cc:492] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.580703 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.581296 8050 ts_tablet_manager.cc:1929] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.581426 8050 log.cc:1199] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/d2676078f47c4bc19391227d9643c15f
I20260505 20:13:29.581754 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8bd19470294a1db91855afe49be6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.581867 8050 ts_tablet_manager.cc:1950] T d2676078f47c4bc19391227d9643c15f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.583592 7937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cce2fd271641ad83c9b3e4beeb12ee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:29.583832 7937 raft_consensus.cc:2468] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:29.589257 8567 raft_consensus.cc:515] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.590132 8567 leader_election.cc:290] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:29.590572 8054 tablet_bootstrap.cc:654] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.590948 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.597200 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663d16be712b40859aa92277eab0c4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.598132 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_430a72f510b94509ba858aa261923638" } modify_external_catalogs: true
I20260505 20:13:29.598618 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_430a72f510b94509ba858aa261923638" } modify_external_catalogs: true
I20260505 20:13:29.600906 8054 tablet_bootstrap.cc:492] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.601085 8054 ts_tablet_manager.cc:1403] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260505 20:13:29.601840 8054 raft_consensus.cc:359] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.602059 8054 raft_consensus.cc:385] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.602131 8054 raft_consensus.cc:740] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.602383 8054 consensus_queue.cc:260] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.604092 8054 ts_tablet_manager.cc:1434] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:29.604424 8054 tablet_bootstrap.cc:492] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.606096 8054 tablet_bootstrap.cc:654] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.608155 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.608454 8051 ts_tablet_manager.cc:1916] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.613137 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet d2676078f47c4bc19391227d9643c15f (table default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]) successfully deleted
I20260505 20:13:29.615969 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596f03adbea413b813c9037d4243fae" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:29.616163 7737 leader_election.cc:304] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:29.617362 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a026a8408ed9462b820b560a98dcabd1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:29.619292 7661 raft_consensus.cc:3060] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:29.621601 7342 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 4c7eb831ec4f411ba7237926953ca440
I20260505 20:13:29.624929 8058 tablet_bootstrap.cc:492] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:29.625813 8058 ts_tablet_manager.cc:1403] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.139s user 0.012s sys 0.012s
I20260505 20:13:29.627866 8054 tablet_bootstrap.cc:492] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.628074 8054 ts_tablet_manager.cc:1403] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260505 20:13:29.628206 7661 raft_consensus.cc:2468] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:29.628937 8054 raft_consensus.cc:359] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.629328 8058 raft_consensus.cc:359] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.629630 8058 raft_consensus.cc:385] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.629778 8058 raft_consensus.cc:740] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.629935 8054 raft_consensus.cc:385] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.630168 8054 raft_consensus.cc:740] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.630409 8058 consensus_queue.cc:260] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.630815 8054 consensus_queue.cc:260] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.631767 8051 ts_tablet_manager.cc:1929] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:29.631922 8051 log.cc:1199] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/74a5d442f25242ea8371fca8643f4ce6
I20260505 20:13:29.632501 8051 ts_tablet_manager.cc:1950] T 74a5d442f25242ea8371fca8643f4ce6 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.638124 8058 ts_tablet_manager.cc:1434] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:29.638962 8054 ts_tablet_manager.cc:1434] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260505 20:13:29.639179 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 337) took 1886 ms. Trace:
I20260505 20:13:29.639443 8051 rpcz_store.cc:276] 0505 20:13:27.752392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.752826 (+ 434us) service_pool.cc:224] Handling call
0505 20:13:29.549344 (+1796518us) ts_tablet_manager.cc:1151] Deleting tablet 74a5d442f25242ea8371fca8643f4ce6
0505 20:13:29.549355 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.616936 (+ 67581us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.631649 (+ 14713us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.639133 (+ 7484us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715923}
I20260505 20:13:29.640405 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 355) took 1837 ms. Trace:
I20260505 20:13:29.640584 8051 rpcz_store.cc:276] 0505 20:13:27.802661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.833488 (+ 30827us) service_pool.cc:224] Handling call
0505 20:13:29.640218 (+1806730us) ts_tablet_manager.cc:1151] Deleting tablet e69bdfc75a494635837178cb16c08c1c
0505 20:13:29.640263 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.640371 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1806505}
I20260505 20:13:29.641100 8051 tablet_replica.cc:333] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.641368 8051 raft_consensus.cc:2243] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
W20260505 20:13:29.642046 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b393bfc209b6461aab958ebf49014d25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b393bfc209b6461aab958ebf49014d25 already in progress: creating tablet
I20260505 20:13:29.642975 8051 pending_rounds.cc:70] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:29.643113 8051 pending_rounds.cc:77] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737183119765504 op_type: NO_OP noop_request { }
I20260505 20:13:29.643733 8051 raft_consensus.cc:2889] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:29.643945 8051 raft_consensus.cc:2272] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.648105 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 74a5d442f25242ea8371fca8643f4ce6 (table default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8]) successfully deleted
W20260505 20:13:29.648427 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e69bdfc75a494635837178cb16c08c1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69bdfc75a494635837178cb16c08c1c already in progress: creating tablet
I20260505 20:13:29.654008 7342 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
W20260505 20:13:29.654181 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet d3cd1b7b0456462a80d653dd442589a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3cd1b7b0456462a80d653dd442589a6 already in progress: creating tablet
I20260505 20:13:29.655640 8051 ts_tablet_manager.cc:1916] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.655929 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet bde33085759f4fd8a130d80878d1e564
I20260505 20:13:29.658113 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.658571 7333 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:29.660926 8058 tablet_bootstrap.cc:492] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:29.650892 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 38822ad83f51454f9203fc17ed93a32f (DEFAULT_TABLE table=default.Table_7ef38a3fc00f4cdca3666e9359a5fb38 [id=6907b9983088424f8bcc957773626fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.653395 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.661616 8054 tablet_bootstrap.cc:492] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.661729 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38822ad83f51454f9203fc17ed93a32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.657208 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.663230 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_db181a51dd2c430ca2792b4bef5cd912" } modify_external_catalogs: true
I20260505 20:13:29.663430 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_db181a51dd2c430ca2792b4bef5cd912" } modify_external_catalogs: true
I20260505 20:13:29.665135 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d991da0b0d3b445b918500a013593fe2" } modify_external_catalogs: true
I20260505 20:13:29.665772 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d991da0b0d3b445b918500a013593fe2" } modify_external_catalogs: true
W20260505 20:13:29.667306 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 883ec65f15604346813e5f87d55802fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883ec65f15604346813e5f87d55802fc already in progress: creating tablet
I20260505 20:13:29.667713 8050 tablet_replica.cc:333] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.668015 8050 raft_consensus.cc:2243] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.668270 8050 raft_consensus.cc:2272] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.669155 8050 ts_tablet_manager.cc:1916] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.670874 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_bb8322b408f541c991f0a30d92464b28" } new_table_name: "default.Table_53865526cc344c468eaca63580090168" modify_external_catalogs: true
I20260505 20:13:29.671276 8058 tablet_bootstrap.cc:654] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.672468 8054 tablet_bootstrap.cc:654] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.672474 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1954f3a3b7034c16b51824755e5e357f" } modify_external_catalogs: true
I20260505 20:13:29.672624 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1954f3a3b7034c16b51824755e5e357f" } modify_external_catalogs: true
I20260505 20:13:29.673916 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e39a201cd67e459489cc0ee580f8a165" } new_table_name: "default.Table_b32b876ca24341f7bd70ee43912ee08f" modify_external_catalogs: true
I20260505 20:13:29.676030 8050 ts_tablet_manager.cc:1929] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.676189 8050 log.cc:1199] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:29.676528 8050 ts_tablet_manager.cc:1950] T 944aad58d3c14577a0c66edd95fdf5e0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.677558 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 944aad58d3c14577a0c66edd95fdf5e0 (table default.Table_4dda980af4a44fb3b08d9845bc9a4c2f [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:29.679615 7342 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:29.679806 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet b6895af5f55b4bc183065626417090a4
I20260505 20:13:29.680881 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.681895 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.683569 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.683871 7914 tablet_service.cc:1511] Processing CreateTablet for tablet ede080523cb1482d8a531f4044164475 (DEFAULT_TABLE table=default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.684322 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede080523cb1482d8a531f4044164475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.687354 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.688946 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 38822ad83f51454f9203fc17ed93a32f (DEFAULT_TABLE table=default.Table_7ef38a3fc00f4cdca3666e9359a5fb38 [id=6907b9983088424f8bcc957773626fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.689404 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38822ad83f51454f9203fc17ed93a32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.689522 8050 tablet_replica.cc:333] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.689707 8050 raft_consensus.cc:2243] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.689900 8050 raft_consensus.cc:2272] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.690689 8050 ts_tablet_manager.cc:1916] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.690652 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d (DEFAULT_TABLE table=default.Table_1f4c5959987145b594d24feb4eb6a4d1 [id=4b76ab7e66f34e8d876aff5a0f59840c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.691018 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.695214 7641 tablet_service.cc:1511] Processing CreateTablet for tablet ede080523cb1482d8a531f4044164475 (DEFAULT_TABLE table=default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.695519 7915 tablet_service.cc:1511] Processing CreateTablet for tablet cb5cfc700aff4082ae089476e2af044f (DEFAULT_TABLE table=default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.695647 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede080523cb1482d8a531f4044164475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.695706 7635 tablet_service.cc:1511] Processing CreateTablet for tablet cb5cfc700aff4082ae089476e2af044f (DEFAULT_TABLE table=default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.695860 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5cfc700aff4082ae089476e2af044f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.696085 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5cfc700aff4082ae089476e2af044f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.698093 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d (DEFAULT_TABLE table=default.Table_1f4c5959987145b594d24feb4eb6a4d1 [id=4b76ab7e66f34e8d876aff5a0f59840c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.698439 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.699479 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3a4294f4c34ac886a136c2ece31531 (DEFAULT_TABLE table=default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d [id=a441a18b04ef463bb4c69e9e25f1ffd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.699785 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3a4294f4c34ac886a136c2ece31531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.700460 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca (DEFAULT_TABLE table=default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb [id=2c8ae910936748198e221a7864a4ccf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.700541 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 944eaa335fcf49be975baee21c715642
I20260505 20:13:29.700788 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:29.700882 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a46c981a27ac4527a40d49714356185e consensus state has no leader
W20260505 20:13:29.701530 7736 leader_election.cc:343] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:29.701692 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 85181.9us
I20260505 20:13:29.702040 7736 leader_election.cc:304] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:29.703244 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca (DEFAULT_TABLE table=default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb [id=2c8ae910936748198e221a7864a4ccf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.703485 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3a4294f4c34ac886a136c2ece31531 (DEFAULT_TABLE table=default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d [id=a441a18b04ef463bb4c69e9e25f1ffd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.703619 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.703819 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3a4294f4c34ac886a136c2ece31531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.704136 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 (DEFAULT_TABLE table=default.Table_d6c96dbb361b457684823113cd6727ea [id=5b2af32ce8704ee4b48ebeb114130d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.704507 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaff49cb0ff4298be24603b2015c8a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.706759 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.709910 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.715006 8053 tablet_bootstrap.cc:492] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:29.721153 8568 raft_consensus.cc:2804] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:29.721318 8568 raft_consensus.cc:493] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:29.721480 8568 raft_consensus.cc:3060] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:29.724464 8568 raft_consensus.cc:515] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:29.724918 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 579bd562fea64fe69db2b4a6085b7bed consensus state has no leader
I20260505 20:13:29.725242 8568 leader_election.cc:290] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:29.725696 8567 raft_consensus.cc:2804] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:29.728729 7339 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_7ddda7425d0f44d18fe52b4af466e35c" } new_table_name: "default.Table_a6dcb45454814d749d55a423415118b2" modify_external_catalogs: true
I20260505 20:13:29.729673 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d940540a0f0347a396258cd69ee109ec" } new_table_name: "default.Table_7fa012f95dc24a889777e593eaa0fd26" modify_external_catalogs: true
I20260505 20:13:29.731384 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_56edcc43011944a8894e3b105d3be69e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.731851 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_b05a62cc3a7e446e915328413ead238d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.731998 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56edcc43011944a8894e3b105d3be69e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.732358 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b05a62cc3a7e446e915328413ead238d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.733342 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_7864889bd60f4d50a92b38018c93ca92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.734072 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_501dd560884045e79bb35144cae9d817"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.734573 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_501dd560884045e79bb35144cae9d817 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.737847 8567 raft_consensus.cc:697] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:29.738194 8567 consensus_queue.cc:237] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:29.739419 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 54554us
I20260505 20:13:29.741523 7335 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_62aece033038452d8dd6e128877cc4e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.741935 8050 ts_tablet_manager.cc:1929] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.742056 8050 log.cc:1199] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/98af33c2cdb24937858efdc7b638418f
W20260505 20:13:29.742321 7335 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62aece033038452d8dd6e128877cc4e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.742444 8050 ts_tablet_manager.cc:1950] T 98af33c2cdb24937858efdc7b638418f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:29.744570 7661 raft_consensus.cc:1275] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Refusing update from remote peer 974ed93a43c54ccbb58e60bfdae7c546: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:29.745225 8447 consensus_queue.cc:1048] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:29.747871 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7864889bd60f4d50a92b38018c93ca92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.749421 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_fde64ff0b9514797968ea93a1a179537"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.750046 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fde64ff0b9514797968ea93a1a179537 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.753229 8051 ts_tablet_manager.cc:1929] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:29.754245 8051 log.cc:1199] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/ef996218e8b14e3b80eeab3397edec57
W20260505 20:13:29.757321 7737 leader_election.cc:343] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b596f03adbea413b813c9037d4243fae
I20260505 20:13:29.757092 8051 ts_tablet_manager.cc:1950] T ef996218e8b14e3b80eeab3397edec57 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.759467 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 338) took 2002 ms. Trace:
I20260505 20:13:29.760107 8051 rpcz_store.cc:276] 0505 20:13:27.757092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.757150 (+ 58us) service_pool.cc:224] Handling call
0505 20:13:29.641042 (+1883892us) ts_tablet_manager.cc:1151] Deleting tablet ef996218e8b14e3b80eeab3397edec57
0505 20:13:29.641051 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.745034 (+103983us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.753105 (+ 8071us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.759416 (+ 6311us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1804967}
I20260505 20:13:29.760519 8051 tablet_replica.cc:333] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.760704 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet ef996218e8b14e3b80eeab3397edec57 (table default.Table_61a206162d5748ceb746d958b0f9ae76 [id=3301fb46a9e340309c987b52bb312f70]) successfully deleted
I20260505 20:13:29.760747 8051 raft_consensus.cc:2243] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.760912 8051 raft_consensus.cc:2272] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.761498 8051 ts_tablet_manager.cc:1916] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.763819 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_817fb0aff75f4e239ba5270ce18debd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.764493 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_817fb0aff75f4e239ba5270ce18debd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.766260 7339 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86c9aaca827442cc8cc605f56c222860 consensus state has no leader
I20260505 20:13:29.766407 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f812836f154f43be8c95a729c99d8665"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.766775 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_bd6970923f6943358212e065fee537ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:29.766973 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f812836f154f43be8c95a729c99d8665 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.767400 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd6970923f6943358212e065fee537ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:29.768642 7598 consensus_peers.cc:597] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e6da3130e724445b0d1f3c20e4e3d02. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:29.771313 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_72ff1e9617b74cd2af00b37a2b306db6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:29.771656 8054 tablet_bootstrap.cc:492] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.771847 8054 ts_tablet_manager.cc:1403] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.110s user 0.005s sys 0.000s
W20260505 20:13:29.771868 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72ff1e9617b74cd2af00b37a2b306db6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:29.772780 8054 raft_consensus.cc:359] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.773002 8054 raft_consensus.cc:385] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.773098 8054 raft_consensus.cc:740] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.773461 8054 consensus_queue.cc:260] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.775130 8054 ts_tablet_manager.cc:1434] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:29.775923 8058 tablet_bootstrap.cc:492] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:29.776077 8058 ts_tablet_manager.cc:1403] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.002s
I20260505 20:13:29.776911 8058 raft_consensus.cc:359] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.777112 8058 raft_consensus.cc:385] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.777209 8058 raft_consensus.cc:740] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.777472 8058 consensus_queue.cc:260] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.778923 8058 ts_tablet_manager.cc:1434] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:29.779268 8058 tablet_bootstrap.cc:492] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:29.781831 7342 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b0068351f518498c8eee7ad99db7fec6" } new_table_name: "default.Table_89d3067a6f7a4267948a7c6c40726e8e" modify_external_catalogs: true
I20260505 20:13:29.783469 8058 tablet_bootstrap.cc:654] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.788232 8051 ts_tablet_manager.cc:1929] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.795048 7737 leader_election.cc:304] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:29.795473 8051 log.cc:1199] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e17b17089792450bbc4dba372076af9a
W20260505 20:13:29.795451 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 55776.8us
I20260505 20:13:29.796016 8051 ts_tablet_manager.cc:1950] T e17b17089792450bbc4dba372076af9a P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:29.796403 7737 leader_election.cc:343] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a026a8408ed9462b820b560a98dcabd1
I20260505 20:13:29.797623 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 339) took 2040 ms. Trace:
I20260505 20:13:29.797714 7800 raft_consensus.cc:1275] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Refusing update from remote peer 974ed93a43c54ccbb58e60bfdae7c546: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260505 20:13:29.798991 8051 rpcz_store.cc:276] 0505 20:13:27.757217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.757340 (+ 123us) service_pool.cc:224] Handling call
0505 20:13:29.760445 (+2003105us) ts_tablet_manager.cc:1151] Deleting tablet e17b17089792450bbc4dba372076af9a
0505 20:13:29.760456 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.784756 (+ 24300us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.788157 (+ 3401us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.797568 (+ 9411us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1924296}
I20260505 20:13:29.799067 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cce2fd271641ad83c9b3e4beeb12ee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:29.799314 7936 raft_consensus.cc:3060] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:29.799598 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e17b17089792450bbc4dba372076af9a (table default.Table_8f662bf9642940d19389e4fe4f0a5e18 [id=a950b5c2d6ae401ca441ec76000e8084]) successfully deleted
I20260505 20:13:29.800114 8051 tablet_replica.cc:333] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.800307 8051 raft_consensus.cc:2243] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.800477 8051 raft_consensus.cc:2272] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.804407 7936 raft_consensus.cc:2468] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:29.807063 8051 ts_tablet_manager.cc:1916] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.815526 8051 ts_tablet_manager.cc:1929] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.817174 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 38822ad83f51454f9203fc17ed93a32f (DEFAULT_TABLE table=default.Table_7ef38a3fc00f4cdca3666e9359a5fb38 [id=6907b9983088424f8bcc957773626fb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.771658 8050 tablet_replica.cc:333] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:29.819779 8053 tablet_bootstrap.cc:654] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.820932 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.826848 7333 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b36ca8cad35d47ba80d17ed4bbed7818" } modify_external_catalogs: true
I20260505 20:13:29.827068 7333 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_b36ca8cad35d47ba80d17ed4bbed7818" } modify_external_catalogs: true
I20260505 20:13:29.829933 8490 raft_consensus.cc:2749] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:29.831219 8054 tablet_bootstrap.cc:492] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.831430 8051 log.cc:1199] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/7591290e4ddf4bcc9d4676a2618a346c
I20260505 20:13:29.832238 8051 ts_tablet_manager.cc:1950] T 7591290e4ddf4bcc9d4676a2618a346c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.833113 8054 tablet_bootstrap.cc:654] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.833148 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 340) took 2075 ms. Trace:
I20260505 20:13:29.837723 7767 tablet_service.cc:1511] Processing CreateTablet for tablet cb5cfc700aff4082ae089476e2af044f (DEFAULT_TABLE table=default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.833388 8051 rpcz_store.cc:276] 0505 20:13:27.757330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.757480 (+ 150us) service_pool.cc:224] Handling call
0505 20:13:29.800026 (+2042546us) ts_tablet_manager.cc:1151] Deleting tablet 7591290e4ddf4bcc9d4676a2618a346c
0505 20:13:29.800038 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.812265 (+ 12227us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.815431 (+ 3166us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.833098 (+ 17667us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1963824}
I20260505 20:13:29.838529 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 7591290e4ddf4bcc9d4676a2618a346c (table default.Table_3f93bb9d891e4ac6b582689068819e21 [id=def2b4e333d84128b44c8d912afef0a6]) successfully deleted
I20260505 20:13:29.838727 8051 tablet_replica.cc:333] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.839102 8051 raft_consensus.cc:2243] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.841322 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38822ad83f51454f9203fc17ed93a32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.841998 7766 tablet_service.cc:1511] Processing CreateTablet for tablet ede080523cb1482d8a531f4044164475 (DEFAULT_TABLE table=default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.842447 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.842628 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5cfc700aff4082ae089476e2af044f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.843025 8051 raft_consensus.cc:2272] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.843698 8051 ts_tablet_manager.cc:1916] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.847210 8052 ts_tablet_manager.cc:1929] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.847543 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d (DEFAULT_TABLE table=default.Table_1f4c5959987145b594d24feb4eb6a4d1 [id=4b76ab7e66f34e8d876aff5a0f59840c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.848448 8054 tablet_bootstrap.cc:492] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:29.848428 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:29.848671 8054 ts_tablet_manager.cc:1403] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260505 20:13:29.848616 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 6f3a4294f4c34ac886a136c2ece31531 (DEFAULT_TABLE table=default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d [id=a441a18b04ef463bb4c69e9e25f1ffd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.849502 8054 raft_consensus.cc:359] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.849725 8054 raft_consensus.cc:385] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.849874 8054 raft_consensus.cc:740] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.850185 8054 consensus_queue.cc:260] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.852494 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ede080523cb1482d8a531f4044164475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.854878 8052 log.cc:1199] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e17b17089792450bbc4dba372076af9a
I20260505 20:13:29.855353 8052 ts_tablet_manager.cc:1950] T e17b17089792450bbc4dba372076af9a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:29.855595 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f3a4294f4c34ac886a136c2ece31531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.855808 8054 ts_tablet_manager.cc:1434] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260505 20:13:29.858186 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:29.858357 8051 ts_tablet_manager.cc:1929] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.858515 8051 log.cc:1199] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/a1f5bfa086f9422ebda96b2485ad986b
I20260505 20:13:29.858855 8051 ts_tablet_manager.cc:1950] T a1f5bfa086f9422ebda96b2485ad986b P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.860288 8054 tablet_bootstrap.cc:492] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:29.862666 7336 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:29.869647 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 347) took 2100 ms. Trace:
I20260505 20:13:29.871649 8054 tablet_bootstrap.cc:654] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:29.871822 8051 rpcz_store.cc:276] 0505 20:13:27.768666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.771391 (+ 2725us) service_pool.cc:224] Handling call
0505 20:13:29.838573 (+2067182us) ts_tablet_manager.cc:1151] Deleting tablet a1f5bfa086f9422ebda96b2485ad986b
0505 20:13:29.838587 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.850236 (+ 11649us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.858275 (+ 8039us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.869580 (+ 11305us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2002016}
I20260505 20:13:29.872309 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_133f54e3650c43b59175c563864bd932" } modify_external_catalogs: true
I20260505 20:13:29.872526 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet a1f5bfa086f9422ebda96b2485ad986b (table default.Table_381e5521f71b4d388d6643fb24a3bc27 [id=6606be420f5c424f93d731dfa574a5e7]) successfully deleted
I20260505 20:13:29.872582 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_133f54e3650c43b59175c563864bd932" } modify_external_catalogs: true
I20260505 20:13:29.873024 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 352) took 2079 ms. Trace:
I20260505 20:13:29.873133 8051 rpcz_store.cc:276] 0505 20:13:27.793282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.793339 (+ 57us) service_pool.cc:224] Handling call
0505 20:13:29.872797 (+2079458us) ts_tablet_manager.cc:1151] Deleting tablet 0d5ed062508b411eb0fa5a14637830ea
0505 20:13:29.872809 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.872970 (+ 161us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2036109}
W20260505 20:13:29.873569 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 0d5ed062508b411eb0fa5a14637830ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d5ed062508b411eb0fa5a14637830ea already in progress: creating tablet
I20260505 20:13:29.873672 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.874017 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 358) took 1954 ms. Trace:
I20260505 20:13:29.874142 8051 rpcz_store.cc:276] 0505 20:13:27.919920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.919971 (+ 51us) service_pool.cc:224] Handling call
0505 20:13:29.873855 (+1953884us) ts_tablet_manager.cc:1151] Deleting tablet c720fc66db36402a83a7690d70a40353
0505 20:13:29.873865 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.873967 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1951729}
W20260505 20:13:29.874603 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet c720fc66db36402a83a7690d70a40353 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c720fc66db36402a83a7690d70a40353 already in progress: creating tablet
I20260505 20:13:29.875066 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 356) took 1955 ms. Trace:
I20260505 20:13:29.876013 8051 rpcz_store.cc:276] 0505 20:13:27.919607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.920104 (+ 497us) service_pool.cc:224] Handling call
0505 20:13:29.874868 (+1954764us) ts_tablet_manager.cc:1151] Deleting tablet 8f1505e592e543cca92d8949bdae007e
0505 20:13:29.874880 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.874999 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1949485}
I20260505 20:13:29.876385 7341 master_service.cc:954] ReplaceTablet: received request to replace tablet 944eaa335fcf49be975baee21c715642 from {username='slave'} at 127.0.0.1:58274
W20260505 20:13:29.876629 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8f1505e592e543cca92d8949bdae007e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f1505e592e543cca92d8949bdae007e already in progress: creating tablet
I20260505 20:13:29.877038 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 357) took 1957 ms. Trace:
I20260505 20:13:29.877660 8051 rpcz_store.cc:276] 0505 20:13:27.919771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.920065 (+ 294us) service_pool.cc:224] Handling call
0505 20:13:29.876906 (+1956841us) ts_tablet_manager.cc:1151] Deleting tablet d138d27f444f45d28acdc7d72a9649f5
0505 20:13:29.876914 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.876987 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1946030}
I20260505 20:13:29.878085 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
W20260505 20:13:29.878281 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet d138d27f444f45d28acdc7d72a9649f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d138d27f444f45d28acdc7d72a9649f5 already in progress: creating tablet
I20260505 20:13:29.878509 8447 consensus_queue.cc:1048] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:29.878644 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 359) took 1946 ms. Trace:
I20260505 20:13:29.878743 8051 rpcz_store.cc:276] 0505 20:13:27.932303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.932502 (+ 199us) service_pool.cc:224] Handling call
0505 20:13:29.878493 (+1945991us) ts_tablet_manager.cc:1151] Deleting tablet 8e650b297603425184ad97ddf99ec36d
0505 20:13:29.878501 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.878581 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1940776}
I20260505 20:13:29.879171 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 (DEFAULT_TABLE table=default.Table_d6c96dbb361b457684823113cd6727ea [id=5b2af32ce8704ee4b48ebeb114130d6b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:29.879458 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8e650b297603425184ad97ddf99ec36d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e650b297603425184ad97ddf99ec36d already in progress: creating tablet
I20260505 20:13:29.879913 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 360) took 1921 ms. Trace:
I20260505 20:13:29.880328 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaff49cb0ff4298be24603b2015c8a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.881724 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 360) took 2289 ms. Trace:
I20260505 20:13:29.881991 8052 rpcz_store.cc:276] 0505 20:13:27.591787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.591848 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:29.311498 (+1719650us) ts_tablet_manager.cc:1151] Deleting tablet e17b17089792450bbc4dba372076af9a
0505 20:13:29.311513 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.839034 (+527521us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.847126 (+ 8092us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.881643 (+ 34517us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1719395}
I20260505 20:13:29.882527 8052 tablet_replica.cc:333] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:29.882932 8052 raft_consensus.cc:2243] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:29.883251 8052 raft_consensus.cc:2272] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.884337 8052 ts_tablet_manager.cc:1916] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.885845 8051 rpcz_store.cc:276] 0505 20:13:27.961793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.962032 (+ 239us) service_pool.cc:224] Handling call
0505 20:13:29.879722 (+1917690us) ts_tablet_manager.cc:1151] Deleting tablet 7214ab77d7904f0e9d37cb8d7a5a53a4
0505 20:13:29.879734 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.879832 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1917471}
W20260505 20:13:29.886430 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 already in progress: creating tablet
I20260505 20:13:29.886876 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 365) took 1817 ms. Trace:
I20260505 20:13:29.887010 8051 rpcz_store.cc:276] 0505 20:13:28.068900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.093796 (+ 24896us) service_pool.cc:224] Handling call
0505 20:13:29.886716 (+1792920us) ts_tablet_manager.cc:1151] Deleting tablet b6ed7c0220d147c7853c7afc1ef09607
0505 20:13:29.886728 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.886827 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1792717}
W20260505 20:13:29.887481 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b6ed7c0220d147c7853c7afc1ef09607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6ed7c0220d147c7853c7afc1ef09607 already in progress: creating tablet
I20260505 20:13:29.887876 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 366) took 1818 ms. Trace:
I20260505 20:13:29.888002 8051 rpcz_store.cc:276] 0505 20:13:28.069026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.162321 (+ 93295us) service_pool.cc:224] Handling call
0505 20:13:29.887728 (+1725407us) ts_tablet_manager.cc:1151] Deleting tablet 54becbd4690c403e803a7a79f12cb6d5
0505 20:13:29.887739 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.887824 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1725116}
W20260505 20:13:29.888414 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 54becbd4690c403e803a7a79f12cb6d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54becbd4690c403e803a7a79f12cb6d5 already in progress: creating tablet
I20260505 20:13:29.888805 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 377) took 1642 ms. Trace:
W20260505 20:13:29.880524 7737 consensus_peers.cc:597] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 611bba6267194d058cd08a27cdd2af49. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:29.888933 8051 rpcz_store.cc:276] 0505 20:13:28.246199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.246276 (+ 77us) service_pool.cc:224] Handling call
0505 20:13:29.888659 (+1642383us) ts_tablet_manager.cc:1151] Deleting tablet f2b2e40635b141c59d3789aca81efba7
0505 20:13:29.888668 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.888759 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1594218}
W20260505 20:13:29.889394 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f2b2e40635b141c59d3789aca81efba7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b2e40635b141c59d3789aca81efba7 already in progress: creating tablet
I20260505 20:13:29.890341 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 378) took 1555 ms. Trace:
I20260505 20:13:29.890720 8051 rpcz_store.cc:276] 0505 20:13:28.333925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.333988 (+ 63us) service_pool.cc:224] Handling call
0505 20:13:29.889690 (+1555702us) ts_tablet_manager.cc:1151] Deleting tablet 004a8e72cab44d31af3369b8df1e434e
0505 20:13:29.889702 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.889824 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1555463}
W20260505 20:13:29.891543 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 004a8e72cab44d31af3369b8df1e434e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 004a8e72cab44d31af3369b8df1e434e already in progress: creating tablet
I20260505 20:13:29.892102 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 379) took 1528 ms. Trace:
I20260505 20:13:29.892238 7737 leader_election.cc:304] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:29.892412 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca (DEFAULT_TABLE table=default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb [id=2c8ae910936748198e221a7864a4ccf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.892629 8051 rpcz_store.cc:276] 0505 20:13:28.363210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.363594 (+ 384us) service_pool.cc:224] Handling call
0505 20:13:29.891924 (+1528330us) ts_tablet_manager.cc:1151] Deleting tablet 19720f3a29f34515a952e50f4fec9f97
0505 20:13:29.891936 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.892036 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1502795}
I20260505 20:13:29.893517 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 381) took 1493 ms. Trace:
I20260505 20:13:29.893651 8557 consensus_queue.cc:1048] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:29.894121 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 19720f3a29f34515a952e50f4fec9f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19720f3a29f34515a952e50f4fec9f97 already in progress: creating tablet
I20260505 20:13:29.894816 8051 rpcz_store.cc:276] 0505 20:13:28.400061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.403546 (+ 3485us) service_pool.cc:224] Handling call
0505 20:13:29.893330 (+1489784us) ts_tablet_manager.cc:1151] Deleting tablet 4628e33d204c452ab12acf76f754f2ad
0505 20:13:29.893342 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.893445 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489462}
W20260505 20:13:29.895740 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 4628e33d204c452ab12acf76f754f2ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4628e33d204c452ab12acf76f754f2ad already in progress: creating tablet
I20260505 20:13:29.895761 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e17b17089792450bbc4dba372076af9a (table default.Table_8f662bf9642940d19389e4fe4f0a5e18 [id=a950b5c2d6ae401ca441ec76000e8084]) successfully deleted
I20260505 20:13:29.896376 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 384) took 1448 ms. Trace:
I20260505 20:13:29.896955 8051 rpcz_store.cc:276] 0505 20:13:28.448407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.448572 (+ 165us) service_pool.cc:224] Handling call
0505 20:13:29.896154 (+1447582us) ts_tablet_manager.cc:1151] Deleting tablet b9f684cd880b4a748cab49795de11503
0505 20:13:29.896167 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.896315 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1432153}
I20260505 20:13:29.897734 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:29.897722 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b9f684cd880b4a748cab49795de11503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9f684cd880b4a748cab49795de11503 already in progress: creating tablet
I20260505 20:13:29.898463 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 383) took 1483 ms. Trace:
I20260505 20:13:29.898700 8490 raft_consensus.cc:2804] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:29.898947 8051 rpcz_store.cc:276] 0505 20:13:28.415055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.415172 (+ 117us) service_pool.cc:224] Handling call
0505 20:13:29.898277 (+1483105us) ts_tablet_manager.cc:1151] Deleting tablet f3b3c646af9843048382e77b138aea44
0505 20:13:29.898291 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.898394 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1432237}
W20260505 20:13:29.899600 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f3b3c646af9843048382e77b138aea44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3b3c646af9843048382e77b138aea44 already in progress: creating tablet
I20260505 20:13:29.900198 8490 raft_consensus.cc:697] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:29.900265 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 386) took 1412 ms. Trace:
I20260505 20:13:29.900349 8051 rpcz_store.cc:276] 0505 20:13:28.487618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.490857 (+ 3239us) service_pool.cc:224] Handling call
0505 20:13:29.900126 (+1409269us) ts_tablet_manager.cc:1151] Deleting tablet 1218bd76239540be9a93ca455ba3eb47
0505 20:13:29.900136 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.900216 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408931}
I20260505 20:13:29.900548 8490 consensus_queue.cc:237] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:29.900743 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 1218bd76239540be9a93ca455ba3eb47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1218bd76239540be9a93ca455ba3eb47 already in progress: creating tablet
I20260505 20:13:29.901544 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 398) took 1249 ms. Trace:
I20260505 20:13:29.905373 8051 rpcz_store.cc:276] 0505 20:13:28.652099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.653219 (+ 1120us) service_pool.cc:224] Handling call
0505 20:13:29.901405 (+1248186us) ts_tablet_manager.cc:1151] Deleting tablet 168d9a40a69d4beab8e79a97e7723e69
0505 20:13:29.901414 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.901491 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245676}
W20260505 20:13:29.906371 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 168d9a40a69d4beab8e79a97e7723e69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 168d9a40a69d4beab8e79a97e7723e69 already in progress: creating tablet
I20260505 20:13:29.906929 8051 tablet_replica.cc:333] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.907541 8051 raft_consensus.cc:2243] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.908130 8051 raft_consensus.cc:2272] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.909933 8051 ts_tablet_manager.cc:1916] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.910914 8568 consensus_queue.cc:1048] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260505 20:13:29.918473 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1612c41337614a9c9edcd92892fd1c68" } modify_external_catalogs: true
I20260505 20:13:29.918819 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1612c41337614a9c9edcd92892fd1c68" } modify_external_catalogs: true
I20260505 20:13:29.920557 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_1bd6d826ee3e43e49cc3f1cde7ee0db4" } new_table_name: "default.Table_8e0d06e5e3a94117911e112f93d23c32" modify_external_catalogs: true
I20260505 20:13:29.921988 7335 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d7d6dfb1719442dab808da26e3a7e10d" } modify_external_catalogs: true
I20260505 20:13:29.922252 7335 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d7d6dfb1719442dab808da26e3a7e10d" } modify_external_catalogs: true
I20260505 20:13:29.924185 7339 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5e1f5308c918489ba8d124bd3752d9b3" } modify_external_catalogs: true
I20260505 20:13:29.924427 7339 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_5e1f5308c918489ba8d124bd3752d9b3" } modify_external_catalogs: true
I20260505 20:13:29.929303 7341 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_08e8ff8899e844538e9421366d07e8a4" } new_table_name: "default.Table_e152f139ba5447bda8846c89d2ea6628" modify_external_catalogs: true
I20260505 20:13:29.932668 7340 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 4 got 0
I20260505 20:13:29.938498 7340 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 4 got 0
I20260505 20:13:29.944738 8051 ts_tablet_manager.cc:1929] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:29.946715 8051 log.cc:1199] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/923ed274fe454cc4a625516769e6b5f3
I20260505 20:13:29.947540 8051 ts_tablet_manager.cc:1950] T 923ed274fe454cc4a625516769e6b5f3 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:29.950160 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 396) took 1315 ms. Trace:
I20260505 20:13:29.950836 8051 rpcz_store.cc:276] 0505 20:13:28.635196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.646538 (+ 11342us) service_pool.cc:224] Handling call
0505 20:13:29.906820 (+1260282us) ts_tablet_manager.cc:1151] Deleting tablet 923ed274fe454cc4a625516769e6b5f3
0505 20:13:29.906836 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.925167 (+ 18331us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.944603 (+ 19436us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:29.950109 (+ 5506us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250296}
I20260505 20:13:29.951821 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 923ed274fe454cc4a625516769e6b5f3 (table default.Table_b8dc23a61d1044d387ba34de22f570cb [id=580de9a798e54694a39a898d5fe4ab1b]) successfully deleted
I20260505 20:13:29.952328 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 397) took 1303 ms. Trace:
I20260505 20:13:29.952802 8051 rpcz_store.cc:276] 0505 20:13:28.649162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.656590 (+ 7428us) service_pool.cc:224] Handling call
0505 20:13:29.951867 (+1295277us) ts_tablet_manager.cc:1151] Deleting tablet 22a98da176254eeb896c680fbcb98caa
0505 20:13:29.951881 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.952274 (+ 393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1286713}
W20260505 20:13:29.953804 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 22a98da176254eeb896c680fbcb98caa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22a98da176254eeb896c680fbcb98caa already in progress: creating tablet
I20260505 20:13:29.953910 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 399) took 1299 ms. Trace:
I20260505 20:13:29.955581 8051 rpcz_store.cc:276] 0505 20:13:28.654867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.655065 (+ 198us) service_pool.cc:224] Handling call
0505 20:13:29.953764 (+1298699us) ts_tablet_manager.cc:1151] Deleting tablet 3d74dbab83b840d9b2bd103e946d3032
0505 20:13:29.953778 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:29.953877 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288160}
W20260505 20:13:29.956600 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 3d74dbab83b840d9b2bd103e946d3032 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d74dbab83b840d9b2bd103e946d3032 already in progress: creating tablet
W20260505 20:13:29.957521 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet bcd289ce979940ae96554d5756d140d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcd289ce979940ae96554d5756d140d7 already in progress: creating tablet
W20260505 20:13:29.958248 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4816f1ccb82e4641b2dcfe9ce9b55fae already in progress: creating tablet
I20260505 20:13:29.960291 8051 tablet_replica.cc:333] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:29.891295 8050 raft_consensus.cc:2243] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:29.963199 8050 raft_consensus.cc:2272] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.963773 8051 raft_consensus.cc:2243] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:29.964437 8051 pending_rounds.cc:70] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:29.965785 8051 pending_rounds.cc:77] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737187378618368 op_type: NO_OP noop_request { }
I20260505 20:13:29.966207 8051 raft_consensus.cc:2889] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:29.966495 8051 raft_consensus.cc:2272] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:29.968428 8050 ts_tablet_manager.cc:1916] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:29.974522 8557 raft_consensus.cc:493] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:29.974807 8557 raft_consensus.cc:515] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.975711 8557 leader_election.cc:290] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:29.968467 8058 tablet_bootstrap.cc:492] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:29.976739 8058 ts_tablet_manager.cc:1403] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.198s user 0.001s sys 0.008s
W20260505 20:13:29.977288 7598 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:29.977624 8058 raft_consensus.cc:359] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.977967 8058 raft_consensus.cc:385] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:29.978097 8058 raft_consensus.cc:740] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:29.978559 8058 consensus_queue.cc:260] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:29.980255 8058 ts_tablet_manager.cc:1434] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:29.980738 8058 tablet_bootstrap.cc:492] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:29.980932 7328 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 254906us
I20260505 20:13:29.981501 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 (DEFAULT_TABLE table=default.Table_d6c96dbb361b457684823113cd6727ea [id=5b2af32ce8704ee4b48ebeb114130d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.981565 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:29.982057 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaff49cb0ff4298be24603b2015c8a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.982717 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 98af33c2cdb24937858efdc7b638418f (table default.Table_7aa09788a9b54cab8303f80b2237ee4e [id=e8647104c97e4b258208aedab9f5f35d]) successfully deleted
I20260505 20:13:29.983457 7900 tablet_service.cc:1511] Processing CreateTablet for tablet bc112545c3eb4e0189cb1ea45edd4fd0 (DEFAULT_TABLE table=default.Table_318c908c4ab241c09ed344cd15203aea [id=3a774ed366a4499683d2c81d149d0dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.983883 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc112545c3eb4e0189cb1ea45edd4fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.986203 7635 tablet_service.cc:1511] Processing CreateTablet for tablet bc112545c3eb4e0189cb1ea45edd4fd0 (DEFAULT_TABLE table=default.Table_318c908c4ab241c09ed344cd15203aea [id=3a774ed366a4499683d2c81d149d0dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.986671 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc112545c3eb4e0189cb1ea45edd4fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.989962 7334 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_c3df4da03c5b4917b507a2945a453705" } new_table_name: "default.Table_7fed6273ecc7495982a3888baed39d0d" modify_external_catalogs: true
I20260505 20:13:29.990320 7625 tablet_service.cc:1511] Processing CreateTablet for tablet f5dfabb36fa5499780b0d15c71404307 (DEFAULT_TABLE table=default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.990855 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5dfabb36fa5499780b0d15c71404307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.991550 7340 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_56edcc43011944a8894e3b105d3be69e" } new_table_name: "default.Table_dbca8d5382b04c119856038b4a11f047" modify_external_catalogs: true
I20260505 20:13:29.993728 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9bd035b077474294d274a8f8cb38fd (DEFAULT_TABLE table=default.Table_38d192fd0ccf420588d860dddcd2394c [id=b11d0432d00747cba7ee33cdf0d4881c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.994390 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9bd035b077474294d274a8f8cb38fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.994411 7333 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f0ca8cc557674992b88f3379cc1db652
I20260505 20:13:29.994519 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9bd035b077474294d274a8f8cb38fd (DEFAULT_TABLE table=default.Table_38d192fd0ccf420588d860dddcd2394c [id=b11d0432d00747cba7ee33cdf0d4881c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:29.994925 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9bd035b077474294d274a8f8cb38fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:29.996170 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:29.997659 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 20c24f9f26c84ba7b2ce85f9da4bccf8
W20260505 20:13:29.998082 7342 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 68718abc133e452495567232e51fb55b has no consensus state
I20260505 20:13:29.999192 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:30.000403 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_f6ef71acc15249d5bdd74eac928d3bcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:30.001013 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6ef71acc15249d5bdd74eac928d3bcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.002378 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_8595c29834684cbd83e7b51b31b8b82b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:30.002965 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8595c29834684cbd83e7b51b31b8b82b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.003609 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.004043 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.005370 7333 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_c3df4da03c5b4917b507a2945a453705 [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 2 got 0
I20260505 20:13:30.005545 7900 tablet_service.cc:1511] Processing CreateTablet for tablet f5dfabb36fa5499780b0d15c71404307 (DEFAULT_TABLE table=default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.006001 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5dfabb36fa5499780b0d15c71404307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.012086 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 608bffbbc10141e8bd19f475b95bdc65
I20260505 20:13:30.013602 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:30.017932 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.032578 7338 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_314707634b784fa686de6f277f00aec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:30.034152 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1f7a0fefa74f45a1cf3ffeac2c33fb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.036150 8054 tablet_bootstrap.cc:492] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.036587 8054 ts_tablet_manager.cc:1403] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.176s user 0.011s sys 0.014s
I20260505 20:13:30.037847 8054 raft_consensus.cc:359] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.038952 7338 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_314707634b784fa686de6f277f00aec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.042768 8054 raft_consensus.cc:385] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.042992 8054 raft_consensus.cc:740] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:30.043576 7337 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 997f2f9cf76a4311ab233cb7d8bc8e3c consensus state has no leader
I20260505 20:13:30.038503 7773 tablet_service.cc:1511] Processing CreateTablet for tablet bc112545c3eb4e0189cb1ea45edd4fd0 (DEFAULT_TABLE table=default.Table_318c908c4ab241c09ed344cd15203aea [id=3a774ed366a4499683d2c81d149d0dcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.044176 8620 tablet.cc:1724] T 983ad31892394f67a7a9a727dc2bef1b P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:30.045610 7337 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:30.046144 8051 ts_tablet_manager.cc:1916] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.044225 8054 consensus_queue.cc:260] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.048528 8054 ts_tablet_manager.cc:1434] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260505 20:13:30.049978 7337 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_58b87c163c1f49a89a9bc55d655baf2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:30.050074 8058 tablet_bootstrap.cc:654] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:30.050971 7337 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58b87c163c1f49a89a9bc55d655baf2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.057559 8054 tablet_bootstrap.cc:492] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.059379 7781 tablet_service.cc:1511] Processing CreateTablet for tablet f5dfabb36fa5499780b0d15c71404307 (DEFAULT_TABLE table=default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.060011 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9bd035b077474294d274a8f8cb38fd (DEFAULT_TABLE table=default.Table_38d192fd0ccf420588d860dddcd2394c [id=b11d0432d00747cba7ee33cdf0d4881c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.060148 8054 tablet_bootstrap.cc:654] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.069218 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc112545c3eb4e0189cb1ea45edd4fd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.071967 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (DEFAULT_TABLE table=default.Table_ac5b74d3d36f45ec9885c20f92938f45 [id=67accc85180f48418217cf187d1fee88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.072463 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ed3ee8c7a048979f5c620bc21f5b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.073011 7906 tablet_service.cc:1511] Processing CreateTablet for tablet d75821282ca446b7b875ccb5a063e784 (DEFAULT_TABLE table=default.Table_3c329f8225c0482ba66b8cb2bece4f84 [id=76c82dc9119c4120bb27ac4b61c9f8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.073511 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75821282ca446b7b875ccb5a063e784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.078087 7625 tablet_service.cc:1511] Processing CreateTablet for tablet d75821282ca446b7b875ccb5a063e784 (DEFAULT_TABLE table=default.Table_3c329f8225c0482ba66b8cb2bece4f84 [id=76c82dc9119c4120bb27ac4b61c9f8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.078567 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75821282ca446b7b875ccb5a063e784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.080921 8058 tablet_bootstrap.cc:492] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.081157 8058 ts_tablet_manager.cc:1403] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.006s
I20260505 20:13:30.081280 8050 ts_tablet_manager.cc:1929] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.081435 8050 log.cc:1199] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/2c12a95b0ed445c7b598db136f6ac05c
I20260505 20:13:30.082315 8058 raft_consensus.cc:359] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.089922 8058 raft_consensus.cc:385] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.090195 8058 raft_consensus.cc:740] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.090535 8058 consensus_queue.cc:260] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.090049 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (DEFAULT_TABLE table=default.Table_ac5b74d3d36f45ec9885c20f92938f45 [id=67accc85180f48418217cf187d1fee88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.091316 8058 ts_tablet_manager.cc:1434] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260505 20:13:30.091699 8058 tablet_bootstrap.cc:492] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.092253 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ed3ee8c7a048979f5c620bc21f5b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.093415 8054 tablet_bootstrap.cc:492] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.093638 8054 ts_tablet_manager.cc:1403] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.001s
I20260505 20:13:30.093712 7335 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet f5dfabb36fa5499780b0d15c71404307
I20260505 20:13:30.094714 8054 raft_consensus.cc:359] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.095033 8054 raft_consensus.cc:385] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.095165 8054 raft_consensus.cc:740] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.095492 8054 consensus_queue.cc:260] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.096124 8054 ts_tablet_manager.cc:1434] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:30.096879 8050 ts_tablet_manager.cc:1950] T 2c12a95b0ed445c7b598db136f6ac05c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:30.096912 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.097232 8054 tablet_bootstrap.cc:492] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.099165 8054 tablet_bootstrap.cc:654] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.099803 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
I20260505 20:13:30.099885 8058 tablet_bootstrap.cc:654] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.101578 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9bd035b077474294d274a8f8cb38fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.105170 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.106030 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 2c12a95b0ed445c7b598db136f6ac05c (table default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]) successfully deleted
I20260505 20:13:30.106283 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.107676 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5dfabb36fa5499780b0d15c71404307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.110154 8051 ts_tablet_manager.cc:1929] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:30.111193 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.111658 7339 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet ee19f65120184eca9495513b68440b4f
I20260505 20:13:30.112913 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.113106 8050 tablet_replica.cc:333] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:30.113341 8050 raft_consensus.cc:2243] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.114189 8054 tablet_bootstrap.cc:492] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.114742 8054 ts_tablet_manager.cc:1403] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260505 20:13:30.115540 8054 raft_consensus.cc:359] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.115808 8054 raft_consensus.cc:385] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.115909 8054 raft_consensus.cc:740] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.116195 8054 consensus_queue.cc:260] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.117501 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (DEFAULT_TABLE table=default.Table_ac5b74d3d36f45ec9885c20f92938f45 [id=67accc85180f48418217cf187d1fee88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.117645 8054 ts_tablet_manager.cc:1434] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:30.114189 8050 raft_consensus.cc:2272] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.118877 8050 ts_tablet_manager.cc:1916] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.121188 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ed3ee8c7a048979f5c620bc21f5b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.121088 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_06b9387992f541f584126cf0be193f38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:30.114228 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:30.121773 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06b9387992f541f584126cf0be193f38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.117205 8058 tablet_bootstrap.cc:492] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.121999 8058 ts_tablet_manager.cc:1403] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260505 20:13:30.122191 8051 log.cc:1199] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/4e6da3130e724445b0d1f3c20e4e3d02
I20260505 20:13:30.123066 8051 ts_tablet_manager.cc:1950] T 4e6da3130e724445b0d1f3c20e4e3d02 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:30.123562 8054 tablet_bootstrap.cc:492] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.124569 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.123018 8058 raft_consensus.cc:359] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.125736 8058 raft_consensus.cc:385] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.125917 8058 raft_consensus.cc:740] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:30.126003 7596 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.126758 8054 tablet_bootstrap.cc:654] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.127290 7596 leader_election.cc:304] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.127386 7768 tablet_service.cc:1511] Processing CreateTablet for tablet d75821282ca446b7b875ccb5a063e784 (DEFAULT_TABLE table=default.Table_3c329f8225c0482ba66b8cb2bece4f84 [id=76c82dc9119c4120bb27ac4b61c9f8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.127559 8058 consensus_queue.cc:260] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.128099 8557 raft_consensus.cc:2749] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.128453 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75821282ca446b7b875ccb5a063e784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.128760 8058 ts_tablet_manager.cc:1434] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:30.129108 8058 tablet_bootstrap.cc:492] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.134793 8058 tablet_bootstrap.cc:654] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:30.136312 7341 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 034852d91c26434f8a3c7fd8100c49ac consensus state has no leader
I20260505 20:13:30.139369 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 408) took 1160 ms. Trace:
I20260505 20:13:30.140651 8051 rpcz_store.cc:276] 0505 20:13:28.978723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.978774 (+ 51us) service_pool.cc:224] Handling call
0505 20:13:29.960214 (+981440us) ts_tablet_manager.cc:1151] Deleting tablet 4e6da3130e724445b0d1f3c20e4e3d02
0505 20:13:29.960226 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.076330 (+116104us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.110031 (+ 33701us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.139316 (+ 29285us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":981225}
I20260505 20:13:30.142138 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 753536034d2647ef90ee3cf280b13855 (DEFAULT_TABLE table=default.Table_9892374ca24c4ab9a063de4b525033be [id=f74e2d63044b4e4b98c2d0b056fcc0a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.142627 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753536034d2647ef90ee3cf280b13855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.144619 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.148670 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 407) took 1172 ms. Trace:
I20260505 20:13:30.148717 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 4e6da3130e724445b0d1f3c20e4e3d02 (table default.Table_7ddae9d794cb4fc8bdd97ec5db7a246c [id=af669dc2fb6848f0ba9899d2dd7344f7]) successfully deleted
I20260505 20:13:30.154111 8051 rpcz_store.cc:276] 0505 20:13:28.976216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.979129 (+ 2913us) service_pool.cc:224] Handling call
0505 20:13:30.148476 (+1169347us) ts_tablet_manager.cc:1151] Deleting tablet e6c5c661e8aa4962bb9922b9ead7d784
0505 20:13:30.148491 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.148626 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169114}
I20260505 20:13:30.154846 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 753536034d2647ef90ee3cf280b13855 (DEFAULT_TABLE table=default.Table_9892374ca24c4ab9a063de4b525033be [id=f74e2d63044b4e4b98c2d0b056fcc0a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.152411 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 753536034d2647ef90ee3cf280b13855 (DEFAULT_TABLE table=default.Table_9892374ca24c4ab9a063de4b525033be [id=f74e2d63044b4e4b98c2d0b056fcc0a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.155505 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753536034d2647ef90ee3cf280b13855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.155509 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753536034d2647ef90ee3cf280b13855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.158773 7341 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:30.159444 7341 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.139875 8058 tablet_bootstrap.cc:492] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.162135 8058 ts_tablet_manager.cc:1403] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.000s
I20260505 20:13:30.163619 8058 raft_consensus.cc:359] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.164032 8058 raft_consensus.cc:385] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.164206 8058 raft_consensus.cc:740] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.164638 8058 consensus_queue.cc:260] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.165081 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 463264us
I20260505 20:13:30.165637 8058 ts_tablet_manager.cc:1434] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260505 20:13:30.166446 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e6c5c661e8aa4962bb9922b9ead7d784 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6c5c661e8aa4962bb9922b9ead7d784 already in progress: creating tablet
W20260505 20:13:30.168426 7334 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01e800dfb0354beab9c835cbed9dceb4 consensus state has no leader
I20260505 20:13:30.169538 7663 raft_consensus.cc:3060] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.165953 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cce2fd271641ad83c9b3e4beeb12ee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.169775 7662 raft_consensus.cc:3060] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.169863 8058 tablet_bootstrap.cc:492] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.166285 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 409) took 1170 ms. Trace:
I20260505 20:13:30.171620 8051 rpcz_store.cc:276] 0505 20:13:28.996048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.996198 (+ 150us) service_pool.cc:224] Handling call
0505 20:13:30.166059 (+1169861us) ts_tablet_manager.cc:1151] Deleting tablet 8c8754580368453aa0aae021d8c665da
0505 20:13:30.166076 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.166230 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169377}
W20260505 20:13:30.172250 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 8c8754580368453aa0aae021d8c665da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c8754580368453aa0aae021d8c665da already in progress: creating tablet
I20260505 20:13:30.172327 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 410) took 1108 ms. Trace:
I20260505 20:13:30.175925 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.181594 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_2a37262735b9408bb4498e2ad3758f5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:30.182320 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a37262735b9408bb4498e2ad3758f5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.184028 7333 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_230d8eb90a074722ae79ec83c16b757b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:30.184633 7333 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_230d8eb90a074722ae79ec83c16b757b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.173725 7662 raft_consensus.cc:2468] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:30.186286 8051 rpcz_store.cc:276] 0505 20:13:29.064019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.064079 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:30.172142 (+1108063us) ts_tablet_manager.cc:1151] Deleting tablet 4939dab5a4d54a08a75424bcaabbb8dd
0505 20:13:30.172153 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.172286 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107684}
I20260505 20:13:30.175834 8621 tablet.cc:1724] T 983ad31892394f67a7a9a727dc2bef1b P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260505 20:13:30.190313 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 4939dab5a4d54a08a75424bcaabbb8dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4939dab5a4d54a08a75424bcaabbb8dd already in progress: creating tablet
I20260505 20:13:30.190719 8051 tablet_replica.cc:333] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:30.192127 8051 raft_consensus.cc:2243] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.192446 8051 raft_consensus.cc:2272] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.193264 8051 ts_tablet_manager.cc:1916] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:30.193416 7340 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2c99f02ea514a2581f0697dc3ef6461 has no consensus state
I20260505 20:13:30.194424 8058 tablet_bootstrap.cc:654] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.200156 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 799f3fc33c48436da61cc0cfbf0b0218 (DEFAULT_TABLE table=default.Table_6d4b2501aefb48ae90019d3bfdb71a24 [id=5945251171634214a7e24933d7768727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.200886 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799f3fc33c48436da61cc0cfbf0b0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.201141 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce500f525c748d999d591390dd6094b (DEFAULT_TABLE table=default.Table_89dfd83915c249d2bfd6edc8f86c2acf [id=98e304465ac0407c92443491641607f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.201563 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce500f525c748d999d591390dd6094b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.215714 7340 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:30.216005 7340 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:30.216202 7340 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 4 got 0
I20260505 20:13:30.221086 8051 ts_tablet_manager.cc:1929] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.223747 8605 raft_consensus.cc:493] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.224326 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 799f3fc33c48436da61cc0cfbf0b0218 (DEFAULT_TABLE table=default.Table_6d4b2501aefb48ae90019d3bfdb71a24 [id=5945251171634214a7e24933d7768727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.224763 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799f3fc33c48436da61cc0cfbf0b0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.223992 8605 raft_consensus.cc:515] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.229696 8567 consensus_queue.cc:1048] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260505 20:13:30.232174 7782 tablet_service.cc:1511] Processing CreateTablet for tablet b6a3078a3ec94043b84de3d39a1f5233 (DEFAULT_TABLE table=default.Table_45b02f2afbda4ad88bfc9c41c987aa4b [id=83bea458fe874e78a4168e6820a7f048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.236521 7342 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_df8877e563ff4aa49f6f201934596c59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:30.237186 7342 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df8877e563ff4aa49f6f201934596c59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.238581 8605 leader_election.cc:290] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.245270 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a3078a3ec94043b84de3d39a1f5233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.246265 8052 ts_tablet_manager.cc:1929] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:30.246501 8052 log.cc:1199] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/74a5d442f25242ea8371fca8643f4ce6
I20260505 20:13:30.242373 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce500f525c748d999d591390dd6094b (DEFAULT_TABLE table=default.Table_89dfd83915c249d2bfd6edc8f86c2acf [id=98e304465ac0407c92443491641607f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.247773 8052 ts_tablet_manager.cc:1950] T 74a5d442f25242ea8371fca8643f4ce6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:30.248337 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 364) took 2494 ms. Trace:
I20260505 20:13:30.249198 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce500f525c748d999d591390dd6094b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.224053 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce500f525c748d999d591390dd6094b (DEFAULT_TABLE table=default.Table_89dfd83915c249d2bfd6edc8f86c2acf [id=98e304465ac0407c92443491641607f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.226902 7636 tablet_service.cc:1511] Processing CreateTablet for tablet b6a3078a3ec94043b84de3d39a1f5233 (DEFAULT_TABLE table=default.Table_45b02f2afbda4ad88bfc9c41c987aa4b [id=83bea458fe874e78a4168e6820a7f048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.250497 8051 log.cc:1199] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f32d3ec040604ce7b384c4b6a202707f
I20260505 20:13:30.250505 8052 rpcz_store.cc:276] 0505 20:13:27.753676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.753731 (+ 55us) service_pool.cc:224] Handling call
0505 20:13:29.882416 (+2128685us) ts_tablet_manager.cc:1151] Deleting tablet 74a5d442f25242ea8371fca8643f4ce6
0505 20:13:29.882428 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.131052 (+248624us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.242281 (+111229us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.248185 (+ 5904us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2122025}
I20260505 20:13:30.238540 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e800dfb0354beab9c835cbed9dceb4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.251005 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 74a5d442f25242ea8371fca8643f4ce6 (table default.Table_75b399df34af49b78ee0de07fcdc0991 [id=8bb9e97bc80f43c99a93689f548cc8e8]) successfully deleted
I20260505 20:13:30.251061 7661 raft_consensus.cc:2468] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:30.250584 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a3078a3ec94043b84de3d39a1f5233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.227028 8058 tablet_bootstrap.cc:492] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.251353 8052 tablet_replica.cc:333] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:30.251484 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce500f525c748d999d591390dd6094b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.251614 8052 raft_consensus.cc:2243] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:30.252025 8052 raft_consensus.cc:2272] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.253564 8053 tablet_bootstrap.cc:492] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:30.253708 8053 ts_tablet_manager.cc:1403] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.695s user 0.009s sys 0.012s
I20260505 20:13:30.255422 7913 tablet_service.cc:1511] Processing CreateTablet for tablet b6a3078a3ec94043b84de3d39a1f5233 (DEFAULT_TABLE table=default.Table_45b02f2afbda4ad88bfc9c41c987aa4b [id=83bea458fe874e78a4168e6820a7f048]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.256183 8605 raft_consensus.cc:493] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.256197 8620 tablet.cc:1724] T ff4ea5fcb558489097e518a28ad967dd P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260505 20:13:30.256481 8605 raft_consensus.cc:515] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.256512 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e800dfb0354beab9c835cbed9dceb4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:30.257339 8605 leader_election.cc:290] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.257709 8058 ts_tablet_manager.cc:1403] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.088s user 0.005s sys 0.000s
I20260505 20:13:30.257701 8619 raft_consensus.cc:493] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.258256 8619 raft_consensus.cc:515] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.258291 7907 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b05546a4f47aea5fae1cf767b762d (DEFAULT_TABLE table=default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.258657 8058 raft_consensus.cc:359] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.258890 8058 raft_consensus.cc:385] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.259009 8058 raft_consensus.cc:740] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.259325 8058 consensus_queue.cc:260] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.260072 8052 ts_tablet_manager.cc:1916] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.260140 8058 ts_tablet_manager.cc:1434] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:30.260919 8058 tablet_bootstrap.cc:492] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.262631 7336 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e0363126ed254326bea2dd6eeeda5ace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:30.263188 8058 tablet_bootstrap.cc:654] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.263523 8053 raft_consensus.cc:359] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.263715 8053 raft_consensus.cc:385] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.263803 8053 raft_consensus.cc:740] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:30.263372 7336 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0363126ed254326bea2dd6eeeda5ace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:30.266070 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb404fa927641f48f28c6bdaa297db3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.266357 7661 raft_consensus.cc:2468] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:30.267258 7736 leader_election.cc:304] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.268144 7736 leader_election.cc:304] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.268690 8567 raft_consensus.cc:2804] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.268823 8567 raft_consensus.cc:493] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.268934 8567 raft_consensus.cc:3060] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.274155 8567 raft_consensus.cc:515] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.274838 8605 raft_consensus.cc:2804] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.275075 8605 raft_consensus.cc:493] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.275264 8605 raft_consensus.cc:3060] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.276831 7635 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b05546a4f47aea5fae1cf767b762d (DEFAULT_TABLE table=default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.277393 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b05546a4f47aea5fae1cf767b762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.280583 7338 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_18b6a5de2149454d876ffde71ee2f43e" } modify_external_catalogs: true
I20260505 20:13:30.280834 7338 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_18b6a5de2149454d876ffde71ee2f43e" } modify_external_catalogs: true
W20260505 20:13:30.282065 7328 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 65003660c44547cc8674baeca370e395 consensus state has no leader
I20260505 20:13:30.282732 7641 tablet_service.cc:1511] Processing CreateTablet for tablet e1e4b516283f441bb77f038816afa4ed (DEFAULT_TABLE table=default.Table_bf62bacfeaa24c4ca237490e17c20ad8 [id=a89cd6133fe5494cbf2d3520bc8c744a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.282887 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (DEFAULT_TABLE table=default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.283192 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e4b516283f441bb77f038816afa4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.284430 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578a9ebf768d4c73990fb2a28a9d4ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.289268 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e800dfb0354beab9c835cbed9dceb4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.289508 7661 raft_consensus.cc:3060] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.292748 7661 raft_consensus.cc:2468] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:30.292852 8621 tablet.cc:1724] T ff4ea5fcb558489097e518a28ad967dd P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260505 20:13:30.294633 8050 ts_tablet_manager.cc:1929] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.279791 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (DEFAULT_TABLE table=default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.297307 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578a9ebf768d4c73990fb2a28a9d4ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.302142 8050 log.cc:1199] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:30.280587 7766 tablet_service.cc:1511] Processing CreateTablet for tablet e1e4b516283f441bb77f038816afa4ed (DEFAULT_TABLE table=default.Table_bf62bacfeaa24c4ca237490e17c20ad8 [id=a89cd6133fe5494cbf2d3520bc8c744a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.303201 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e4b516283f441bb77f038816afa4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.305217 7337 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e" } modify_external_catalogs: true
I20260505 20:13:30.305418 7337 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e" } modify_external_catalogs: true
I20260505 20:13:30.281328 7768 tablet_service.cc:1511] Processing CreateTablet for tablet c689df9f8285487da25b32b6c02df003 (DEFAULT_TABLE table=default.Table_2818c22c9c4d486ea6a43294e850d902 [id=98228933cfdf4f30b5c3431bf704abea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.285473 7773 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b05546a4f47aea5fae1cf767b762d (DEFAULT_TABLE table=default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.276088 8567 leader_election.cc:290] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.293859 7736 leader_election.cc:304] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.308790 7935 raft_consensus.cc:2468] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:30.295892 7737 leader_election.cc:343] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:30.308043 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c689df9f8285487da25b32b6c02df003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.311136 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a3078a3ec94043b84de3d39a1f5233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.311110 8615 raft_consensus.cc:2804] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.311272 8615 raft_consensus.cc:697] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:30.296105 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 799f3fc33c48436da61cc0cfbf0b0218 (DEFAULT_TABLE table=default.Table_6d4b2501aefb48ae90019d3bfdb71a24 [id=5945251171634214a7e24933d7768727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.311549 8615 consensus_queue.cc:237] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.311892 7625 tablet_service.cc:1511] Processing CreateTablet for tablet c689df9f8285487da25b32b6c02df003 (DEFAULT_TABLE table=default.Table_2818c22c9c4d486ea6a43294e850d902 [id=98228933cfdf4f30b5c3431bf704abea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.313524 7915 tablet_service.cc:1511] Processing CreateTablet for tablet c689df9f8285487da25b32b6c02df003 (DEFAULT_TABLE table=default.Table_2818c22c9c4d486ea6a43294e850d902 [id=98228933cfdf4f30b5c3431bf704abea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.314975 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (DEFAULT_TABLE table=default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.315008 8050 ts_tablet_manager.cc:1950] T 84fb3dcea55d4b348cbf92c3c4581dda P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:30.315663 7916 tablet_service.cc:1511] Processing CreateTablet for tablet e1e4b516283f441bb77f038816afa4ed (DEFAULT_TABLE table=default.Table_bf62bacfeaa24c4ca237490e17c20ad8 [id=a89cd6133fe5494cbf2d3520bc8c744a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.316424 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b05546a4f47aea5fae1cf767b762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.310983 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b05546a4f47aea5fae1cf767b762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.317184 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e800dfb0354beab9c835cbed9dceb4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:30.317269 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4939dab5a4d54a08a75424bcaabbb8dd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.317437 7936 raft_consensus.cc:3060] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.318470 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4939dab5a4d54a08a75424bcaabbb8dd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.319343 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 84fb3dcea55d4b348cbf92c3c4581dda (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
W20260505 20:13:30.320250 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet bde33085759f4fd8a130d80878d1e564 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bde33085759f4fd8a130d80878d1e564 already in progress: creating tablet
I20260505 20:13:30.294056 8053 consensus_queue.cc:260] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.322609 8053 ts_tablet_manager.cc:1434] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260505 20:13:30.324039 8053 tablet_bootstrap.cc:492] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:30.324915 8619 leader_election.cc:290] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.325397 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e4b516283f441bb77f038816afa4ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:30.327004 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet b6895af5f55b4bc183065626417090a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6895af5f55b4bc183065626417090a4 already in progress: creating tablet
I20260505 20:13:30.333228 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c689df9f8285487da25b32b6c02df003. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:30.338201 7869 leader_election.cc:343] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:30.338582 7870 leader_election.cc:343] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:30.340490 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 already in progress: creating tablet
I20260505 20:13:30.341602 8054 tablet_bootstrap.cc:492] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.341811 8054 ts_tablet_manager.cc:1403] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.218s user 0.045s sys 0.079s
W20260505 20:13:30.343609 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 944eaa335fcf49be975baee21c715642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944eaa335fcf49be975baee21c715642 already in progress: creating tablet
I20260505 20:13:30.344446 8054 raft_consensus.cc:359] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.291661 8605 raft_consensus.cc:515] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.347587 7335 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2] alter complete (version 2)
I20260505 20:13:30.347777 8605 leader_election.cc:290] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.353603 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb404fa927641f48f28c6bdaa297db3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.354012 7661 raft_consensus.cc:3060] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:30.354233 7737 leader_election.cc:343] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:30.354475 8054 raft_consensus.cc:385] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.354663 7936 raft_consensus.cc:2468] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:30.355391 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799f3fc33c48436da61cc0cfbf0b0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.356446 8050 tablet_replica.cc:333] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:30.357188 7661 raft_consensus.cc:2468] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:30.358456 7870 leader_election.cc:304] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.358668 7736 leader_election.cc:304] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:30.359084 8605 raft_consensus.cc:2804] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.359264 8605 raft_consensus.cc:697] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:30.359579 8605 consensus_queue.cc:237] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.360455 8054 raft_consensus.cc:740] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.360812 8054 consensus_queue.cc:260] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.361428 8054 ts_tablet_manager.cc:1434] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260505 20:13:30.361872 8054 tablet_bootstrap.cc:492] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.368901 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 578a9ebf768d4c73990fb2a28a9d4ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.371232 8447 raft_consensus.cc:2749] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.372658 8053 tablet_bootstrap.cc:654] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.372658 8050 raft_consensus.cc:2243] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.372997 8050 raft_consensus.cc:2272] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.372982 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 359ab1033ccf4445862867f3f8b78ecd (DEFAULT_TABLE table=default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.373415 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359ab1033ccf4445862867f3f8b78ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.373481 8051 ts_tablet_manager.cc:1950] T f32d3ec040604ce7b384c4b6a202707f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:30.374395 8447 raft_consensus.cc:493] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.374562 8447 raft_consensus.cc:515] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.373638 8050 ts_tablet_manager.cc:1916] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.375231 8447 leader_election.cc:290] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.377368 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a98da176254eeb896c680fbcb98caa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.378082 7636 tablet_service.cc:1511] Processing CreateTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 (DEFAULT_TABLE table=default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf [id=ce67d81dbf7049bbb005069ee91d338a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.379159 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d78ebf153640e4b2f518fb215f1bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.379119 8557 raft_consensus.cc:493] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.379513 8557 raft_consensus.cc:515] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.380264 8557 leader_election.cc:290] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.381356 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf77f6323af4263852853e10003faee" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.381549 7802 raft_consensus.cc:2468] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:30.383395 7596 leader_election.cc:304] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.383782 8557 raft_consensus.cc:2804] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.383879 8557 raft_consensus.cc:493] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.383973 8557 raft_consensus.cc:3060] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.387022 8557 raft_consensus.cc:515] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.388203 8557 leader_election.cc:290] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.390767 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf77f6323af4263852853e10003faee" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:30.390959 7802 raft_consensus.cc:3060] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.393760 8633 tablet.cc:1724] T ff4ea5fcb558489097e518a28ad967dd P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260505 20:13:30.395242 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c689df9f8285487da25b32b6c02df003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.397293 8054 tablet_bootstrap.cc:654] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:30.397069 7869 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.401268 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_aa8a97db5d1e46a2afbe7ceeb00c1538" } new_table_name: "default.Table_ab61868a8dcf4a8ea31488afb5c5f401" modify_external_catalogs: true
I20260505 20:13:30.402837 7340 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_144b1826c7b54532bd72768c533adc7e" } modify_external_catalogs: true
I20260505 20:13:30.403036 7340 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_144b1826c7b54532bd72768c533adc7e" } modify_external_catalogs: true
I20260505 20:13:30.411285 7900 tablet_service.cc:1511] Processing CreateTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 (DEFAULT_TABLE table=default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf [id=ce67d81dbf7049bbb005069ee91d338a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.397302 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a98da176254eeb896c680fbcb98caa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:30.403859 7598 leader_election.cc:343] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 6cf77f6323af4263852853e10003faee
W20260505 20:13:30.412132 7598 leader_election.cc:343] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 6cf77f6323af4263852853e10003faee
W20260505 20:13:30.412969 7870 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.413678 7870 leader_election.cc:304] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.414309 8447 raft_consensus.cc:2749] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.415684 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d78ebf153640e4b2f518fb215f1bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.418817 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.419301 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.422953 7339 catalog_manager.cc:5671] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:30.425175 7339 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:30.425426 8054 tablet_bootstrap.cc:492] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.425817 8054 ts_tablet_manager.cc:1403] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.000s
I20260505 20:13:30.426306 7339 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]). Expected version 2 got 0
I20260505 20:13:30.426698 7339 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4]). Expected version 4 got 0
I20260505 20:13:30.427925 8447 raft_consensus.cc:493] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.428067 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 411) took 1363 ms. Trace:
I20260505 20:13:30.428102 8447 raft_consensus.cc:515] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.428184 8051 rpcz_store.cc:276] 0505 20:13:29.065069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.065173 (+ 104us) service_pool.cc:224] Handling call
0505 20:13:30.190620 (+1125447us) ts_tablet_manager.cc:1151] Deleting tablet f32d3ec040604ce7b384c4b6a202707f
0505 20:13:30.190632 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.216330 (+ 25698us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.220950 (+ 4620us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.428007 (+207057us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1125201}
I20260505 20:13:30.428625 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f32d3ec040604ce7b384c4b6a202707f (table default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]) successfully deleted
I20260505 20:13:30.428820 8447 leader_election.cc:290] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.431308 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a42f0b6dc74cbd8d72ae36410f9d35" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:30.431921 7870 leader_election.cc:343] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.432515 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 359ab1033ccf4445862867f3f8b78ecd (DEFAULT_TABLE table=default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.433710 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:30.433951 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 412) took 1338 ms. Trace:
I20260505 20:13:30.433943 7781 tablet_service.cc:1511] Processing CreateTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 (DEFAULT_TABLE table=default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf [id=ce67d81dbf7049bbb005069ee91d338a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.434048 8051 rpcz_store.cc:276] 0505 20:13:29.095485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.098137 (+ 2652us) service_pool.cc:224] Handling call
0505 20:13:30.433720 (+1335583us) ts_tablet_manager.cc:1151] Deleting tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0
0505 20:13:30.433733 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.433893 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1335311}
I20260505 20:13:30.434582 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d78ebf153640e4b2f518fb215f1bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.437844 8050 ts_tablet_manager.cc:1929] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.437966 8051 tablet_replica.cc:333] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:30.437995 8050 log.cc:1199] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:30.438203 8051 raft_consensus.cc:2243] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.438335 8050 ts_tablet_manager.cc:1950] T 4939dab5a4d54a08a75424bcaabbb8dd P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:30.438416 8051 raft_consensus.cc:2272] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.439025 8051 ts_tablet_manager.cc:1916] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.443449 8639 raft_consensus.cc:493] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.443737 8639 raft_consensus.cc:515] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.446008 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6acad22190b402d892d06ff97bd9476" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.446583 8054 raft_consensus.cc:359] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.446795 8054 raft_consensus.cc:385] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.446887 8054 raft_consensus.cc:740] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.447106 8054 consensus_queue.cc:260] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.448864 7870 leader_election.cc:343] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.450322 8054 ts_tablet_manager.cc:1434] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260505 20:13:30.450501 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a42f0b6dc74cbd8d72ae36410f9d35" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:30.451231 7869 leader_election.cc:343] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.451373 7869 leader_election.cc:304] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.451951 8619 raft_consensus.cc:2749] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.452245 7802 raft_consensus.cc:2468] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:30.452701 7596 leader_election.cc:304] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:30.453280 8054 tablet_bootstrap.cc:492] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.455523 8557 raft_consensus.cc:2804] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.456498 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359ab1033ccf4445862867f3f8b78ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.458182 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 4939dab5a4d54a08a75424bcaabbb8dd (table default.Table_08e74268c74d44938d75f8cdbfb18948 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
W20260505 20:13:30.458490 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 already in progress: creating tablet
W20260505 20:13:30.458729 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f0ca8cc557674992b88f3379cc1db652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0ca8cc557674992b88f3379cc1db652 already in progress: creating tablet
W20260505 20:13:30.458947 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 608bffbbc10141e8bd19f475b95bdc65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 608bffbbc10141e8bd19f475b95bdc65 already in progress: creating tablet
W20260505 20:13:30.459148 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f5dfabb36fa5499780b0d15c71404307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5dfabb36fa5499780b0d15c71404307 already in progress: creating tablet
W20260505 20:13:30.459417 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet ee19f65120184eca9495513b68440b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee19f65120184eca9495513b68440b4f already in progress: creating tablet
I20260505 20:13:30.459805 8050 tablet_replica.cc:333] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:30.460115 8050 raft_consensus.cc:2243] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.461313 8050 raft_consensus.cc:2272] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.461448 8639 leader_election.cc:290] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.461897 8054 tablet_bootstrap.cc:654] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.463769 8050 ts_tablet_manager.cc:1916] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.474128 8054 tablet_bootstrap.cc:492] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.474538 8054 ts_tablet_manager.cc:1403] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.002s
I20260505 20:13:30.474720 8557 raft_consensus.cc:697] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:30.471297 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6acad22190b402d892d06ff97bd9476" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:30.475412 7869 leader_election.cc:343] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.475565 7869 leader_election.cc:304] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:30.475769 7869 raft_consensus.cc:2686] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:30.475090 8557 consensus_queue.cc:237] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.476212 8050 ts_tablet_manager.cc:1929] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.476333 8050 log.cc:1199] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c6acad22190b402d892d06ff97bd9476
I20260505 20:13:30.476758 8050 ts_tablet_manager.cc:1950] T c6acad22190b402d892d06ff97bd9476 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:30.476570 8054 raft_consensus.cc:359] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.479379 8058 tablet_bootstrap.cc:492] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.479579 8058 ts_tablet_manager.cc:1403] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.219s user 0.033s sys 0.056s
I20260505 20:13:30.480089 8054 raft_consensus.cc:385] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.480499 8058 raft_consensus.cc:359] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.481820 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 76178d1c329b4bf59fe3955f2893cd39 (DEFAULT_TABLE table=default.Table_2734568ba0294940a39a4c8768564f53 [id=8a90ca18bf294706a81e213ac3a7e450]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.482257 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76178d1c329b4bf59fe3955f2893cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.480216 8054 raft_consensus.cc:740] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.483743 8054 consensus_queue.cc:260] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.484309 8054 ts_tablet_manager.cc:1434] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260505 20:13:30.486838 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 359ab1033ccf4445862867f3f8b78ecd (DEFAULT_TABLE table=default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.487313 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359ab1033ccf4445862867f3f8b78ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.487440 8058 raft_consensus.cc:385] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.487620 8058 raft_consensus.cc:740] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.488585 8054 tablet_bootstrap.cc:492] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.488603 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 76178d1c329b4bf59fe3955f2893cd39 (DEFAULT_TABLE table=default.Table_2734568ba0294940a39a4c8768564f53 [id=8a90ca18bf294706a81e213ac3a7e450]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.490059 8052 ts_tablet_manager.cc:1929] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:30.490365 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76178d1c329b4bf59fe3955f2893cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.490398 8058 consensus_queue.cc:260] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.491693 8058 ts_tablet_manager.cc:1434] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260505 20:13:30.494772 8058 tablet_bootstrap.cc:492] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.495095 8054 tablet_bootstrap.cc:654] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.497831 8058 tablet_bootstrap.cc:654] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.504860 8054 tablet_bootstrap.cc:492] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.505048 8054 ts_tablet_manager.cc:1403] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260505 20:13:30.505930 8054 raft_consensus.cc:359] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.506127 8054 raft_consensus.cc:385] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.506209 8054 raft_consensus.cc:740] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.506456 8054 consensus_queue.cc:260] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.507112 8633 tablet.cc:1724] T 983ad31892394f67a7a9a727dc2bef1b P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:30.504235 8051 ts_tablet_manager.cc:1929] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.508657 8051 log.cc:1199] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e0f86a888c5e4fb3acbd78f68c81576f
I20260505 20:13:30.511287 8054 ts_tablet_manager.cc:1434] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:30.512413 8051 ts_tablet_manager.cc:1950] T e0f86a888c5e4fb3acbd78f68c81576f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:30.512440 8054 tablet_bootstrap.cc:492] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.515733 8052 log.cc:1199] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/d2841214f07b4ae6b8cd7e97493b69d6
I20260505 20:13:30.516430 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 415) took 1388 ms. Trace:
I20260505 20:13:30.516999 8054 tablet_bootstrap.cc:654] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.517166 8051 rpcz_store.cc:276] 0505 20:13:29.128091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.128148 (+ 57us) service_pool.cc:224] Handling call
0505 20:13:30.437861 (+1309713us) ts_tablet_manager.cc:1151] Deleting tablet e0f86a888c5e4fb3acbd78f68c81576f
0505 20:13:30.437874 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.467530 (+ 29656us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.504142 (+ 36612us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.516391 (+ 12249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241219}
I20260505 20:13:30.517885 8052 ts_tablet_manager.cc:1950] T d2841214f07b4ae6b8cd7e97493b69d6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:30.518373 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e0f86a888c5e4fb3acbd78f68c81576f (table default.Table_99c224cd93784af1a21c3c3260971518 [id=e0008576d3f44c03b0244b28e61ccdc8]) successfully deleted
I20260505 20:13:30.518944 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 429) took 1096 ms. Trace:
I20260505 20:13:30.519060 8058 tablet_bootstrap.cc:492] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.519014 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 378) took 2616 ms. Trace:
I20260505 20:13:30.519120 8051 rpcz_store.cc:276] 0505 20:13:29.422951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.423127 (+ 176us) service_pool.cc:224] Handling call
0505 20:13:30.518748 (+1095621us) ts_tablet_manager.cc:1151] Deleting tablet b8d50ceda0ff4bb6b49920c922dfee9e
0505 20:13:30.518759 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.518903 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1093781}
I20260505 20:13:30.519147 8052 rpcz_store.cc:276] 0505 20:13:27.901545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.901598 (+ 53us) service_pool.cc:224] Handling call
0505 20:13:30.251287 (+2349689us) ts_tablet_manager.cc:1151] Deleting tablet d2841214f07b4ae6b8cd7e97493b69d6
0505 20:13:30.251297 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.334885 (+ 83588us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.476172 (+141287us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.518295 (+ 42123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2349352}
I20260505 20:13:30.519724 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet d2841214f07b4ae6b8cd7e97493b69d6 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]) successfully deleted
I20260505 20:13:30.519318 8058 ts_tablet_manager.cc:1403] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.004s
W20260505 20:13:30.522554 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b8d50ceda0ff4bb6b49920c922dfee9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8d50ceda0ff4bb6b49920c922dfee9e already in progress: creating tablet
I20260505 20:13:30.522917 8051 tablet_replica.cc:333] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:30.523140 8051 raft_consensus.cc:2243] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.523291 8058 raft_consensus.cc:359] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.523500 8058 raft_consensus.cc:385] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.523567 8058 raft_consensus.cc:740] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.523808 8058 consensus_queue.cc:260] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.524312 8058 ts_tablet_manager.cc:1434] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:30.525337 8054 tablet_bootstrap.cc:492] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.525527 8054 ts_tablet_manager.cc:1403] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260505 20:13:30.526403 8054 raft_consensus.cc:359] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.526589 8054 raft_consensus.cc:385] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.526671 8054 raft_consensus.cc:740] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.527776 8058 tablet_bootstrap.cc:492] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.531032 8054 consensus_queue.cc:260] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.531589 8054 ts_tablet_manager.cc:1434] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:30.532414 8058 tablet_bootstrap.cc:654] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.534395 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 379) took 2618 ms. Trace:
I20260505 20:13:30.534835 8054 tablet_bootstrap.cc:492] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:30.542135 7737 consensus_peers.cc:597] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a026a8408ed9462b820b560a98dcabd1. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:30.542207 8054 tablet_bootstrap.cc:654] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.523311 8051 raft_consensus.cc:2272] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.543794 8051 ts_tablet_manager.cc:1916] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.550271 8639 raft_consensus.cc:493] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.550489 8639 raft_consensus.cc:515] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.551222 8639 leader_election.cc:290] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.552004 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:30.552654 7870 leader_election.cc:343] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.553845 8054 tablet_bootstrap.cc:492] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.554021 8054 ts_tablet_manager.cc:1403] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.003s
I20260505 20:13:30.554898 8054 raft_consensus.cc:359] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.555101 8054 raft_consensus.cc:385] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.555184 8054 raft_consensus.cc:740] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.557344 8054 consensus_queue.cc:260] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.559926 8054 ts_tablet_manager.cc:1434] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:30.560262 8054 tablet_bootstrap.cc:492] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.560192 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:30.560708 7869 leader_election.cc:343] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.560861 7869 leader_election.cc:304] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.561239 8639 raft_consensus.cc:2749] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.561693 8052 rpcz_store.cc:276] 0505 20:13:27.902189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.902237 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:30.520362 (+2618125us) ts_tablet_manager.cc:1151] Deleting tablet e69bdfc75a494635837178cb16c08c1c
0505 20:13:30.520376 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.520499 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2617924}
W20260505 20:13:30.562309 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e69bdfc75a494635837178cb16c08c1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e69bdfc75a494635837178cb16c08c1c already in progress: creating tablet
I20260505 20:13:30.562479 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 380) took 2659 ms. Trace:
I20260505 20:13:30.562695 8052 rpcz_store.cc:276] 0505 20:13:27.902603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.902648 (+ 45us) service_pool.cc:224] Handling call
0505 20:13:30.562271 (+2659623us) ts_tablet_manager.cc:1151] Deleting tablet 8f1505e592e543cca92d8949bdae007e
0505 20:13:30.562284 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.562426 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2659406}
W20260505 20:13:30.563187 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 8f1505e592e543cca92d8949bdae007e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f1505e592e543cca92d8949bdae007e already in progress: creating tablet
I20260505 20:13:30.563383 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 381) took 2660 ms. Trace:
I20260505 20:13:30.563572 8052 rpcz_store.cc:276] 0505 20:13:27.903016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.903081 (+ 65us) service_pool.cc:224] Handling call
0505 20:13:30.563187 (+2660106us) ts_tablet_manager.cc:1151] Deleting tablet d138d27f444f45d28acdc7d72a9649f5
0505 20:13:30.563201 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.563315 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2659852}
W20260505 20:13:30.564265 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet d138d27f444f45d28acdc7d72a9649f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d138d27f444f45d28acdc7d72a9649f5 already in progress: creating tablet
I20260505 20:13:30.564412 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 375) took 2663 ms. Trace:
I20260505 20:13:30.564548 8054 tablet_bootstrap.cc:654] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.564522 8052 rpcz_store.cc:276] 0505 20:13:27.901186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:27.905802 (+ 4616us) service_pool.cc:224] Handling call
0505 20:13:30.564267 (+2658465us) ts_tablet_manager.cc:1151] Deleting tablet 0d5ed062508b411eb0fa5a14637830ea
0505 20:13:30.564278 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.564360 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2658229}
I20260505 20:13:30.565021 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 382) took 2527 ms. Trace:
W20260505 20:13:30.566051 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 0d5ed062508b411eb0fa5a14637830ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d5ed062508b411eb0fa5a14637830ea already in progress: creating tablet
I20260505 20:13:30.568650 8058 tablet_bootstrap.cc:492] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.568811 8058 ts_tablet_manager.cc:1403] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.010s
I20260505 20:13:30.569669 8058 raft_consensus.cc:359] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.569878 8058 raft_consensus.cc:385] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.569964 8058 raft_consensus.cc:740] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.570226 8058 consensus_queue.cc:260] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.572851 8058 ts_tablet_manager.cc:1434] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:30.573213 8058 tablet_bootstrap.cc:492] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.575114 8058 tablet_bootstrap.cc:654] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.583321 8054 tablet_bootstrap.cc:492] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.583516 8054 ts_tablet_manager.cc:1403] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20260505 20:13:30.583993 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca1fb1425e347d191f3c5931d9bf224 (DEFAULT_TABLE table=default.Table_2036d69d672348c0b08335df0c49d801 [id=045845bc74254e53ba6f9ede9e6d4a0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.584455 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca1fb1425e347d191f3c5931d9bf224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.586311 8054 raft_consensus.cc:359] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.586534 8054 raft_consensus.cc:385] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.586634 8054 raft_consensus.cc:740] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.587658 8054 consensus_queue.cc:260] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.588275 8054 ts_tablet_manager.cc:1434] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:30.589483 8054 tablet_bootstrap.cc:492] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.593452 8054 tablet_bootstrap.cc:654] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.594722 7628 tablet_service.cc:1511] Processing CreateTablet for tablet 76178d1c329b4bf59fe3955f2893cd39 (DEFAULT_TABLE table=default.Table_2734568ba0294940a39a4c8768564f53 [id=8a90ca18bf294706a81e213ac3a7e450]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.595211 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76178d1c329b4bf59fe3955f2893cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.596540 8051 ts_tablet_manager.cc:1929] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.597462 8051 log.cc:1199] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/a026a8408ed9462b820b560a98dcabd1
W20260505 20:13:30.599246 7736 consensus_peers.cc:597] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:30.606314 8051 ts_tablet_manager.cc:1950] T a026a8408ed9462b820b560a98dcabd1 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:30.609586 8053 tablet_bootstrap.cc:492] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:30.609969 8053 ts_tablet_manager.cc:1403] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.286s user 0.008s sys 0.001s
I20260505 20:13:30.611228 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 426) took 1199 ms. Trace:
I20260505 20:13:30.611666 8053 raft_consensus.cc:359] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.611996 8053 raft_consensus.cc:385] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.612102 8053 raft_consensus.cc:740] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.613791 8053 consensus_queue.cc:260] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.614110 8051 rpcz_store.cc:276] 0505 20:13:29.411598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.412018 (+ 420us) service_pool.cc:224] Handling call
0505 20:13:30.522829 (+1110811us) ts_tablet_manager.cc:1151] Deleting tablet a026a8408ed9462b820b560a98dcabd1
0505 20:13:30.522840 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.570273 (+ 47433us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.596430 (+ 26157us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.611137 (+ 14707us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097368}
I20260505 20:13:30.614570 8053 ts_tablet_manager.cc:1434] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:30.615003 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet a026a8408ed9462b820b560a98dcabd1 (table default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]) successfully deleted
I20260505 20:13:30.615088 8053 tablet_bootstrap.cc:492] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:30.615254 8058 tablet_bootstrap.cc:492] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.615495 8058 ts_tablet_manager.cc:1403] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.011s
I20260505 20:13:30.617532 8639 raft_consensus.cc:493] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.617779 8639 raft_consensus.cc:515] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.618309 8058 raft_consensus.cc:359] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.618506 8058 raft_consensus.cc:385] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.618587 8058 raft_consensus.cc:740] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.618577 8639 leader_election.cc:290] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.618839 8058 consensus_queue.cc:260] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.619086 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ed062508b411eb0fa5a14637830ea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:30.619732 7870 leader_election.cc:343] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.620124 8058 ts_tablet_manager.cc:1434] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:30.620221 8051 tablet_replica.cc:333] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:30.620129 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca1fb1425e347d191f3c5931d9bf224 (DEFAULT_TABLE table=default.Table_2036d69d672348c0b08335df0c49d801 [id=045845bc74254e53ba6f9ede9e6d4a0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.621243 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 59f5348c229744ab98f0de3da40de6c5 (DEFAULT_TABLE table=default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.621479 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 59f5348c229744ab98f0de3da40de6c5 (DEFAULT_TABLE table=default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.622017 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f5348c229744ab98f0de3da40de6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.622644 8058 tablet_bootstrap.cc:492] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.623569 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca1fb1425e347d191f3c5931d9bf224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.624464 8058 tablet_bootstrap.cc:654] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.625597 8051 raft_consensus.cc:2243] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.625849 8051 raft_consensus.cc:2272] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.626116 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f5348c229744ab98f0de3da40de6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.626425 8051 ts_tablet_manager.cc:1916] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.627628 7333 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_2734568ba0294940a39a4c8768564f53" } new_table_name: "default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3" modify_external_catalogs: true
I20260505 20:13:30.565155 8052 rpcz_store.cc:276] 0505 20:13:28.037916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.038096 (+ 180us) service_pool.cc:224] Handling call
0505 20:13:30.564877 (+2526781us) ts_tablet_manager.cc:1151] Deleting tablet c720fc66db36402a83a7690d70a40353
0505 20:13:30.564888 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.564970 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2526369}
I20260505 20:13:30.641649 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 59f5348c229744ab98f0de3da40de6c5 (DEFAULT_TABLE table=default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:30.642051 7326 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet c720fc66db36402a83a7690d70a40353 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c720fc66db36402a83a7690d70a40353 already in progress: creating tablet
I20260505 20:13:30.642288 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca1fb1425e347d191f3c5931d9bf224 (DEFAULT_TABLE table=default.Table_2036d69d672348c0b08335df0c49d801 [id=045845bc74254e53ba6f9ede9e6d4a0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:30.644133 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ed062508b411eb0fa5a14637830ea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:30.644940 7869 leader_election.cc:343] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.645159 7869 leader_election.cc:304] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.645819 8639 raft_consensus.cc:2749] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.646142 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca1fb1425e347d191f3c5931d9bf224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.647082 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f5348c229744ab98f0de3da40de6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:30.647331 8054 tablet_bootstrap.cc:492] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.647504 8054 ts_tablet_manager.cc:1403] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.058s user 0.016s sys 0.007s
I20260505 20:13:30.648391 8054 raft_consensus.cc:359] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.648618 8054 raft_consensus.cc:385] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.648710 8054 raft_consensus.cc:740] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.649374 8054 consensus_queue.cc:260] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.651361 8054 ts_tablet_manager.cc:1434] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:30.651723 8054 tablet_bootstrap.cc:492] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.652544 8051 ts_tablet_manager.cc:1929] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260505 20:13:30.653826 8054 tablet_bootstrap.cc:654] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.653709 8051 log.cc:1199] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/611bba6267194d058cd08a27cdd2af49
I20260505 20:13:30.654523 8051 ts_tablet_manager.cc:1950] T 611bba6267194d058cd08a27cdd2af49 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:30.655905 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 427) took 1241 ms. Trace:
I20260505 20:13:30.656958 8051 rpcz_store.cc:276] 0505 20:13:29.414214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.414310 (+ 96us) service_pool.cc:224] Handling call
0505 20:13:30.615358 (+1201048us) ts_tablet_manager.cc:1151] Deleting tablet 611bba6267194d058cd08a27cdd2af49
0505 20:13:30.615368 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.634699 (+ 19331us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.652441 (+ 17742us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.655862 (+ 3421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167072}
I20260505 20:13:30.658138 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 430) took 1198 ms. Trace:
I20260505 20:13:30.658149 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 611bba6267194d058cd08a27cdd2af49 (table default.Table_2cdd70905bf04e9da6c310c3df99d628 [id=25578717c43d40dfb1999130c1208d98]) successfully deleted
I20260505 20:13:30.658655 8051 rpcz_store.cc:276] 0505 20:13:29.459560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.459626 (+ 66us) service_pool.cc:224] Handling call
0505 20:13:30.657971 (+1198345us) ts_tablet_manager.cc:1151] Deleting tablet d3cd1b7b0456462a80d653dd442589a6
0505 20:13:30.657983 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.658101 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189167}
W20260505 20:13:30.659462 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet d3cd1b7b0456462a80d653dd442589a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3cd1b7b0456462a80d653dd442589a6 already in progress: creating tablet
I20260505 20:13:30.659868 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 432) took 1195 ms. Trace:
I20260505 20:13:30.660145 8051 rpcz_store.cc:276] 0505 20:13:29.464283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.464347 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:30.659460 (+1195113us) ts_tablet_manager.cc:1151] Deleting tablet 883ec65f15604346813e5f87d55802fc
0505 20:13:30.659470 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.659834 (+ 364us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190453}
I20260505 20:13:30.660926 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 431) took 1197 ms. Trace:
W20260505 20:13:30.661567 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 883ec65f15604346813e5f87d55802fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883ec65f15604346813e5f87d55802fc already in progress: creating tablet
I20260505 20:13:30.661861 8051 rpcz_store.cc:276] 0505 20:13:29.463209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.465799 (+ 2590us) service_pool.cc:224] Handling call
0505 20:13:30.660796 (+1194997us) ts_tablet_manager.cc:1151] Deleting tablet b393bfc209b6461aab958ebf49014d25
0505 20:13:30.660806 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.660892 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1191711}
I20260505 20:13:30.662086 8052 tablet_replica.cc:333] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:30.662428 8052 raft_consensus.cc:2243] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:30.662590 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b393bfc209b6461aab958ebf49014d25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b393bfc209b6461aab958ebf49014d25 already in progress: creating tablet
I20260505 20:13:30.662655 8052 raft_consensus.cc:2272] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.663462 8052 ts_tablet_manager.cc:1916] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.663648 8051 tablet_replica.cc:333] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:30.663995 8051 raft_consensus.cc:2243] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.664438 8051 raft_consensus.cc:2272] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.664561 8054 tablet_bootstrap.cc:492] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:30.664744 8054 ts_tablet_manager.cc:1403] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.009s
I20260505 20:13:30.665364 8051 ts_tablet_manager.cc:1916] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.665757 8054 raft_consensus.cc:359] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:30.666003 8054 raft_consensus.cc:385] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.666112 8054 raft_consensus.cc:740] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.666386 8054 consensus_queue.cc:260] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:30.666970 8054 ts_tablet_manager.cc:1434] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:30.667327 8054 tablet_bootstrap.cc:492] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:30.672331 8054 tablet_bootstrap.cc:654] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.674400 8058 tablet_bootstrap.cc:492] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.674628 8058 ts_tablet_manager.cc:1403] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.006s
I20260505 20:13:30.675486 8058 raft_consensus.cc:359] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.675748 8058 raft_consensus.cc:385] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.675879 8058 raft_consensus.cc:740] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.676147 8058 consensus_queue.cc:260] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.678277 8058 ts_tablet_manager.cc:1434] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:30.678627 8058 tablet_bootstrap.cc:492] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.677652 7758 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 115) took 1306 ms. Trace:
I20260505 20:13:30.680473 8058 tablet_bootstrap.cc:654] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.680619 7758 rpcz_store.cc:276] 0505 20:13:29.370633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.370743 (+ 110us) service_pool.cc:224] Handling call
0505 20:13:29.720299 (+349556us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x6160001f4930. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf165efc3 00007fdbf418bcb8 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.045178 (+324879us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x6160000e1454. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.176562 (+131384us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x616000220354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.365918 (+189356us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x6160001c0354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.407791 (+ 41873us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x616000220954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.671263 (+263472us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x6160001f0954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.677473 (+ 6210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670624256}
I20260505 20:13:30.689927 8605 raft_consensus.cc:493] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.692417 8051 ts_tablet_manager.cc:1929] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:30.693430 8051 log.cc:1199] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:30.694134 8051 ts_tablet_manager.cc:1950] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:30.695494 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 433) took 1184 ms. Trace:
I20260505 20:13:30.696548 8051 rpcz_store.cc:276] 0505 20:13:29.511342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.511714 (+ 372us) service_pool.cc:224] Handling call
0505 20:13:30.662645 (+1150931us) ts_tablet_manager.cc:1151] Deleting tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb
0505 20:13:30.662654 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.671528 (+ 8874us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.692314 (+ 20786us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:30.695433 (+ 3119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1144201}
I20260505 20:13:30.697400 7327 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb (table default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 [id=e51e3514b22840c391a0e2f929547557]) successfully deleted
I20260505 20:13:30.698396 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 434) took 1040 ms. Trace:
I20260505 20:13:30.699036 8051 rpcz_store.cc:276] 0505 20:13:29.657989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.658045 (+ 56us) service_pool.cc:224] Handling call
0505 20:13:30.697828 (+1039783us) ts_tablet_manager.cc:1151] Deleting tablet bde33085759f4fd8a130d80878d1e564
0505 20:13:30.697843 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.698340 (+ 497us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1039582}
W20260505 20:13:30.699679 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet bde33085759f4fd8a130d80878d1e564 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bde33085759f4fd8a130d80878d1e564 already in progress: creating tablet
I20260505 20:13:30.700278 7761 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 112) took 1403 ms. Trace:
I20260505 20:13:30.700436 7761 rpcz_store.cc:276] 0505 20:13:29.297225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.297302 (+ 77us) service_pool.cc:224] Handling call
0505 20:13:30.044707 (+747405us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x6160000e1454. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.109479 (+ 64772us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x61800004448c. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf186452e 00007fdbf165f25c 00007fdbf418bcb8 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8
0505 20:13:30.179591 (+ 70112us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x616000220354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.365224 (+185633us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x6160001c0354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.407710 (+ 42486us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x616000220954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.697472 (+289762us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x6160001f0954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.700229 (+ 2757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822034944}
I20260505 20:13:30.700847 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 435) took 1017 ms. Trace:
I20260505 20:13:30.701061 8051 rpcz_store.cc:276] 0505 20:13:29.683397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.683465 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:30.700191 (+1016726us) ts_tablet_manager.cc:1151] Deleting tablet b6895af5f55b4bc183065626417090a4
0505 20:13:30.700202 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.700317 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016460}
W20260505 20:13:30.701774 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b6895af5f55b4bc183065626417090a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6895af5f55b4bc183065626417090a4 already in progress: creating tablet
I20260505 20:13:30.702265 8051 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33030 (request call id 436) took 1015 ms. Trace:
I20260505 20:13:30.702702 8051 rpcz_store.cc:276] 0505 20:13:29.687199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.687267 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:30.702116 (+1014849us) ts_tablet_manager.cc:1151] Deleting tablet e2554ecdcfd64ca6ba75e6b4077a5ab3
0505 20:13:30.702126 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.702214 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014607}
W20260505 20:13:30.703382 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 already in progress: creating tablet
W20260505 20:13:30.704118 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 944eaa335fcf49be975baee21c715642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944eaa335fcf49be975baee21c715642 already in progress: creating tablet
W20260505 20:13:30.710404 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f0ca8cc557674992b88f3379cc1db652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0ca8cc557674992b88f3379cc1db652 already in progress: creating tablet
I20260505 20:13:30.710650 7762 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 113) took 1411 ms. Trace:
W20260505 20:13:30.711203 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 already in progress: creating tablet
I20260505 20:13:30.711203 7762 rpcz_store.cc:276] 0505 20:13:29.299503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.299570 (+ 67us) service_pool.cc:224] Handling call
0505 20:13:29.706741 (+407171us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x6160000f7730. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf165efc3 00007fdbf418bcb8 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.044860 (+338119us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x6160000e1454. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.178149 (+133289us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x616000220354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.364131 (+185982us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x6160001c0354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.407567 (+ 43436us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x616000220954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.674240 (+266673us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x6160001f0954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.710570 (+ 36330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730788736}
W20260505 20:13:30.711807 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 608bffbbc10141e8bd19f475b95bdc65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 608bffbbc10141e8bd19f475b95bdc65 already in progress: creating tablet
W20260505 20:13:30.712385 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f5dfabb36fa5499780b0d15c71404307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5dfabb36fa5499780b0d15c71404307 already in progress: creating tablet
W20260505 20:13:30.712962 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet ee19f65120184eca9495513b68440b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee19f65120184eca9495513b68440b4f already in progress: creating tablet
I20260505 20:13:30.714653 8058 tablet_bootstrap.cc:492] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.700575 7760 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 114) took 1356 ms. Trace:
I20260505 20:13:30.714844 8058 ts_tablet_manager.cc:1403] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.004s
I20260505 20:13:30.714874 7760 rpcz_store.cc:276] 0505 20:13:29.344196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.344290 (+ 94us) service_pool.cc:224] Handling call
0505 20:13:29.647360 (+303070us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x6160000f7730. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf165efc3 00007fdbf418bcb8 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.045046 (+397686us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x6160000e1454. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.180938 (+135892us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x616000220354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.361715 (+180777us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x6160001c0354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.401015 (+ 39300us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x616000220954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.697908 (+296893us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x6160001f0954. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:30.700524 (+ 2616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824483456}
I20260505 20:13:30.715713 8058 raft_consensus.cc:359] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.715919 8058 raft_consensus.cc:385] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.715987 8058 raft_consensus.cc:740] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.716234 8058 consensus_queue.cc:260] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.716734 8058 ts_tablet_manager.cc:1434] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:30.717065 8058 tablet_bootstrap.cc:492] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.720247 8058 tablet_bootstrap.cc:654] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.722615 8605 raft_consensus.cc:515] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.724169 8639 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.724388 8639 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.725922 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:30.726482 7870 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.727461 8639 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.727579 8058 tablet_bootstrap.cc:492] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.727743 8058 ts_tablet_manager.cc:1403] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260505 20:13:30.728188 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.728545 8058 raft_consensus.cc:359] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.728780 8058 raft_consensus.cc:385] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.728881 8058 raft_consensus.cc:740] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.729110 8058 consensus_queue.cc:260] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.730208 7869 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.730444 7869 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.731307 8639 raft_consensus.cc:2749] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.732405 8058 ts_tablet_manager.cc:1434] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260505 20:13:30.732762 8058 tablet_bootstrap.cc:492] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.734994 8058 tablet_bootstrap.cc:654] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.740886 8639 raft_consensus.cc:493] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.741111 8639 raft_consensus.cc:515] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.741873 8639 leader_election.cc:290] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.742492 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea726cff03664c3d81b5e541ef738d4a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:30.743072 7870 leader_election.cc:343] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.744335 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea726cff03664c3d81b5e541ef738d4a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:30.744956 7869 leader_election.cc:343] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.745167 7869 leader_election.cc:304] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.745859 8639 raft_consensus.cc:2749] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.749102 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034852d91c26434f8a3c7fd8100c49ac" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.749393 7661 raft_consensus.cc:2468] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:30.750222 7736 leader_election.cc:304] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.750641 8058 tablet_bootstrap.cc:492] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.750835 8058 ts_tablet_manager.cc:1403] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.000s
I20260505 20:13:30.750869 8616 raft_consensus.cc:2804] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.751029 8616 raft_consensus.cc:493] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.751170 8616 raft_consensus.cc:3060] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.751704 8058 raft_consensus.cc:359] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.751888 8058 raft_consensus.cc:385] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.751951 8058 raft_consensus.cc:740] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.752228 8058 consensus_queue.cc:260] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.755571 8616 raft_consensus.cc:515] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.756003 8058 ts_tablet_manager.cc:1434] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:30.756376 8058 tablet_bootstrap.cc:492] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.757377 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034852d91c26434f8a3c7fd8100c49ac" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.757665 7661 raft_consensus.cc:3060] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.758556 8058 tablet_bootstrap.cc:654] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.762250 8616 leader_election.cc:290] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.763309 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034852d91c26434f8a3c7fd8100c49ac" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:30.763612 7936 raft_consensus.cc:3060] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.766569 8058 tablet_bootstrap.cc:492] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.766752 8058 ts_tablet_manager.cc:1403] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260505 20:13:30.767647 8058 raft_consensus.cc:359] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.767817 8058 raft_consensus.cc:385] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.767900 8058 raft_consensus.cc:740] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.768052 7936 raft_consensus.cc:2468] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:30.768148 8058 consensus_queue.cc:260] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.770123 8058 ts_tablet_manager.cc:1434] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:30.770442 8058 tablet_bootstrap.cc:492] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.761696 7661 raft_consensus.cc:2468] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:30.772253 8058 tablet_bootstrap.cc:654] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.771272 7737 leader_election.cc:304] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:30.773304 8616 raft_consensus.cc:2804] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.773802 8616 raft_consensus.cc:697] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:30.774200 8616 consensus_queue.cc:237] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.778997 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034852d91c26434f8a3c7fd8100c49ac" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:30.779336 7936 raft_consensus.cc:2376] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1. Re-sending same reply.
I20260505 20:13:30.780237 8605 leader_election.cc:290] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.783106 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c6acad22190b402d892d06ff97bd9476 (table default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]) successfully deleted
I20260505 20:13:30.783592 8050 tablet_replica.cc:333] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:30.783983 8050 raft_consensus.cc:2243] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:30.784291 8050 raft_consensus.cc:2272] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:30.785420 7342 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f32414ac94684234ab3a25f46213b70b" } modify_external_catalogs: true
I20260505 20:13:30.785703 7342 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_f32414ac94684234ab3a25f46213b70b" } modify_external_catalogs: true
I20260505 20:13:30.791010 8058 tablet_bootstrap.cc:492] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.791183 8058 ts_tablet_manager.cc:1403] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.009s
I20260505 20:13:30.792006 8058 raft_consensus.cc:359] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.792219 8058 raft_consensus.cc:385] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.792289 8058 raft_consensus.cc:740] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.793553 8490 raft_consensus.cc:493] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.793828 8490 raft_consensus.cc:515] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.794715 8490 leader_election.cc:290] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:30.797161 7736 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:30.797951 8490 consensus_queue.cc:1048] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:30.799392 7737 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:30.799566 7737 leader_election.cc:304] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.800094 8490 raft_consensus.cc:2749] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.800302 8058 consensus_queue.cc:260] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.803880 8058 ts_tablet_manager.cc:1434] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260505 20:13:30.804257 8058 tablet_bootstrap.cc:492] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.806151 8058 tablet_bootstrap.cc:654] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.806598 8053 tablet_bootstrap.cc:654] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.827253 8058 tablet_bootstrap.cc:492] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.827427 8058 ts_tablet_manager.cc:1403] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.008s
I20260505 20:13:30.828239 8058 raft_consensus.cc:359] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.828429 8058 raft_consensus.cc:385] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.828529 8058 raft_consensus.cc:740] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.830148 8641 raft_consensus.cc:493] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.830283 8641 raft_consensus.cc:515] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.831068 8641 leader_election.cc:290] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.831509 8058 consensus_queue.cc:260] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.832651 7598 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
W20260505 20:13:30.833159 7596 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:30.833323 7596 leader_election.cc:304] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.833863 8641 raft_consensus.cc:2749] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.837257 8058 ts_tablet_manager.cc:1434] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260505 20:13:30.841466 8058 tablet_bootstrap.cc:492] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.843391 8058 tablet_bootstrap.cc:654] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.859653 8058 tablet_bootstrap.cc:492] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.859871 8641 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.860035 8058 ts_tablet_manager.cc:1403] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.006s
I20260505 20:13:30.860056 8641 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.860865 8641 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.861173 8058 raft_consensus.cc:359] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.861418 8058 raft_consensus.cc:385] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.861496 8058 raft_consensus.cc:740] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.861766 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.861771 8058 consensus_queue.cc:260] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.862347 8058 ts_tablet_manager.cc:1434] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260505 20:13:30.862524 7596 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.862751 8058 tablet_bootstrap.cc:492] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.865639 8058 tablet_bootstrap.cc:654] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.870764 7303 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskf21k8s/build/asan/bin/kudu pid 7311
I20260505 20:13:30.879050 7336 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d6c96dbb361b457684823113cd6727ea" } modify_external_catalogs: true
I20260505 20:13:30.879341 7336 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_d6c96dbb361b457684823113cd6727ea" } modify_external_catalogs: true
I20260505 20:13:30.883025 8058 tablet_bootstrap.cc:492] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.883183 8058 ts_tablet_manager.cc:1403] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.005s
I20260505 20:13:30.883801 7338 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet e32ff17c39f04bc2b1c9c37a1165399b
I20260505 20:13:30.883951 8058 raft_consensus.cc:359] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.884117 8058 raft_consensus.cc:385] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.884189 8058 raft_consensus.cc:740] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.884392 8058 consensus_queue.cc:260] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.884908 8058 ts_tablet_manager.cc:1434] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:30.885223 8058 tablet_bootstrap.cc:492] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.885910 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.887110 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:30.888075 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e32ff17c39f04bc2b1c9c37a1165399b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32ff17c39f04bc2b1c9c37a1165399b already in progress: creating tablet
I20260505 20:13:30.889287 8058 tablet_bootstrap.cc:654] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.811650 8639 raft_consensus.cc:493] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.901979 8639 raft_consensus.cc:515] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.902487 8050 ts_tablet_manager.cc:1916] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:30.902747 8639 leader_election.cc:290] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.902937 8639 raft_consensus.cc:493] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.903069 8639 raft_consensus.cc:515] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.903684 8639 leader_election.cc:290] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.845417 8619 raft_consensus.cc:493] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.903896 8619 raft_consensus.cc:515] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.904446 8619 leader_election.cc:290] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.861934 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:30.905194 7936 raft_consensus.cc:2468] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:30.879805 8447 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.905462 8447 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.906030 8447 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.906149 7338 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_6d292d45d5d24556b062b5b0fd05a0b1" } new_table_name: "default.Table_d230cae490dd484187dccd1014a710f5" modify_external_catalogs: true
I20260505 20:13:30.907083 8053 tablet_bootstrap.cc:492] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:30.907271 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1e6d72c57e42f09432a30295c47f1f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.907765 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed44127b4c848bf9ed4a49ad8b106fb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.908146 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3679480e55444d0d935f262217e44485" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.908530 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.910068 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1e6d72c57e42f09432a30295c47f1f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.910562 8058 tablet_bootstrap.cc:492] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.910722 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3679480e55444d0d935f262217e44485" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.910771 8058 ts_tablet_manager.cc:1403] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260505 20:13:30.910972 7663 raft_consensus.cc:2468] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:30.911320 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.911490 7664 raft_consensus.cc:2468] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:30.910573 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed44127b4c848bf9ed4a49ad8b106fb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:30.911731 8058 raft_consensus.cc:359] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.911923 8058 raft_consensus.cc:385] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.911993 8058 raft_consensus.cc:740] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.912223 8058 consensus_queue.cc:260] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.912655 7869 leader_election.cc:343] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.912760 8058 ts_tablet_manager.cc:1434] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:30.907269 8053 ts_tablet_manager.cc:1403] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.292s user 0.003s sys 0.001s
W20260505 20:13:30.912896 7869 leader_election.cc:343] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.913062 8058 tablet_bootstrap.cc:492] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:30.913069 7869 leader_election.cc:343] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:30.913246 7869 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.913419 7662 raft_consensus.cc:2468] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:30.913908 8053 raft_consensus.cc:359] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.914103 8053 raft_consensus.cc:385] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.914196 8053 raft_consensus.cc:740] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:30.914330 7870 leader_election.cc:343] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.914445 7870 leader_election.cc:304] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:30.914474 8053 consensus_queue.cc:260] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.914749 8058 tablet_bootstrap.cc:654] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.914851 7870 leader_election.cc:304] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.915203 7870 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.915501 7337 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet feef367085954816b312d4f1cdd80b1d
I20260505 20:13:30.915534 7870 leader_election.cc:304] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.915939 8447 raft_consensus.cc:2749] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:30.916141 8447 raft_consensus.cc:2804] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.916222 8447 raft_consensus.cc:493] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.916311 8447 raft_consensus.cc:3060] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.917989 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:33030
W20260505 20:13:30.918653 7327 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet feef367085954816b312d4f1cdd80b1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet feef367085954816b312d4f1cdd80b1d already in progress: creating tablet
I20260505 20:13:30.919049 8447 raft_consensus.cc:515] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:30.919179 7736 consensus_peers.cc:597] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 611bba6267194d058cd08a27cdd2af49. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:30.919493 8619 raft_consensus.cc:2804] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.919601 8619 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.919695 8619 raft_consensus.cc:3060] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.920636 8053 ts_tablet_manager.cc:1434] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260505 20:13:30.922305 8447 leader_election.cc:290] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.922991 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3679480e55444d0d935f262217e44485" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:30.923507 8447 raft_consensus.cc:2804] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260505 20:13:30.923556 7869 leader_election.cc:343] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.923703 8447 raft_consensus.cc:493] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.923802 8447 raft_consensus.cc:3060] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.926472 8619 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.926828 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3679480e55444d0d935f262217e44485" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.927102 7662 raft_consensus.cc:3060] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.927165 8619 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.927587 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:30.927847 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.928017 7664 raft_consensus.cc:3060] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.929057 8447 raft_consensus.cc:515] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.929817 8447 leader_election.cc:290] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:30.931481 7664 raft_consensus.cc:2468] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:30.933176 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed44127b4c848bf9ed4a49ad8b106fb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:30.933421 7869 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.934581 7870 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:30.935881 7869 leader_election.cc:343] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:30.936430 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed44127b4c848bf9ed4a49ad8b106fb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:30.936645 7664 raft_consensus.cc:3060] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.939741 7664 raft_consensus.cc:2468] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:30.940186 7870 leader_election.cc:304] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.940656 8619 raft_consensus.cc:2804] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.940806 8619 raft_consensus.cc:697] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:30.940892 8639 raft_consensus.cc:2804] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.941047 8639 raft_consensus.cc:697] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:30.941112 8619 consensus_queue.cc:237] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.941327 8639 consensus_queue.cc:237] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.943913 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:42664
I20260505 20:13:30.944329 7662 raft_consensus.cc:2468] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:30.945000 7870 leader_election.cc:304] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:30.950157 8619 raft_consensus.cc:2804] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.950501 8641 raft_consensus.cc:493] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:30.950709 8641 raft_consensus.cc:515] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.951512 8641 leader_election.cc:290] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.952179 8619 raft_consensus.cc:697] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:30.952601 8619 consensus_queue.cc:237] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.953244 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596f03adbea413b813c9037d4243fae" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:30.957170 7799 raft_consensus.cc:2468] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:30.957896 7596 leader_election.cc:304] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.958408 8641 raft_consensus.cc:2804] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:30.958534 8641 raft_consensus.cc:493] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:30.958676 8641 raft_consensus.cc:3060] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.967250 7337 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_4dda980af4a44fb3b08d9845bc9a4c2f" } new_table_name: "default.Table_e668fd82eb274b2fb39e758534ec447c" modify_external_catalogs: true
I20260505 20:13:30.974334 8490 consensus_queue.cc:1048] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:30.974717 7335 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab52fb4e7c73420fa58cb6da23372adc consensus state has no leader
I20260505 20:13:30.978349 8058 tablet_bootstrap.cc:492] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:30.978542 8058 ts_tablet_manager.cc:1403] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.066s user 0.006s sys 0.007s
I20260505 20:13:30.979429 8058 raft_consensus.cc:359] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.979629 8058 raft_consensus.cc:385] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:30.979714 8058 raft_consensus.cc:740] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:30.979928 8058 consensus_queue.cc:260] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.980408 8058 ts_tablet_manager.cc:1434] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:30.980736 8058 tablet_bootstrap.cc:492] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:30.981073 8053 tablet_bootstrap.cc:492] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:30.982617 8058 tablet_bootstrap.cc:654] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:30.986515 8641 raft_consensus.cc:515] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:30.987196 8641 leader_election.cc:290] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:30.987876 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596f03adbea413b813c9037d4243fae" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:30.988070 7799 raft_consensus.cc:3060] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:30.991089 7799 raft_consensus.cc:2468] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:30.991606 7596 leader_election.cc:304] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:30.991915 8641 raft_consensus.cc:2804] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:30.992072 8641 raft_consensus.cc:697] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:30.992338 8641 consensus_queue.cc:237] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.010538 8058 tablet_bootstrap.cc:492] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.010746 8058 ts_tablet_manager.cc:1403] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.002s
I20260505 20:13:31.011619 8058 raft_consensus.cc:359] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.011834 8058 raft_consensus.cc:385] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.011904 8058 raft_consensus.cc:740] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.012177 8058 consensus_queue.cc:260] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.014508 7335 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58274:
table { table_name: "default.Table_53010b8cbf5e426590b4f82d68e96660" } new_table_name: "default.Table_ea0f05ec98db400598340a9825b698ff" modify_external_catalogs: true
I20260505 20:13:31.016439 8053 tablet_bootstrap.cc:654] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.021027 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:31.021560 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:31.022043 7598 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.022377 8641 raft_consensus.cc:2804] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.022442 8058 ts_tablet_manager.cc:1434] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:31.022485 8641 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.022720 8641 raft_consensus.cc:3060] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.022840 8058 tablet_bootstrap.cc:492] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:31.024667 7598 leader_election.cc:343] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b596f03adbea413b813c9037d4243fae
I20260505 20:13:31.024760 8058 tablet_bootstrap.cc:654] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.025698 8639 raft_consensus.cc:493] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.025940 8639 raft_consensus.cc:515] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.026640 8639 leader_election.cc:290] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.029686 7340 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 5dcd25ecd87b40bdb4c7b9f62d943be1
I20260505 20:13:31.032243 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.032644 7598 leader_election.cc:343] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b596f03adbea413b813c9037d4243fae
W20260505 20:13:31.033034 7869 leader_election.cc:343] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.035228 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.035547 7662 raft_consensus.cc:2468] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.036481 7870 leader_election.cc:304] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.037058 8639 raft_consensus.cc:2804] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.037185 8639 raft_consensus.cc:493] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.037300 8639 raft_consensus.cc:3060] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.041152 7340 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_e4b497841d1c48fc87bbb37cd4e68890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:31.041914 7340 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4b497841d1c48fc87bbb37cd4e68890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:31.044205 8058 tablet_bootstrap.cc:492] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.044703 8058 ts_tablet_manager.cc:1403] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.002s
I20260505 20:13:31.045485 8054 tablet_bootstrap.cc:492] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.045684 8054 ts_tablet_manager.cc:1403] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.378s user 0.059s sys 0.119s
I20260505 20:13:31.045611 8058 raft_consensus.cc:359] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.045848 8058 raft_consensus.cc:385] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.045945 8058 raft_consensus.cc:740] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.046211 8058 consensus_queue.cc:260] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.046797 8058 ts_tablet_manager.cc:1434] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:31.046804 8054 raft_consensus.cc:359] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.046983 8054 raft_consensus.cc:385] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.047060 8054 raft_consensus.cc:740] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.047129 8058 tablet_bootstrap.cc:492] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.047354 8054 consensus_queue.cc:260] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.047996 8054 ts_tablet_manager.cc:1434] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:31.048346 8054 tablet_bootstrap.cc:492] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.050603 8054 tablet_bootstrap.cc:654] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.051096 8058 tablet_bootstrap.cc:654] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.071637 8641 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.072391 8641 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.072769 8639 raft_consensus.cc:515] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.073426 8639 leader_election.cc:290] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.075786 7341 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:31.076521 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.076735 7935 raft_consensus.cc:3060] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.077103 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.077297 7664 raft_consensus.cc:3060] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.079661 7935 raft_consensus.cc:2468] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.080399 7664 raft_consensus.cc:2468] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.080578 7598 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.080917 8050 ts_tablet_manager.cc:1929] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:31.081143 8050 log.cc:1199] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:31.081204 8641 raft_consensus.cc:2804] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.081352 8641 raft_consensus.cc:697] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.081733 8050 ts_tablet_manager.cc:1950] T a4a42f0b6dc74cbd8d72ae36410f9d35 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:31.081691 8641 consensus_queue.cc:237] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.082765 8050 tablet_replica.cc:333] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:31.082996 8050 raft_consensus.cc:2243] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:31.083184 8050 raft_consensus.cc:2272] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.083797 8050 ts_tablet_manager.cc:1916] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.083803 7870 leader_election.cc:304] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.084043 8557 raft_consensus.cc:493] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.084228 8557 raft_consensus.cc:515] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.084332 8639 raft_consensus.cc:2804] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.084479 8639 raft_consensus.cc:697] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.084919 8557 leader_election.cc:290] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.084846 8639 consensus_queue.cc:237] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.090209 7339 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:31.091012 7339 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:31.092553 7334 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58274:
name: "default.Table_45bd1808371b4519abd37364b534e889"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:31.093166 7334 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45bd1808371b4519abd37364b534e889 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:31.098083 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet a4a42f0b6dc74cbd8d72ae36410f9d35 (table default.Table_8b4013ec119f4c35aef190778e2fa5c6 [id=8ac7668d8df2475098e86492dd431fb2]) successfully deleted
I20260505 20:13:31.100714 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c1f63c849c48438abdaa965ab051f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47490
W20260505 20:13:31.101239 7598 leader_election.cc:343] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 2c12a95b0ed445c7b598db136f6ac05c
W20260505 20:13:31.102089 7333 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76178d1c329b4bf59fe3955f2893cd39 consensus state has no leader
I20260505 20:13:31.106498 8557 raft_consensus.cc:493] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.106725 8557 raft_consensus.cc:515] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.107460 8557 leader_election.cc:290] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.108319 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1e6d72c57e42f09432a30295c47f1f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.108589 7935 raft_consensus.cc:2468] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.109668 7598 leader_election.cc:304] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.110199 8557 raft_consensus.cc:2804] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.110291 8557 raft_consensus.cc:493] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.110378 8557 raft_consensus.cc:3060] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.113246 8557 raft_consensus.cc:515] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.114554 8557 leader_election.cc:290] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.115192 8054 tablet_bootstrap.cc:492] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.115278 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1e6d72c57e42f09432a30295c47f1f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.115612 8054 ts_tablet_manager.cc:1403] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.067s user 0.006s sys 0.001s
I20260505 20:13:31.115620 7935 raft_consensus.cc:3060] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.116597 8054 raft_consensus.cc:359] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.116806 8054 raft_consensus.cc:385] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.116904 8054 raft_consensus.cc:740] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.117195 8054 consensus_queue.cc:260] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.117941 8054 ts_tablet_manager.cc:1434] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:31.118309 8054 tablet_bootstrap.cc:492] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.119884 7935 raft_consensus.cc:2468] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.120302 8054 tablet_bootstrap.cc:654] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.120509 7598 leader_election.cc:304] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.120942 8557 raft_consensus.cc:2804] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.123782 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.124809 7869 leader_election.cc:343] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.128832 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1e6d72c57e42f09432a30295c47f1f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.132009 8052 ts_tablet_manager.cc:1929] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:31.132556 7596 leader_election.cc:343] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.132541 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c12a95b0ed445c7b598db136f6ac05c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.132859 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1e6d72c57e42f09432a30295c47f1f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.133103 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.133339 8052 log.cc:1199] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/923ed274fe454cc4a625516769e6b5f3
W20260505 20:13:31.133710 7596 leader_election.cc:343] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.133919 7596 leader_election.cc:304] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.134162 8052 ts_tablet_manager.cc:1950] T 923ed274fe454cc4a625516769e6b5f3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.134466 8053 tablet_bootstrap.cc:492] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:31.135432 7596 leader_election.cc:343] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:31.135820 7596 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.137367 8641 raft_consensus.cc:2749] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.138057 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 383) took 3099 ms. Trace:
I20260505 20:13:31.141575 7372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260505 20:13:31.119926 8050 ts_tablet_manager.cc:1929] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:31.150414 8050 log.cc:1199] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/22a98da176254eeb896c680fbcb98caa
I20260505 20:13:31.151146 8050 ts_tablet_manager.cc:1950] T 22a98da176254eeb896c680fbcb98caa P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:31.153414 8050 tablet_replica.cc:333] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:31.155162 7328 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 22a98da176254eeb896c680fbcb98caa (table default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]) successfully deleted
I20260505 20:13:31.154872 8054 tablet_bootstrap.cc:492] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.162261 8052 rpcz_store.cc:276] 0505 20:13:28.038034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.038194 (+ 160us) service_pool.cc:224] Handling call
0505 20:13:30.640602 (+2602408us) ts_tablet_manager.cc:1151] Deleting tablet 923ed274fe454cc4a625516769e6b5f3
0505 20:13:30.640617 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:30.821566 (+180949us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.075816 (+254250us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.137111 (+ 61295us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2601923}
I20260505 20:13:31.162482 8054 ts_tablet_manager.cc:1403] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260505 20:13:31.162864 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 384) took 3122 ms. Trace:
I20260505 20:13:31.162964 8668 raft_consensus.cc:493] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.163007 8052 rpcz_store.cc:276] 0505 20:13:28.040267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.040413 (+ 146us) service_pool.cc:224] Handling call
0505 20:13:31.162654 (+3122241us) ts_tablet_manager.cc:1151] Deleting tablet 8e650b297603425184ad97ddf99ec36d
0505 20:13:31.162668 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.162824 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3121634}
I20260505 20:13:31.163129 8668 raft_consensus.cc:515] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.163414 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 385) took 3123 ms. Trace:
I20260505 20:13:31.163542 8052 rpcz_store.cc:276] 0505 20:13:28.040413 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.040494 (+ 81us) service_pool.cc:224] Handling call
0505 20:13:31.163275 (+3122781us) ts_tablet_manager.cc:1151] Deleting tablet 7214ab77d7904f0e9d37cb8d7a5a53a4
0505 20:13:31.163286 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.163383 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3121863}
I20260505 20:13:31.163892 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 390) took 3077 ms. Trace:
I20260505 20:13:31.163997 8052 rpcz_store.cc:276] 0505 20:13:28.085988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.086272 (+ 284us) service_pool.cc:224] Handling call
0505 20:13:31.163777 (+3077505us) ts_tablet_manager.cc:1151] Deleting tablet b6ed7c0220d147c7853c7afc1ef09607
0505 20:13:31.163785 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.163854 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3077274}
I20260505 20:13:31.164909 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 391) took 3078 ms. Trace:
I20260505 20:13:31.164908 8668 leader_election.cc:290] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.165011 8052 rpcz_store.cc:276] 0505 20:13:28.086127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.086535 (+ 408us) service_pool.cc:224] Handling call
0505 20:13:31.164774 (+3078239us) ts_tablet_manager.cc:1151] Deleting tablet 54becbd4690c403e803a7a79f12cb6d5
0505 20:13:31.164783 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.164873 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3078052}
I20260505 20:13:31.165359 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 402) took 2948 ms. Trace:
I20260505 20:13:31.166348 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172cd9f38dd8491ea3ecf42b680d398f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.165462 8052 rpcz_store.cc:276] 0505 20:13:28.216630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.216709 (+ 79us) service_pool.cc:224] Handling call
0505 20:13:31.165232 (+2948523us) ts_tablet_manager.cc:1151] Deleting tablet f2b2e40635b141c59d3789aca81efba7
0505 20:13:31.165242 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.165328 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2899281}
W20260505 20:13:31.166823 7869 leader_election.cc:343] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.167043 8054 raft_consensus.cc:359] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.167260 8054 raft_consensus.cc:385] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.167361 8054 raft_consensus.cc:740] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.167616 8054 consensus_queue.cc:260] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.168154 8054 ts_tablet_manager.cc:1434] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:31.168505 8054 tablet_bootstrap.cc:492] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.168478 8616 consensus_queue.cc:1048] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.169687 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 404) took 2661 ms. Trace:
I20260505 20:13:31.169888 8052 rpcz_store.cc:276] 0505 20:13:28.508539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.508603 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:31.169514 (+2660911us) ts_tablet_manager.cc:1151] Deleting tablet 004a8e72cab44d31af3369b8df1e434e
0505 20:13:31.169525 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.169651 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2660630}
I20260505 20:13:31.170403 8054 tablet_bootstrap.cc:654] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.171053 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 410) took 2661 ms. Trace:
I20260505 20:13:31.171226 8052 rpcz_store.cc:276] 0505 20:13:28.509352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.509617 (+ 265us) service_pool.cc:224] Handling call
0505 20:13:31.170920 (+2661303us) ts_tablet_manager.cc:1151] Deleting tablet b9f684cd880b4a748cab49795de11503
0505 20:13:31.170931 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.171019 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2661090}
I20260505 20:13:31.171880 8052 tablet_replica.cc:333] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.172559 8052 raft_consensus.cc:2243] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:31.173158 8052 raft_consensus.cc:2272] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.174877 8052 ts_tablet_manager.cc:1916] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.180861 8053 ts_tablet_manager.cc:1403] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.214s user 0.007s sys 0.000s
I20260505 20:13:31.185487 8050 raft_consensus.cc:2243] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:31.186528 8641 raft_consensus.cc:493] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.188963 8050 pending_rounds.cc:70] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:31.189172 8050 pending_rounds.cc:77] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737196818554880 op_type: NO_OP noop_request { }
I20260505 20:13:31.188639 8054 tablet_bootstrap.cc:492] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.190064 8054 ts_tablet_manager.cc:1403] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.000s
I20260505 20:13:31.190238 8050 raft_consensus.cc:2889] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:31.192593 8050 raft_consensus.cc:2272] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.192981 8054 raft_consensus.cc:359] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.193277 8054 raft_consensus.cc:385] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.193430 8054 raft_consensus.cc:740] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.193701 8054 consensus_queue.cc:260] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.194543 8054 ts_tablet_manager.cc:1434] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:31.195147 8054 tablet_bootstrap.cc:492] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.200670 8605 consensus_queue.cc:1048] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.165683 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172cd9f38dd8491ea3ecf42b680d398f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.166342 8058 tablet_bootstrap.cc:492] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.203027 8058 ts_tablet_manager.cc:1403] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.156s user 0.008s sys 0.014s
W20260505 20:13:31.203354 7870 leader_election.cc:343] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.203329 8641 raft_consensus.cc:515] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.203507 7870 leader_election.cc:304] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:31.204118 8058 raft_consensus.cc:359] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.204505 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944aad58d3c14577a0c66edd95fdf5e0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.204716 8058 raft_consensus.cc:385] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.204814 8058 raft_consensus.cc:740] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:31.204842 7598 leader_election.cc:343] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:31.205068 8058 consensus_queue.cc:260] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:31.205219 7596 leader_election.cc:343] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.205359 7596 leader_election.cc:304] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.205681 8058 ts_tablet_manager.cc:1434] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:31.206039 8058 tablet_bootstrap.cc:492] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.207868 8058 tablet_bootstrap.cc:654] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.169186 8688 raft_consensus.cc:493] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.179224 8690 raft_consensus.cc:493] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.162035 8557 raft_consensus.cc:697] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.208962 8690 raft_consensus.cc:515] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.209388 8557 consensus_queue.cc:237] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.209976 8690 leader_election.cc:290] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.210292 8690 raft_consensus.cc:2749] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.208967 8688 raft_consensus.cc:515] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.211777 8050 ts_tablet_manager.cc:1916] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.212013 8688 leader_election.cc:290] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.213485 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ed062508b411eb0fa5a14637830ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.213719 7936 raft_consensus.cc:2468] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.212042 8053 raft_consensus.cc:359] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.214015 8053 raft_consensus.cc:385] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.214119 8053 raft_consensus.cc:740] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:31.214321 7598 leader_election.cc:343] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c6acad22190b402d892d06ff97bd9476
I20260505 20:13:31.214373 8053 consensus_queue.cc:260] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.214629 8641 leader_election.cc:290] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.214811 7598 leader_election.cc:304] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.216754 8639 raft_consensus.cc:2749] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.220863 8557 raft_consensus.cc:2804] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.221002 8557 raft_consensus.cc:493] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.221112 8557 raft_consensus.cc:3060] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.224231 8557 raft_consensus.cc:515] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.224723 8053 ts_tablet_manager.cc:1434] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260505 20:13:31.224920 8557 leader_election.cc:290] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.225525 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ed062508b411eb0fa5a14637830ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.225719 7936 raft_consensus.cc:3060] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.226588 8050 ts_tablet_manager.cc:1929] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:31.226815 8050 log.cc:1199] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:31.227295 8050 ts_tablet_manager.cc:1950] T 50c1f63c849c48438abdaa965ab051f9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:31.227927 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6acad22190b402d892d06ff97bd9476" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.228753 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ed062508b411eb0fa5a14637830ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.228892 7936 raft_consensus.cc:2468] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.229535 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d5ed062508b411eb0fa5a14637830ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.230247 7596 leader_election.cc:343] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.230432 7596 leader_election.cc:304] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:31.230876 7596 leader_election.cc:343] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.231000 7598 leader_election.cc:304] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.231369 8557 raft_consensus.cc:2749] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.231398 8053 tablet_bootstrap.cc:492] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.231597 8557 raft_consensus.cc:2804] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.231735 8557 raft_consensus.cc:697] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.232041 8557 consensus_queue.cc:237] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:31.231374 7596 leader_election.cc:343] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.236436 8054 tablet_bootstrap.cc:654] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.243539 8639 raft_consensus.cc:493] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.243726 8639 raft_consensus.cc:515] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.244388 8639 leader_election.cc:290] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.245247 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.245996 7869 leader_election.cc:343] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.246865 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:31.247493 7870 leader_election.cc:343] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.247648 7870 leader_election.cc:304] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:31.247687 8058 tablet_bootstrap.cc:492] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.247859 8058 ts_tablet_manager.cc:1403] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.003s
I20260505 20:13:31.248044 8639 raft_consensus.cc:2749] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.248776 8058 raft_consensus.cc:359] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.248989 8058 raft_consensus.cc:385] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.249099 8058 raft_consensus.cc:740] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.249349 8058 consensus_queue.cc:260] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.249944 8058 ts_tablet_manager.cc:1434] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:31.250290 8058 tablet_bootstrap.cc:492] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.251678 8053 tablet_bootstrap.cc:654] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.252140 8058 tablet_bootstrap.cc:654] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.253639 8052 ts_tablet_manager.cc:1929] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:31.261608 8052 log.cc:1199] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/6cf77f6323af4263852853e10003faee
I20260505 20:13:31.266570 8052 ts_tablet_manager.cc:1950] T 6cf77f6323af4263852853e10003faee P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.267773 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 403) took 2759 ms. Trace:
I20260505 20:13:31.268957 8692 raft_consensus.cc:493] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.269254 8692 raft_consensus.cc:515] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.270298 8692 leader_election.cc:290] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.270710 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a98da176254eeb896c680fbcb98caa" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.271783 7596 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.271996 8052 rpcz_store.cc:276] 0505 20:13:28.508386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.509730 (+ 1344us) service_pool.cc:224] Handling call
0505 20:13:31.171815 (+2662085us) ts_tablet_manager.cc:1151] Deleting tablet 6cf77f6323af4263852853e10003faee
0505 20:13:31.171824 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.206330 (+ 34506us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.253529 (+ 47199us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.267702 (+ 14173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2661820}
I20260505 20:13:31.272789 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 409) took 2763 ms. Trace:
I20260505 20:13:31.272909 8052 rpcz_store.cc:276] 0505 20:13:28.509224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.510308 (+ 1084us) service_pool.cc:224] Handling call
0505 20:13:31.272586 (+2762278us) ts_tablet_manager.cc:1151] Deleting tablet f3b3c646af9843048382e77b138aea44
0505 20:13:31.272599 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.272730 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2761996}
I20260505 20:13:31.273502 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 407) took 2764 ms. Trace:
I20260505 20:13:31.273612 8052 rpcz_store.cc:276] 0505 20:13:28.508979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.510611 (+ 1632us) service_pool.cc:224] Handling call
0505 20:13:31.273327 (+2762716us) ts_tablet_manager.cc:1151] Deleting tablet 4628e33d204c452ab12acf76f754f2ad
0505 20:13:31.273339 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.273444 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2762459}
W20260505 20:13:31.274247 7598 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 22a98da176254eeb896c680fbcb98caa
I20260505 20:13:31.274390 7598 leader_election.cc:304] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.274612 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 405) took 2765 ms. Trace:
I20260505 20:13:31.274650 8692 raft_consensus.cc:2749] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.274726 8052 rpcz_store.cc:276] 0505 20:13:28.508646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.508695 (+ 49us) service_pool.cc:224] Handling call
0505 20:13:31.274450 (+2765755us) ts_tablet_manager.cc:1151] Deleting tablet 19720f3a29f34515a952e50f4fec9f97
0505 20:13:31.274461 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.274556 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4991,"tablet-delete.queue_time_us":2765566}
I20260505 20:13:31.275041 8058 tablet_bootstrap.cc:492] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.275319 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 413) took 2752 ms. Trace:
I20260505 20:13:31.275434 8052 rpcz_store.cc:276] 0505 20:13:28.522339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.522407 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:31.275151 (+2752744us) ts_tablet_manager.cc:1151] Deleting tablet 1218bd76239540be9a93ca455ba3eb47
0505 20:13:31.275172 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.275257 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2752324}
I20260505 20:13:31.275583 8058 ts_tablet_manager.cc:1403] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260505 20:13:31.276414 8058 raft_consensus.cc:359] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.277842 8058 raft_consensus.cc:385] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.277981 8058 raft_consensus.cc:740] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.278314 8058 consensus_queue.cc:260] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.280732 8054 tablet_bootstrap.cc:492] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.280905 8054 ts_tablet_manager.cc:1403] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.086s user 0.008s sys 0.022s
I20260505 20:13:31.281675 8054 raft_consensus.cc:359] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.281920 8054 raft_consensus.cc:385] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.282009 8054 raft_consensus.cc:740] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.282194 8639 raft_consensus.cc:493] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.282358 8639 raft_consensus.cc:515] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.282817 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 422) took 2665 ms. Trace:
I20260505 20:13:31.282920 8052 rpcz_store.cc:276] 0505 20:13:28.617260 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.617328 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:31.281843 (+2664515us) ts_tablet_manager.cc:1151] Deleting tablet 22a98da176254eeb896c680fbcb98caa
0505 20:13:31.281855 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.282727 (+ 872us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2664279}
I20260505 20:13:31.283083 8639 leader_election.cc:290] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.283756 8053 tablet_bootstrap.cc:492] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.283896 8053 ts_tablet_manager.cc:1403] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260505 20:13:31.284628 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74dbab83b840d9b2bd103e946d3032" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.284693 8053 raft_consensus.cc:359] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.284880 8053 raft_consensus.cc:385] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.284971 8053 raft_consensus.cc:740] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.285240 8053 consensus_queue.cc:260] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:31.285390 7870 leader_election.cc:343] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.282339 8054 consensus_queue.cc:260] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.288502 8058 ts_tablet_manager.cc:1434] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260505 20:13:31.289413 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74dbab83b840d9b2bd103e946d3032" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.289808 8058 tablet_bootstrap.cc:492] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.291108 8054 ts_tablet_manager.cc:1434] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260505 20:13:31.291412 8605 raft_consensus.cc:493] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.291538 8605 raft_consensus.cc:515] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.292140 8605 leader_election.cc:290] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.292814 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944aad58d3c14577a0c66edd95fdf5e0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.292985 8054 tablet_bootstrap.cc:492] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.293062 7663 raft_consensus.cc:2468] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:31.294366 7736 leader_election.cc:304] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:31.294915 7869 leader_election.cc:343] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.295042 7869 leader_election.cc:304] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:31.295717 8639 raft_consensus.cc:2749] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.297322 8054 tablet_bootstrap.cc:654] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:31.297585 7737 leader_election.cc:343] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:31.298497 8058 tablet_bootstrap.cc:654] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.300335 8605 raft_consensus.cc:2804] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.300457 8605 raft_consensus.cc:493] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.300540 8605 raft_consensus.cc:3060] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.304687 8605 raft_consensus.cc:515] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.307181 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944aad58d3c14577a0c66edd95fdf5e0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.307502 7663 raft_consensus.cc:3060] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.308099 8058 tablet_bootstrap.cc:492] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.308279 8058 ts_tablet_manager.cc:1403] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260505 20:13:31.309304 8058 raft_consensus.cc:359] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.309478 8058 raft_consensus.cc:385] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.309573 8058 raft_consensus.cc:740] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.310027 8692 raft_consensus.cc:493] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.310144 8692 raft_consensus.cc:515] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.310729 8692 leader_election.cc:290] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.310731 8053 ts_tablet_manager.cc:1434] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260505 20:13:31.311285 8053 tablet_bootstrap.cc:492] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:31.312022 7598 leader_election.cc:343] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:31.312001 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4939dab5a4d54a08a75424bcaabbb8dd" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.309870 8058 consensus_queue.cc:260] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:31.312649 7596 leader_election.cc:343] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.312784 7596 leader_election.cc:304] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.313242 8692 raft_consensus.cc:2749] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.319680 8058 ts_tablet_manager.cc:1434] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260505 20:13:31.322929 7663 raft_consensus.cc:2468] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:31.323316 8052 tablet_replica.cc:333] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.323582 8052 raft_consensus.cc:2243] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:31.326112 8052 pending_rounds.cc:70] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:31.326953 8052 pending_rounds.cc:77] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737191890837504 op_type: NO_OP noop_request { }
I20260505 20:13:31.323846 8058 tablet_bootstrap.cc:492] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.327354 8052 raft_consensus.cc:2889] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:31.327350 7736 leader_election.cc:304] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.327705 8052 raft_consensus.cc:2272] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.327888 8490 raft_consensus.cc:2804] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.328015 8490 raft_consensus.cc:697] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:31.328097 8605 leader_election.cc:290] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.328336 8490 consensus_queue.cc:237] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.329492 8692 raft_consensus.cc:493] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.329629 8692 raft_consensus.cc:515] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.330236 8692 leader_election.cc:290] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.330917 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:31.331065 7737 leader_election.cc:343] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:31.331215 7935 raft_consensus.cc:2468] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.331624 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.331774 7598 leader_election.cc:304] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:31.332221 7596 leader_election.cc:343] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.332513 8692 raft_consensus.cc:2804] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.332610 8692 raft_consensus.cc:493] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.332680 8692 raft_consensus.cc:3060] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.332710 8053 tablet_bootstrap.cc:654] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.335505 8692 raft_consensus.cc:515] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.336560 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.337311 7596 leader_election.cc:343] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.337253 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.337519 7935 raft_consensus.cc:3060] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.337813 8692 leader_election.cc:290] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.339495 8052 ts_tablet_manager.cc:1916] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.341933 7935 raft_consensus.cc:2468] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.342639 7598 leader_election.cc:304] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.343230 8692 raft_consensus.cc:2804] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.344090 8692 raft_consensus.cc:697] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.344672 8692 consensus_queue.cc:237] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.347805 8058 tablet_bootstrap.cc:654] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.350196 8053 tablet_bootstrap.cc:492] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.350437 8053 ts_tablet_manager.cc:1403] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.006s
I20260505 20:13:31.351760 8053 raft_consensus.cc:359] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.352066 8053 raft_consensus.cc:385] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.352180 8053 raft_consensus.cc:740] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.352574 8053 consensus_queue.cc:260] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.353474 8053 ts_tablet_manager.cc:1434] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260505 20:13:31.353951 8053 tablet_bootstrap.cc:492] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.356307 8053 tablet_bootstrap.cc:654] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.362445 8054 tablet_bootstrap.cc:492] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.362654 8054 ts_tablet_manager.cc:1403] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.070s user 0.015s sys 0.039s
I20260505 20:13:31.363507 8054 raft_consensus.cc:359] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.363690 8054 raft_consensus.cc:385] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.363777 8054 raft_consensus.cc:740] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.364008 8054 consensus_queue.cc:260] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.364555 8054 ts_tablet_manager.cc:1434] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:31.364951 8054 tablet_bootstrap.cc:492] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.366631 8058 tablet_bootstrap.cc:492] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.366787 8054 tablet_bootstrap.cc:654] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.366830 8058 ts_tablet_manager.cc:1403] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260505 20:13:31.367650 8058 raft_consensus.cc:359] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.367865 8058 raft_consensus.cc:385] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.367934 8058 raft_consensus.cc:740] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.368166 8058 consensus_queue.cc:260] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.368680 8058 ts_tablet_manager.cc:1434] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:31.369021 8058 tablet_bootstrap.cc:492] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:31.374076 7737 consensus_peers.cc:597] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:31.379438 8058 tablet_bootstrap.cc:654] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.379354 8616 consensus_queue.cc:1048] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.387095 8053 tablet_bootstrap.cc:492] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.387470 8053 ts_tablet_manager.cc:1403] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260505 20:13:31.388661 8053 raft_consensus.cc:359] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.389190 8053 raft_consensus.cc:385] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.389358 8053 raft_consensus.cc:740] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.389554 8692 raft_consensus.cc:493] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.389705 8053 consensus_queue.cc:260] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.389806 8692 raft_consensus.cc:515] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.390626 8053 ts_tablet_manager.cc:1434] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:31.391039 8053 tablet_bootstrap.cc:492] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.390985 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84fb3dcea55d4b348cbf92c3c4581dda" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.391242 7802 raft_consensus.cc:2468] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.391687 7596 leader_election.cc:304] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.391987 8557 raft_consensus.cc:2804] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.392102 8557 raft_consensus.cc:493] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.392200 8557 raft_consensus.cc:3060] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.395107 8557 raft_consensus.cc:515] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.395768 8557 leader_election.cc:290] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.391378 8692 leader_election.cc:290] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.396420 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84fb3dcea55d4b348cbf92c3c4581dda" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.396687 7802 raft_consensus.cc:3060] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.400731 7802 raft_consensus.cc:2468] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.403187 7596 leader_election.cc:304] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.403898 8557 raft_consensus.cc:2804] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.404078 8557 raft_consensus.cc:697] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.404438 8557 consensus_queue.cc:237] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:31.411420 7596 consensus_peers.cc:597] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cf77f6323af4263852853e10003faee. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:31.411558 8053 tablet_bootstrap.cc:654] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.420045 8053 tablet_bootstrap.cc:492] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.420305 8053 ts_tablet_manager.cc:1403] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.002s
I20260505 20:13:31.421201 8053 raft_consensus.cc:359] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.421502 8053 raft_consensus.cc:385] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.421622 8053 raft_consensus.cc:740] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.421926 8053 consensus_queue.cc:260] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.423692 8053 ts_tablet_manager.cc:1434] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:31.424049 8053 tablet_bootstrap.cc:492] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.426074 8053 tablet_bootstrap.cc:654] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.424271 8692 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.426446 8692 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.428234 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.428423 8605 raft_consensus.cc:493] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.428591 8605 raft_consensus.cc:515] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.429229 8605 leader_election.cc:290] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:31.429723 7596 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.430328 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98af33c2cdb24937858efdc7b638418f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.430536 7664 raft_consensus.cc:2468] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:31.431089 7736 leader_election.cc:304] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.431401 8605 raft_consensus.cc:2804] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.431521 8605 raft_consensus.cc:493] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.431664 8605 raft_consensus.cc:3060] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.435088 8605 raft_consensus.cc:515] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.436492 8605 leader_election.cc:290] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.437199 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98af33c2cdb24937858efdc7b638418f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.437435 7664 raft_consensus.cc:3060] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.440410 7664 raft_consensus.cc:2468] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:31.440987 7736 leader_election.cc:304] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.441135 8053 tablet_bootstrap.cc:492] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.441372 8053 ts_tablet_manager.cc:1403] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.003s
I20260505 20:13:31.441699 8616 raft_consensus.cc:2804] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.441866 8616 raft_consensus.cc:697] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:31.442222 8616 consensus_queue.cc:237] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.442596 8053 raft_consensus.cc:359] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.442828 8053 raft_consensus.cc:385] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.442939 8053 raft_consensus.cc:740] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.452237 8692 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.443218 8053 consensus_queue.cc:260] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.454423 8053 ts_tablet_manager.cc:1434] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260505 20:13:31.454891 8053 tablet_bootstrap.cc:492] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.457538 8053 tablet_bootstrap.cc:654] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.464118 8053 tablet_bootstrap.cc:492] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.464352 8053 ts_tablet_manager.cc:1403] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.001s
I20260505 20:13:31.465518 8053 raft_consensus.cc:359] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.466104 8053 raft_consensus.cc:385] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.466203 8053 raft_consensus.cc:740] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.466583 8053 consensus_queue.cc:260] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.467295 8053 ts_tablet_manager.cc:1434] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:31.467694 8053 tablet_bootstrap.cc:492] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.474466 8053 tablet_bootstrap.cc:654] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:31.475035 8705 log.cc:927] Time spent T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260505 20:13:31.477278 8668 raft_consensus.cc:493] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.477491 8668 raft_consensus.cc:515] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.478152 8668 leader_election.cc:290] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.479097 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e041ebc882b14484a51fe3a6589cddd6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.479400 7663 raft_consensus.cc:2468] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:31.479821 7598 leader_election.cc:343] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:31.481110 7870 leader_election.cc:304] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.481458 8668 raft_consensus.cc:2804] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.481554 8668 raft_consensus.cc:493] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.481649 8668 raft_consensus.cc:3060] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.484225 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e041ebc882b14484a51fe3a6589cddd6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.485189 7737 leader_election.cc:343] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 98af33c2cdb24937858efdc7b638418f
W20260505 20:13:31.485611 7737 leader_election.cc:343] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 98af33c2cdb24937858efdc7b638418f
W20260505 20:13:31.486189 7869 leader_election.cc:343] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.486333 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:31.486912 7598 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.486991 8053 tablet_bootstrap.cc:492] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.487079 7598 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.487139 8053 ts_tablet_manager.cc:1403] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.001s
W20260505 20:13:31.487911 7598 leader_election.cc:343] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:31.488015 8053 raft_consensus.cc:359] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.488188 8053 raft_consensus.cc:385] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.488278 8053 raft_consensus.cc:740] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.488672 8053 consensus_queue.cc:260] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.489162 8557 raft_consensus.cc:2749] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.489383 8557 raft_consensus.cc:493] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.489512 8557 raft_consensus.cc:515] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.490185 8557 leader_election.cc:290] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.490939 8053 ts_tablet_manager.cc:1434] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260505 20:13:31.491287 8053 tablet_bootstrap.cc:492] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.491261 8668 raft_consensus.cc:515] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.493149 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a42f0b6dc74cbd8d72ae36410f9d35" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.493666 8053 tablet_bootstrap.cc:654] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:31.494058 7596 leader_election.cc:343] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:31.494529 7598 leader_election.cc:343] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:31.494635 7598 leader_election.cc:304] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.495023 8557 raft_consensus.cc:2749] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.495868 8668 leader_election.cc:290] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.495925 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e041ebc882b14484a51fe3a6589cddd6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.496567 7869 leader_election.cc:343] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.496778 8054 tablet_bootstrap.cc:492] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.496970 8054 ts_tablet_manager.cc:1403] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.132s user 0.036s sys 0.045s
I20260505 20:13:31.497998 8054 raft_consensus.cc:359] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.498286 8054 raft_consensus.cc:385] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.498402 8054 raft_consensus.cc:740] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.499068 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e041ebc882b14484a51fe3a6589cddd6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.499330 7663 raft_consensus.cc:3060] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.501878 8052 ts_tablet_manager.cc:1929] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:31.502065 8052 log.cc:1199] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/a026a8408ed9462b820b560a98dcabd1
I20260505 20:13:31.502521 8052 ts_tablet_manager.cc:1950] T a026a8408ed9462b820b560a98dcabd1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.502843 7663 raft_consensus.cc:2468] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.503330 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 423) took 2885 ms. Trace:
I20260505 20:13:31.503358 7870 leader_election.cc:304] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.503902 8668 raft_consensus.cc:2804] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.505110 8668 raft_consensus.cc:697] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.505514 8668 consensus_queue.cc:237] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.513995 8054 consensus_queue.cc:260] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.514657 8054 ts_tablet_manager.cc:1434] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260505 20:13:31.503436 8052 rpcz_store.cc:276] 0505 20:13:28.618246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.618469 (+ 223us) service_pool.cc:224] Handling call
0505 20:13:31.323220 (+2704751us) ts_tablet_manager.cc:1151] Deleting tablet a026a8408ed9462b820b560a98dcabd1
0505 20:13:31.323231 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.362297 (+ 39066us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.473810 (+111513us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.503266 (+ 29456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11071,"tablet-delete.queue_time_us":2704525}
I20260505 20:13:31.515076 8058 tablet_bootstrap.cc:492] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.515237 8058 ts_tablet_manager.cc:1403] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.146s user 0.023s sys 0.016s
I20260505 20:13:31.515262 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 424) took 2894 ms. Trace:
I20260505 20:13:31.515358 8052 rpcz_store.cc:276] 0505 20:13:28.621215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.621274 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:31.515020 (+2893746us) ts_tablet_manager.cc:1151] Deleting tablet 168d9a40a69d4beab8e79a97e7723e69
0505 20:13:31.515043 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.515198 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2893522}
I20260505 20:13:31.515748 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 425) took 2893 ms. Trace:
I20260505 20:13:31.515848 8052 rpcz_store.cc:276] 0505 20:13:28.621802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.621850 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:31.515592 (+2893742us) ts_tablet_manager.cc:1151] Deleting tablet 3d74dbab83b840d9b2bd103e946d3032
0505 20:13:31.515602 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.515686 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2893529}
I20260505 20:13:31.516209 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 432) took 2538 ms. Trace:
I20260505 20:13:31.516112 8058 raft_consensus.cc:359] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.516309 8058 raft_consensus.cc:385] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.516297 8052 rpcz_store.cc:276] 0505 20:13:28.977306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.977990 (+ 684us) service_pool.cc:224] Handling call
0505 20:13:31.516059 (+2538069us) ts_tablet_manager.cc:1151] Deleting tablet bcd289ce979940ae96554d5756d140d7
0505 20:13:31.516069 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.516156 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2537796}
I20260505 20:13:31.516398 8058 raft_consensus.cc:740] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.516614 8058 consensus_queue.cc:260] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:31.516949 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 69969.2us
I20260505 20:13:31.517149 8058 ts_tablet_manager.cc:1434] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:31.517828 8054 tablet_bootstrap.cc:492] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.518814 8058 tablet_bootstrap.cc:492] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.521795 8054 tablet_bootstrap.cc:654] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.523166 8052 tablet_replica.cc:333] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.523402 8052 raft_consensus.cc:2243] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:31.523648 8052 raft_consensus.cc:2272] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.527910 8058 tablet_bootstrap.cc:654] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.533365 8053 tablet_bootstrap.cc:492] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.533555 8053 ts_tablet_manager.cc:1403] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.008s
I20260505 20:13:31.534287 8052 ts_tablet_manager.cc:1916] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.534504 8053 raft_consensus.cc:359] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.534714 8053 raft_consensus.cc:385] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.534828 8053 raft_consensus.cc:740] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.535115 8053 consensus_queue.cc:260] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.537164 8053 ts_tablet_manager.cc:1434] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:31.537825 8053 tablet_bootstrap.cc:492] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.539600 8053 tablet_bootstrap.cc:654] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.539955 8058 tablet_bootstrap.cc:492] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.540113 8058 ts_tablet_manager.cc:1403] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20260505 20:13:31.540853 8058 raft_consensus.cc:359] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.541043 8058 raft_consensus.cc:385] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.541111 8058 raft_consensus.cc:740] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.541361 8058 consensus_queue.cc:260] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.551172 8058 ts_tablet_manager.cc:1434] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260505 20:13:31.557384 8052 ts_tablet_manager.cc:1929] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:31.557541 8052 log.cc:1199] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b596f03adbea413b813c9037d4243fae
I20260505 20:13:31.558691 8054 tablet_bootstrap.cc:492] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.558876 8054 ts_tablet_manager.cc:1403] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260505 20:13:31.559583 8058 tablet_bootstrap.cc:492] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.559772 8054 raft_consensus.cc:359] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.559947 8054 raft_consensus.cc:385] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.560053 8054 raft_consensus.cc:740] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.560325 8054 consensus_queue.cc:260] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.561398 8058 tablet_bootstrap.cc:654] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.565840 8054 ts_tablet_manager.cc:1434] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260505 20:13:31.570827 8054 tablet_bootstrap.cc:492] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.572742 8054 tablet_bootstrap.cc:654] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.580590 8053 tablet_bootstrap.cc:492] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.580842 8053 ts_tablet_manager.cc:1403] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.043s user 0.011s sys 0.022s
I20260505 20:13:31.581682 8053 raft_consensus.cc:359] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.581981 8053 raft_consensus.cc:385] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.582124 8053 raft_consensus.cc:740] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.582456 8053 consensus_queue.cc:260] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.583230 8053 ts_tablet_manager.cc:1434] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:31.583765 8053 tablet_bootstrap.cc:492] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.586329 8052 ts_tablet_manager.cc:1950] T b596f03adbea413b813c9037d4243fae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.587244 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 433) took 2609 ms. Trace:
I20260505 20:13:31.588164 8058 tablet_bootstrap.cc:492] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.588330 8058 ts_tablet_manager.cc:1403] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.001s
I20260505 20:13:31.589054 8058 raft_consensus.cc:359] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.589229 8058 raft_consensus.cc:385] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.589318 8058 raft_consensus.cc:740] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.589846 8052 rpcz_store.cc:276] 0505 20:13:28.977693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.978050 (+ 357us) service_pool.cc:224] Handling call
0505 20:13:31.523062 (+2545012us) ts_tablet_manager.cc:1151] Deleting tablet b596f03adbea413b813c9037d4243fae
0505 20:13:31.523074 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.550131 (+ 27057us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.557270 (+ 7139us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.587198 (+ 29928us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2544771}
I20260505 20:13:31.587721 8053 tablet_bootstrap.cc:654] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.590730 8058 consensus_queue.cc:260] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.591756 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 436) took 2613 ms. Trace:
I20260505 20:13:31.591912 8052 rpcz_store.cc:276] 0505 20:13:28.978075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.978127 (+ 52us) service_pool.cc:224] Handling call
0505 20:13:31.591610 (+2613483us) ts_tablet_manager.cc:1151] Deleting tablet 8c8754580368453aa0aae021d8c665da
0505 20:13:31.591617 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.591719 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2613318}
I20260505 20:13:31.592420 8052 tablet_replica.cc:333] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.592676 8052 raft_consensus.cc:2243] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:31.592866 8052 pending_rounds.cc:70] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:31.592979 8052 pending_rounds.cc:77] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737187378618368 op_type: NO_OP noop_request { }
I20260505 20:13:31.593139 8052 raft_consensus.cc:2889] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:31.593297 8052 raft_consensus.cc:2272] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.593895 8052 ts_tablet_manager.cc:1916] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.594203 8054 tablet_bootstrap.cc:492] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.594400 8054 ts_tablet_manager.cc:1403] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260505 20:13:31.595337 8054 raft_consensus.cc:359] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.595546 8054 raft_consensus.cc:385] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.595631 8054 raft_consensus.cc:740] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.595913 8054 consensus_queue.cc:260] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.596556 8054 ts_tablet_manager.cc:1434] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:31.596973 8668 raft_consensus.cc:493] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.597116 8668 raft_consensus.cc:515] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.597882 8668 leader_election.cc:290] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.598284 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e453fdf9a424fe8974076fac3ad74bf" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.598510 7663 raft_consensus.cc:2468] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.598485 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e453fdf9a424fe8974076fac3ad74bf" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.599016 7869 leader_election.cc:343] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.599061 8058 ts_tablet_manager.cc:1434] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260505 20:13:31.599267 7870 leader_election.cc:304] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.599452 8054 tablet_bootstrap.cc:492] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.602407 8668 raft_consensus.cc:2804] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.602536 8668 raft_consensus.cc:493] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.602625 8668 raft_consensus.cc:3060] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:31.603564 7598 consensus_peers.cc:597] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cf77f6323af4263852853e10003faee. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:31.605935 8054 tablet_bootstrap.cc:654] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.605513 8668 raft_consensus.cc:515] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.609026 8058 tablet_bootstrap.cc:492] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.609696 8052 ts_tablet_manager.cc:1929] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:31.609839 8052 log.cc:1199] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/4e6da3130e724445b0d1f3c20e4e3d02
I20260505 20:13:31.613008 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e453fdf9a424fe8974076fac3ad74bf" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.613216 7663 raft_consensus.cc:3060] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.614324 8058 tablet_bootstrap.cc:654] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.614732 8052 ts_tablet_manager.cc:1950] T 4e6da3130e724445b0d1f3c20e4e3d02 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.615535 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 435) took 2637 ms. Trace:
I20260505 20:13:31.617017 8052 rpcz_store.cc:276] 0505 20:13:28.977957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.977999 (+ 42us) service_pool.cc:224] Handling call
0505 20:13:31.592343 (+2614344us) ts_tablet_manager.cc:1151] Deleting tablet 4e6da3130e724445b0d1f3c20e4e3d02
0505 20:13:31.592354 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.599242 (+ 6888us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.609594 (+ 10352us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.615494 (+ 5900us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2613990}
I20260505 20:13:31.617452 7663 raft_consensus.cc:2468] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.617998 7870 leader_election.cc:304] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.618106 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 434) took 2640 ms. Trace:
I20260505 20:13:31.618330 8639 raft_consensus.cc:2804] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.618239 8052 rpcz_store.cc:276] 0505 20:13:28.977851 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.978248 (+ 397us) service_pool.cc:224] Handling call
0505 20:13:31.617895 (+2639647us) ts_tablet_manager.cc:1151] Deleting tablet e6c5c661e8aa4962bb9922b9ead7d784
0505 20:13:31.617911 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.618068 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2639444}
I20260505 20:13:31.618479 8639 raft_consensus.cc:697] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.618767 8639 consensus_queue.cc:237] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.619397 8052 tablet_replica.cc:333] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.619681 8052 raft_consensus.cc:2243] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:31.619867 8052 raft_consensus.cc:2272] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.621790 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e453fdf9a424fe8974076fac3ad74bf" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.621850 8668 leader_election.cc:290] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:31.622326 7869 leader_election.cc:343] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.626252 8692 raft_consensus.cc:493] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.626475 8692 raft_consensus.cc:515] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.626727 8052 ts_tablet_manager.cc:1916] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.627050 8692 leader_election.cc:290] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.628062 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172cd9f38dd8491ea3ecf42b680d398f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.628285 7933 raft_consensus.cc:2468] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.628640 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172cd9f38dd8491ea3ecf42b680d398f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.628686 7598 leader_election.cc:304] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:31.629105 7596 leader_election.cc:343] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.629491 8692 raft_consensus.cc:2804] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.629571 8692 raft_consensus.cc:493] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.629658 8692 raft_consensus.cc:3060] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.632804 8692 raft_consensus.cc:515] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.634721 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172cd9f38dd8491ea3ecf42b680d398f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.634925 7933 raft_consensus.cc:3060] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.636400 8692 leader_election.cc:290] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.636497 8052 ts_tablet_manager.cc:1929] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:31.636631 8052 log.cc:1199] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:31.637005 8052 ts_tablet_manager.cc:1950] T 4939dab5a4d54a08a75424bcaabbb8dd P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.637939 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172cd9f38dd8491ea3ecf42b680d398f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.638098 8732 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:31.638268 8732 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
W20260505 20:13:31.638509 7596 leader_election.cc:343] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.638525 7933 raft_consensus.cc:2468] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.638978 7598 leader_election.cc:304] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.639374 8692 raft_consensus.cc:2804] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.639519 8692 raft_consensus.cc:697] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.639783 8692 consensus_queue.cc:237] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.640938 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 2 candidate_status { last_received { term: 1 index: 601 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:31.641330 8053 tablet_bootstrap.cc:492] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.641376 8557 raft_consensus.cc:493] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.641503 8557 raft_consensus.cc:515] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.641691 8053 ts_tablet_manager.cc:1403] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.007s
I20260505 20:13:31.640442 8732 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:31.642202 8557 leader_election.cc:290] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.642661 8053 raft_consensus.cc:359] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.642935 8053 raft_consensus.cc:385] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.643038 8053 raft_consensus.cc:740] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.643232 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2676078f47c4bc19391227d9643c15f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.643337 7598 leader_election.cc:343] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: d2676078f47c4bc19391227d9643c15f
I20260505 20:13:31.643332 8053 consensus_queue.cc:260] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.643460 7802 raft_consensus.cc:2468] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.643909 8053 ts_tablet_manager.cc:1434] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:31.643873 7596 leader_election.cc:304] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:31.644286 8557 raft_consensus.cc:2804] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.644387 8557 raft_consensus.cc:493] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.644433 8053 tablet_bootstrap.cc:492] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.644479 8557 raft_consensus.cc:3060] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.644682 8054 tablet_bootstrap.cc:492] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.644822 8054 ts_tablet_manager.cc:1403] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.013s
I20260505 20:13:31.645841 8054 raft_consensus.cc:359] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.646023 8054 raft_consensus.cc:385] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.646113 8054 raft_consensus.cc:740] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.646353 8054 consensus_queue.cc:260] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.647348 8557 raft_consensus.cc:515] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.647753 8058 tablet_bootstrap.cc:492] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.647918 8058 ts_tablet_manager.cc:1403] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.001s
I20260505 20:13:31.648664 8557 leader_election.cc:290] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:31.649866 7598 leader_election.cc:343] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: d2676078f47c4bc19391227d9643c15f
I20260505 20:13:31.649922 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2676078f47c4bc19391227d9643c15f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.650123 7802 raft_consensus.cc:3060] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.652433 8054 ts_tablet_manager.cc:1434] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260505 20:13:31.652640 8058 raft_consensus.cc:359] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.652767 8054 tablet_bootstrap.cc:492] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.652835 8058 raft_consensus.cc:385] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.652909 8058 raft_consensus.cc:740] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.652992 7802 raft_consensus.cc:2468] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.653716 7596 leader_election.cc:304] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:31.655469 8616 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.655630 8616 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.656152 8053 tablet_bootstrap.cc:654] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.656279 8616 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:31.657485 7737 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:31.657722 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.657790 8692 raft_consensus.cc:2804] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.657992 7663 raft_consensus.cc:2393] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:31.658188 8692 raft_consensus.cc:697] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.658524 7736 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:31.658584 8692 consensus_queue.cc:237] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.659049 8616 raft_consensus.cc:3060] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.660020 8058 consensus_queue.cc:260] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.660748 8058 ts_tablet_manager.cc:1434] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:31.661091 8058 tablet_bootstrap.cc:492] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.661151 8054 tablet_bootstrap.cc:654] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.663105 8058 tablet_bootstrap.cc:654] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.664685 8717 consensus_queue.cc:1048] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.669828 8616 raft_consensus.cc:2749] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.674221 8718 consensus_queue.cc:1048] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.676438 8054 tablet_bootstrap.cc:492] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.676635 8054 ts_tablet_manager.cc:1403] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260505 20:13:31.677510 8054 raft_consensus.cc:359] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.677708 8054 raft_consensus.cc:385] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.677821 8054 raft_consensus.cc:740] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.678135 8054 consensus_queue.cc:260] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.679245 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 437) took 2687 ms. Trace:
I20260505 20:13:31.679365 8052 rpcz_store.cc:276] 0505 20:13:28.991856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:28.991914 (+ 58us) service_pool.cc:224] Handling call
0505 20:13:31.619317 (+2627403us) ts_tablet_manager.cc:1151] Deleting tablet 4939dab5a4d54a08a75424bcaabbb8dd
0505 20:13:31.619330 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.633400 (+ 14070us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.636422 (+ 3022us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.679174 (+ 42752us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2627183}
I20260505 20:13:31.682072 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 431) took 2704 ms. Trace:
I20260505 20:13:31.682192 8052 rpcz_store.cc:276] 0505 20:13:28.977145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.013468 (+ 36323us) service_pool.cc:224] Handling call
0505 20:13:31.681862 (+2668394us) ts_tablet_manager.cc:1151] Deleting tablet 4816f1ccb82e4641b2dcfe9ce9b55fae
0505 20:13:31.681874 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.682008 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2668137}
I20260505 20:13:31.682722 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 438) took 2658 ms. Trace:
I20260505 20:13:31.682823 8052 rpcz_store.cc:276] 0505 20:13:29.024606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.025701 (+ 1095us) service_pool.cc:224] Handling call
0505 20:13:31.682578 (+2656877us) ts_tablet_manager.cc:1151] Deleting tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0
0505 20:13:31.682586 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.682665 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2656593}
I20260505 20:13:31.683545 8052 tablet_replica.cc:333] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.685894 8052 raft_consensus.cc:2243] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:31.687187 8639 raft_consensus.cc:493] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.687364 8639 raft_consensus.cc:515] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.687999 8639 leader_election.cc:290] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.689175 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.689431 7664 raft_consensus.cc:2468] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.690068 7870 leader_election.cc:304] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.690127 8052 raft_consensus.cc:2272] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.690518 8639 raft_consensus.cc:2804] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.690629 8639 raft_consensus.cc:493] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.690714 8052 ts_tablet_manager.cc:1916] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.690752 8639 raft_consensus.cc:3060] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.694058 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.694577 7869 leader_election.cc:343] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.695302 8639 raft_consensus.cc:515] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.696324 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.696539 7664 raft_consensus.cc:3060] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.699785 7664 raft_consensus.cc:2468] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.700446 8058 tablet_bootstrap.cc:492] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.700502 7870 leader_election.cc:304] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.700616 8058 ts_tablet_manager.cc:1403] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.001s
I20260505 20:13:31.700852 8668 raft_consensus.cc:2804] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.701108 8668 raft_consensus.cc:697] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.701401 8668 consensus_queue.cc:237] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.703070 8052 ts_tablet_manager.cc:1929] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260505 20:13:31.703295 8052 log.cc:1199] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/611bba6267194d058cd08a27cdd2af49
I20260505 20:13:31.703363 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.703889 7869 leader_election.cc:343] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.703931 8052 ts_tablet_manager.cc:1950] T 611bba6267194d058cd08a27cdd2af49 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.704173 8639 leader_election.cc:290] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.704820 8054 ts_tablet_manager.cc:1434] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260505 20:13:31.705180 8054 tablet_bootstrap.cc:492] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.707046 8054 tablet_bootstrap.cc:654] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.710638 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 451) took 2341 ms. Trace:
I20260505 20:13:31.710278 8058 raft_consensus.cc:359] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.712872 8054 tablet_bootstrap.cc:492] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.712880 8058 raft_consensus.cc:385] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.712980 8058 raft_consensus.cc:740] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.713047 8054 ts_tablet_manager.cc:1403] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260505 20:13:31.713339 8058 consensus_queue.cc:260] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.713433 8052 rpcz_store.cc:276] 0505 20:13:29.369518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.369579 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:31.683449 (+2313870us) ts_tablet_manager.cc:1151] Deleting tablet 611bba6267194d058cd08a27cdd2af49
0505 20:13:31.683457 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.694270 (+ 10813us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.702879 (+ 8609us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.710597 (+ 7718us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2299147}
I20260505 20:13:31.713924 8054 raft_consensus.cc:359] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.714110 8054 raft_consensus.cc:385] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.714207 8054 raft_consensus.cc:740] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.714387 8053 tablet_bootstrap.cc:492] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.714543 8053 ts_tablet_manager.cc:1403] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.070s user 0.008s sys 0.000s
I20260505 20:13:31.714912 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 453) took 2173 ms. Trace:
I20260505 20:13:31.715361 8052 rpcz_store.cc:276] 0505 20:13:29.541653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.541784 (+ 131us) service_pool.cc:224] Handling call
0505 20:13:31.714583 (+2172799us) ts_tablet_manager.cc:1151] Deleting tablet b8d50ceda0ff4bb6b49920c922dfee9e
0505 20:13:31.714730 (+ 147us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.714874 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2170019}
I20260505 20:13:31.715534 8053 raft_consensus.cc:359] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.715934 8053 raft_consensus.cc:385] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.716074 8053 raft_consensus.cc:740] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.716166 8734 raft_consensus.cc:493] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:31.716497 8053 consensus_queue.cc:260] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.716518 8734 raft_consensus.cc:515] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:31.720705 8053 ts_tablet_manager.cc:1434] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260505 20:13:31.721253 8053 tablet_bootstrap.cc:492] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.721807 8616 raft_consensus.cc:493] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.721988 8616 raft_consensus.cc:515] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.722792 8616 leader_election.cc:290] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.723770 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c12a95b0ed445c7b598db136f6ac05c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.723989 7663 raft_consensus.cc:2468] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:31.724012 7737 leader_election.cc:343] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 2c12a95b0ed445c7b598db136f6ac05c
I20260505 20:13:31.724395 7736 leader_election.cc:304] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:31.724843 8616 raft_consensus.cc:2804] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.724982 8616 raft_consensus.cc:493] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.725070 8616 raft_consensus.cc:3060] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.726251 8058 ts_tablet_manager.cc:1434] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.026s user 0.002s sys 0.001s
I20260505 20:13:31.727280 8053 tablet_bootstrap.cc:654] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.728509 8616 raft_consensus.cc:515] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.728688 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 454) took 2184 ms. Trace:
I20260505 20:13:31.728796 8052 rpcz_store.cc:276] 0505 20:13:29.543832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.543922 (+ 90us) service_pool.cc:224] Handling call
0505 20:13:31.728527 (+2184605us) ts_tablet_manager.cc:1151] Deleting tablet d3cd1b7b0456462a80d653dd442589a6
0505 20:13:31.728538 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.728648 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2183769}
I20260505 20:13:31.729482 8054 consensus_queue.cc:260] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.729586 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c12a95b0ed445c7b598db136f6ac05c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.729803 7664 raft_consensus.cc:3060] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.730247 8054 ts_tablet_manager.cc:1434] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260505 20:13:31.730552 8054 tablet_bootstrap.cc:492] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.732355 8054 tablet_bootstrap.cc:654] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.732656 7664 raft_consensus.cc:2468] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:31.733426 8058 tablet_bootstrap.cc:492] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.733566 7736 leader_election.cc:304] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.733975 8718 raft_consensus.cc:2804] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.734135 8718 raft_consensus.cc:697] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:31.734237 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 455) took 2162 ms. Trace:
I20260505 20:13:31.734344 8052 rpcz_store.cc:276] 0505 20:13:29.571854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.571953 (+ 99us) service_pool.cc:224] Handling call
0505 20:13:31.734008 (+2162055us) ts_tablet_manager.cc:1151] Deleting tablet b393bfc209b6461aab958ebf49014d25
0505 20:13:31.734021 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.734146 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2157967}
I20260505 20:13:31.734472 8718 consensus_queue.cc:237] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.735116 8058 tablet_bootstrap.cc:654] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.736438 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 456) took 2154 ms. Trace:
I20260505 20:13:31.736549 8639 raft_consensus.cc:493] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.736722 8639 raft_consensus.cc:515] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.737342 8639 leader_election.cc:290] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.738070 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6166653cbc58470c8ba4926048ba1384" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.738322 7663 raft_consensus.cc:2468] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.738739 7870 leader_election.cc:304] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.739025 8639 raft_consensus.cc:2804] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.739133 8639 raft_consensus.cc:493] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.737787 8616 leader_election.cc:290] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.738116 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6166653cbc58470c8ba4926048ba1384" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.739269 8639 raft_consensus.cc:3060] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:31.738951 7737 leader_election.cc:343] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 2c12a95b0ed445c7b598db136f6ac05c
W20260505 20:13:31.739784 7869 leader_election.cc:343] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.740267 8052 rpcz_store.cc:276] 0505 20:13:29.582241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.584098 (+ 1857us) service_pool.cc:224] Handling call
0505 20:13:31.736280 (+2152182us) ts_tablet_manager.cc:1151] Deleting tablet 883ec65f15604346813e5f87d55802fc
0505 20:13:31.736287 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.736392 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2145186}
I20260505 20:13:31.741937 8053 tablet_bootstrap.cc:492] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.742118 8053 ts_tablet_manager.cc:1403] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20260505 20:13:31.742209 8639 raft_consensus.cc:515] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.742995 8053 raft_consensus.cc:359] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.743206 8053 raft_consensus.cc:385] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.743284 8053 raft_consensus.cc:740] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.743739 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 459) took 1945 ms. Trace:
I20260505 20:13:31.743857 8052 rpcz_store.cc:276] 0505 20:13:29.797838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.803188 (+ 5350us) service_pool.cc:224] Handling call
0505 20:13:31.743488 (+1940300us) ts_tablet_manager.cc:1151] Deleting tablet b6895af5f55b4bc183065626417090a4
0505 20:13:31.743500 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.743701 (+ 201us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1922401}
I20260505 20:13:31.743970 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6166653cbc58470c8ba4926048ba1384" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.744376 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 458) took 1946 ms. Trace:
W20260505 20:13:31.744441 7869 leader_election.cc:343] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.744483 8052 rpcz_store.cc:276] 0505 20:13:29.797670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.805061 (+ 7391us) service_pool.cc:224] Handling call
0505 20:13:31.744233 (+1939172us) ts_tablet_manager.cc:1151] Deleting tablet e2554ecdcfd64ca6ba75e6b4077a5ab3
0505 20:13:31.744244 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.744348 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1901641}
I20260505 20:13:31.744760 8639 leader_election.cc:290] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.745437 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6166653cbc58470c8ba4926048ba1384" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.745641 7664 raft_consensus.cc:3060] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.747699 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 457) took 1950 ms. Trace:
I20260505 20:13:31.747812 8052 rpcz_store.cc:276] 0505 20:13:29.797536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.803817 (+ 6281us) service_pool.cc:224] Handling call
0505 20:13:31.747564 (+1943747us) ts_tablet_manager.cc:1151] Deleting tablet bde33085759f4fd8a130d80878d1e564
0505 20:13:31.747574 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.747658 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1898998}
I20260505 20:13:31.748459 7664 raft_consensus.cc:2468] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.748842 7870 leader_election.cc:304] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.756181 8616 raft_consensus.cc:493] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.756361 8616 raft_consensus.cc:515] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.757000 8616 leader_election.cc:290] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.757586 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3679480e55444d0d935f262217e44485" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.758338 8053 consensus_queue.cc:260] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.758802 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 467) took 1881 ms. Trace:
I20260505 20:13:31.758890 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3679480e55444d0d935f262217e44485" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.758924 8052 rpcz_store.cc:276] 0505 20:13:29.877815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:29.877973 (+ 158us) service_pool.cc:224] Handling call
0505 20:13:31.758642 (+1880669us) ts_tablet_manager.cc:1151] Deleting tablet 944eaa335fcf49be975baee21c715642
0505 20:13:31.758653 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.758759 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1880419}
I20260505 20:13:31.759207 7663 raft_consensus.cc:2393] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:31.759634 7736 leader_election.cc:304] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:31.759743 8053 ts_tablet_manager.cc:1434] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260505 20:13:31.760059 8053 tablet_bootstrap.cc:492] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.760191 8616 raft_consensus.cc:3060] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.762042 8053 tablet_bootstrap.cc:654] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.763267 8616 raft_consensus.cc:2749] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.763242 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 472) took 1662 ms. Trace:
I20260505 20:13:31.763556 8052 rpcz_store.cc:276] 0505 20:13:30.100289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:30.100337 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:31.762974 (+1662637us) ts_tablet_manager.cc:1151] Deleting tablet f0ca8cc557674992b88f3379cc1db652
0505 20:13:31.762987 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.763162 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1657641}
I20260505 20:13:31.763803 8639 raft_consensus.cc:2804] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.764042 8639 raft_consensus.cc:697] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.764158 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 473) took 1660 ms. Trace:
I20260505 20:13:31.764276 8052 rpcz_store.cc:276] 0505 20:13:30.103590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:30.103648 (+ 58us) service_pool.cc:224] Handling call
0505 20:13:31.763984 (+1660336us) ts_tablet_manager.cc:1151] Deleting tablet 20c24f9f26c84ba7b2ce85f9da4bccf8
0505 20:13:31.763996 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.764114 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1657560}
I20260505 20:13:31.764750 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 474) took 1654 ms. Trace:
I20260505 20:13:31.764922 8052 rpcz_store.cc:276] 0505 20:13:30.110609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:30.110658 (+ 49us) service_pool.cc:224] Handling call
0505 20:13:31.764621 (+1653963us) ts_tablet_manager.cc:1151] Deleting tablet 608bffbbc10141e8bd19f475b95bdc65
0505 20:13:31.764629 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.764716 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1653298}
I20260505 20:13:31.765419 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 477) took 1643 ms. Trace:
I20260505 20:13:31.765538 8052 rpcz_store.cc:276] 0505 20:13:30.122385 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:30.122733 (+ 348us) service_pool.cc:224] Handling call
0505 20:13:31.765289 (+1642556us) ts_tablet_manager.cc:1151] Deleting tablet f5dfabb36fa5499780b0d15c71404307
0505 20:13:31.765301 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.765381 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640508}
I20260505 20:13:31.766115 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 478) took 1641 ms. Trace:
I20260505 20:13:31.766227 8052 rpcz_store.cc:276] 0505 20:13:30.125133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:30.125710 (+ 577us) service_pool.cc:224] Handling call
0505 20:13:31.765921 (+1640211us) ts_tablet_manager.cc:1151] Deleting tablet ee19f65120184eca9495513b68440b4f
0505 20:13:31.765997 (+ 76us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.766084 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1621150}
I20260505 20:13:31.766659 8052 tablet_replica.cc:333] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:31.765861 8639 consensus_queue.cc:237] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.766896 8052 raft_consensus.cc:2243] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:31.767258 8052 raft_consensus.cc:2272] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:31.768648 8053 tablet_bootstrap.cc:492] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.768828 8053 ts_tablet_manager.cc:1403] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260505 20:13:31.769831 8052 ts_tablet_manager.cc:1916] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:31.769878 8058 tablet_bootstrap.cc:492] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.770053 8058 ts_tablet_manager.cc:1403] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260505 20:13:31.769799 8053 raft_consensus.cc:359] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.770754 8053 raft_consensus.cc:385] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.770915 8053 raft_consensus.cc:740] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.770911 8058 raft_consensus.cc:359] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.771116 8058 raft_consensus.cc:385] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.771194 8058 raft_consensus.cc:740] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.771168 8053 consensus_queue.cc:260] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.771481 8058 consensus_queue.cc:260] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.771960 8053 ts_tablet_manager.cc:1434] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260505 20:13:31.772291 8053 tablet_bootstrap.cc:492] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.774158 8053 tablet_bootstrap.cc:654] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.776854 8052 ts_tablet_manager.cc:1929] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:31.777006 8052 log.cc:1199] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:31.777472 8052 ts_tablet_manager.cc:1950] T beb404fa927641f48f28c6bdaa297db3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:31.779618 8734 leader_election.cc:290] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:31.779759 8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4615fa5639440fc820498f897adf17d" candidate_term: 2 candidate_status { last_received { term: 1 index: 602 } } ignore_live_leader: false dest_uuid: "29603775b6d74153b21e0bbcc535ff98" is_pre_election: true
I20260505 20:13:31.780192 8322 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4615fa5639440fc820498f897adf17d in term 1.
I20260505 20:13:31.780782 7400 leader_election.cc:304] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98, f4615fa5639440fc820498f897adf17d; no voters:
I20260505 20:13:31.781069 8734 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:31.781194 8734 raft_consensus.cc:493] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73028cd481e446daa9432a35522a7967)
I20260505 20:13:31.781288 8734 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:31.782630 8058 ts_tablet_manager.cc:1434] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260505 20:13:31.783149 8058 tablet_bootstrap.cc:492] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.784824 8058 tablet_bootstrap.cc:654] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.785181 8734 raft_consensus.cc:515] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:31.788666 8734 leader_election.cc:290] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 election: Requested vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:31.789233 8322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4615fa5639440fc820498f897adf17d" candidate_term: 2 candidate_status { last_received { term: 1 index: 602 } } ignore_live_leader: false dest_uuid: "29603775b6d74153b21e0bbcc535ff98"
I20260505 20:13:31.789436 8322 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:31.790198 8054 tablet_bootstrap.cc:492] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.790371 8054 ts_tablet_manager.cc:1403] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.013s
I20260505 20:13:31.791153 8054 raft_consensus.cc:359] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.791275 8718 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.791361 8054 raft_consensus.cc:385] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.791430 8054 raft_consensus.cc:740] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.791404 8718 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.791668 8054 consensus_queue.cc:260] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.792021 8718 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.792156 8054 ts_tablet_manager.cc:1434] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:31.792514 8054 tablet_bootstrap.cc:492] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.792577 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.792801 7933 raft_consensus.cc:2393] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:31.793726 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.794320 8054 tablet_bootstrap.cc:654] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.794293 7736 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:31.794682 8718 raft_consensus.cc:3060] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.795248 8322 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4615fa5639440fc820498f897adf17d in term 2.
I20260505 20:13:31.795367 8052 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42664 (request call id 480) took 1623 ms. Trace:
I20260505 20:13:31.795469 8052 rpcz_store.cc:276] 0505 20:13:30.171912 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:30.175831 (+ 3919us) service_pool.cc:224] Handling call
0505 20:13:31.766574 (+1590743us) ts_tablet_manager.cc:1151] Deleting tablet beb404fa927641f48f28c6bdaa297db3
0505 20:13:31.766586 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:31.773629 (+ 7043us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.776783 (+ 3154us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:31.795302 (+ 18519us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1590392}
I20260505 20:13:31.797458 8718 raft_consensus.cc:2749] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:31.801796 7400 leader_election.cc:304] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98, f4615fa5639440fc820498f897adf17d; no voters:
I20260505 20:13:31.802146 8734 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:31.802579 8639 consensus_queue.cc:1048] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.803192 8053 tablet_bootstrap.cc:492] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.803265 8054 tablet_bootstrap.cc:492] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.803406 8054 ts_tablet_manager.cc:1403] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260505 20:13:31.804186 8054 raft_consensus.cc:359] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.804353 8054 raft_consensus.cc:385] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.804432 8054 raft_consensus.cc:740] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.804623 8054 consensus_queue.cc:260] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.805343 8054 ts_tablet_manager.cc:1434] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:31.807142 8053 ts_tablet_manager.cc:1403] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260505 20:13:31.808024 8053 raft_consensus.cc:359] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.808254 8053 raft_consensus.cc:385] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.808331 8053 raft_consensus.cc:740] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.809917 8639 consensus_queue.cc:1048] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.808578 8053 consensus_queue.cc:260] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.815575 8054 tablet_bootstrap.cc:492] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.816098 8053 ts_tablet_manager.cc:1434] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260505 20:13:31.816445 8053 tablet_bootstrap.cc:492] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.820627 8058 tablet_bootstrap.cc:492] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.821645 8058 ts_tablet_manager.cc:1403] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260505 20:13:31.821810 8054 tablet_bootstrap.cc:654] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.822604 8058 raft_consensus.cc:359] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.823972 8058 raft_consensus.cc:385] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.824082 8058 raft_consensus.cc:740] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.825067 8058 consensus_queue.cc:260] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.826364 8058 ts_tablet_manager.cc:1434] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:31.826766 8058 tablet_bootstrap.cc:492] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.827404 8718 raft_consensus.cc:493] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.827612 8718 raft_consensus.cc:515] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.828675 7802 raft_consensus.cc:3060] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:31.830256 7737 leader_election.cc:343] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c6acad22190b402d892d06ff97bd9476
I20260505 20:13:31.830564 8718 leader_election.cc:290] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.830827 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6acad22190b402d892d06ff97bd9476" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.831048 7664 raft_consensus.cc:2468] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:31.831243 8054 tablet_bootstrap.cc:492] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.831429 8054 ts_tablet_manager.cc:1403] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260505 20:13:31.831498 7736 leader_election.cc:304] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:31.831926 8718 raft_consensus.cc:2804] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.832041 8718 raft_consensus.cc:493] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.832149 8718 raft_consensus.cc:3060] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.832296 8054 raft_consensus.cc:359] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.832499 8054 raft_consensus.cc:385] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.832583 8054 raft_consensus.cc:740] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.832551 8619 consensus_queue.cc:1048] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.835306 8718 raft_consensus.cc:515] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.836084 8734 raft_consensus.cc:697] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 2 LEADER]: Becoming Leader. State: Replica: f4615fa5639440fc820498f897adf17d, State: Running, Role: LEADER
I20260505 20:13:31.836426 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6acad22190b402d892d06ff97bd9476" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.836609 7661 raft_consensus.cc:3060] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.836791 8734 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 602, Committed index: 602, Last appended: 1.602, Last appended by leader: 602, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:31.839787 7661 raft_consensus.cc:2468] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:31.841328 7736 leader_election.cc:304] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.841678 8616 raft_consensus.cc:2804] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.841849 8616 raft_consensus.cc:697] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:31.842108 8616 consensus_queue.cc:237] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.848380 8054 consensus_queue.cc:260] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.849339 8054 ts_tablet_manager.cc:1434] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.018s user 0.001s sys 0.002s
I20260505 20:13:31.850673 8718 leader_election.cc:290] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.850832 8619 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.850996 8619 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.851152 8754 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4615fa5639440fc820498f897adf17d. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:31.851433 8754 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:31.851713 8619 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.852726 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.853287 7869 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.853791 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.854110 7664 raft_consensus.cc:2468] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.856127 8053 tablet_bootstrap.cc:654] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.856637 7870 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.857106 8619 raft_consensus.cc:2804] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.857229 8619 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.857342 8619 raft_consensus.cc:3060] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:31.860613 7737 leader_election.cc:343] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: c6acad22190b402d892d06ff97bd9476
I20260505 20:13:31.862898 8058 tablet_bootstrap.cc:654] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.863986 8619 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.865275 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.866395 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.867341 7869 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.867586 8054 tablet_bootstrap.cc:492] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.870206 8619 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.871243 8054 tablet_bootstrap.cc:654] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.872267 8692 raft_consensus.cc:493] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.872565 8692 raft_consensus.cc:515] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.873178 8692 leader_election.cc:290] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.874121 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74dbab83b840d9b2bd103e946d3032" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.874308 7933 raft_consensus.cc:2468] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.874331 8760 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260505 20:13:31.874643 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74dbab83b840d9b2bd103e946d3032" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.875182 7598 leader_election.cc:304] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:31.875594 7596 leader_election.cc:343] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.875852 7661 raft_consensus.cc:3060] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.878685 7661 raft_consensus.cc:2468] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.879177 7870 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.879906 8619 raft_consensus.cc:2804] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.880062 8619 raft_consensus.cc:697] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.880321 8619 consensus_queue.cc:237] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.881577 8692 raft_consensus.cc:2804] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.881670 8692 raft_consensus.cc:493] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.881793 8692 raft_consensus.cc:3060] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.884694 8692 raft_consensus.cc:515] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.885903 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74dbab83b840d9b2bd103e946d3032" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.886080 7933 raft_consensus.cc:3060] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.888906 7933 raft_consensus.cc:2468] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.889385 7598 leader_election.cc:304] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.889734 8557 raft_consensus.cc:2804] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.889943 8557 raft_consensus.cc:697] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.890312 8557 consensus_queue.cc:237] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.890587 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74dbab83b840d9b2bd103e946d3032" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:31.891211 7596 leader_election.cc:343] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.891407 8692 leader_election.cc:290] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.907166 8619 consensus_queue.cc:1048] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:31.907361 8053 tablet_bootstrap.cc:492] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.907512 8053 ts_tablet_manager.cc:1403] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.091s user 0.000s sys 0.016s
I20260505 20:13:31.908667 8053 raft_consensus.cc:359] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.908869 8053 raft_consensus.cc:385] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.908972 8053 raft_consensus.cc:740] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.909207 8053 consensus_queue.cc:260] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.909765 8053 ts_tablet_manager.cc:1434] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:31.910109 8053 tablet_bootstrap.cc:492] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:31.912053 8053 tablet_bootstrap.cc:654] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.913847 8619 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.914019 8619 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.915405 8619 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.915530 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:31.916155 7869 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.916157 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.916460 7663 raft_consensus.cc:2468] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.917032 7870 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.917402 8619 raft_consensus.cc:2804] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.917533 8619 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.917677 8619 raft_consensus.cc:3060] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.930310 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]
I20260505 20:13:31.931434 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a62884f24a7b450e86c9ec17c75bd041 [id=01f0244c225b47459ca461d8b3c0bde3]
I20260505 20:13:31.931943 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]
I20260505 20:13:31.932096 8619 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.933146 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:31.933161 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:31.933403 7663 raft_consensus.cc:3060] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:31.933636 7869 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.934917 8058 tablet_bootstrap.cc:492] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.935727 8619 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.935108 8058 ts_tablet_manager.cc:1403] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.108s user 0.002s sys 0.004s
I20260505 20:13:31.936452 7663 raft_consensus.cc:2468] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:31.936739 8054 tablet_bootstrap.cc:492] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.936882 8054 ts_tablet_manager.cc:1403] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.003s
I20260505 20:13:31.937321 7870 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.937378 8058 raft_consensus.cc:359] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.937558 8058 raft_consensus.cc:385] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.937634 8058 raft_consensus.cc:740] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.937654 8054 raft_consensus.cc:359] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.937853 8054 raft_consensus.cc:385] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.937950 8054 raft_consensus.cc:740] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.937909 8058 consensus_queue.cc:260] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.939025 8619 raft_consensus.cc:2804] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.939307 8619 raft_consensus.cc:697] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:31.939625 8619 consensus_queue.cc:237] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.942432 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_2036d69d672348c0b08335df0c49d801 [id=045845bc74254e53ba6f9ede9e6d4a0b]
I20260505 20:13:31.943248 8058 ts_tablet_manager.cc:1434] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260505 20:13:31.943560 8058 tablet_bootstrap.cc:492] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.943938 8054 consensus_queue.cc:260] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.944618 8054 ts_tablet_manager.cc:1434] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260505 20:13:31.944073 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]
I20260505 20:13:31.944942 8054 tablet_bootstrap.cc:492] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.945459 8058 tablet_bootstrap.cc:654] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.946717 8054 tablet_bootstrap.cc:654] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.951987 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_9875a3e2f0d444018fb87797fd4bcde6 [id=0b04ae6c921741049ea506fe8323865c]
I20260505 20:13:31.953222 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4]
I20260505 20:13:31.959350 8053 tablet_bootstrap.cc:492] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:31.959570 8053 ts_tablet_manager.cc:1403] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.050s user 0.009s sys 0.015s
I20260505 20:13:31.960433 8557 raft_consensus.cc:493] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.960618 8557 raft_consensus.cc:515] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.961315 8557 leader_election.cc:290] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.962427 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.962687 7933 raft_consensus.cc:2468] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.963047 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:31.963773 8054 tablet_bootstrap.cc:492] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.963981 8054 ts_tablet_manager.cc:1403] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.004s
I20260505 20:13:31.964627 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_070bf3473ab74c31b33db173e8f39d20 [id=12eca25cabd8420aa872cd90cdc4dc03]
I20260505 20:13:31.964812 8054 raft_consensus.cc:359] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.965020 8054 raft_consensus.cc:385] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.965088 8054 raft_consensus.cc:740] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.965368 8054 consensus_queue.cc:260] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:31.965665 7596 leader_election.cc:343] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:31.966164 8054 ts_tablet_manager.cc:1434] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:31.966382 7598 leader_election.cc:304] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:31.966522 8054 tablet_bootstrap.cc:492] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.968466 8557 raft_consensus.cc:2804] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.968582 8557 raft_consensus.cc:493] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.968677 8054 tablet_bootstrap.cc:654] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.968688 8557 raft_consensus.cc:3060] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.968832 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_b05a62cc3a7e446e915328413ead238d [id=13c456c402f444bc97f01c7428024341]
I20260505 20:13:31.969296 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]
I20260505 20:13:31.970398 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]
I20260505 20:13:31.970804 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]
I20260505 20:13:31.971436 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_2abcfc3982a14ad59d71192e56a1f1d9 [id=2514754262884627a95e5da503db0535]
I20260505 20:13:31.972729 8058 tablet_bootstrap.cc:492] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:31.972878 8058 ts_tablet_manager.cc:1403] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.010s
I20260505 20:13:31.973660 8058 raft_consensus.cc:359] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.973888 8058 raft_consensus.cc:385] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.973973 8058 raft_consensus.cc:740] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.974888 8557 raft_consensus.cc:515] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.976686 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:31.976895 7933 raft_consensus.cc:3060] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.978134 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]
I20260505 20:13:31.978574 8557 leader_election.cc:290] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.978744 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_28a64c3b83d5413c8d946d129380d5a1 [id=272374ee2a7a45c5ba51d6dd477f4f86]
I20260505 20:13:31.979183 8053 raft_consensus.cc:359] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.979401 8053 raft_consensus.cc:385] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.979476 8053 raft_consensus.cc:740] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.979712 8053 consensus_queue.cc:260] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.980228 8053 ts_tablet_manager.cc:1434] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260505 20:13:31.980367 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a [id=2933b254aea045eaa6d04f0fc88a5890]
I20260505 20:13:31.980835 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_b9ccf3e9460f4ba28802602c516ab4af [id=2935a29adff5403aab513a78d1a7faac]
I20260505 20:13:31.981652 7933 raft_consensus.cc:2468] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:31.982036 8058 consensus_queue.cc:260] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.982681 8058 ts_tablet_manager.cc:1434] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260505 20:13:31.982653 7598 leader_election.cc:304] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.982971 8693 raft_consensus.cc:2804] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:31.983158 8693 raft_consensus.cc:697] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:31.983464 8693 consensus_queue.cc:237] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.985023 8692 raft_consensus.cc:493] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.985188 8692 raft_consensus.cc:515] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.985370 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_6d292d45d5d24556b062b5b0fd05a0b1 [id=2b4a4163adc847139f13c1221f58d86a]
I20260505 20:13:31.985831 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb [id=2c8ae910936748198e221a7864a4ccf6]
I20260505 20:13:31.985710 8692 leader_election.cc:290] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.986646 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a73fbe5892774352b079b4b0ce80d9c3 [id=2caf3e7ce2e84c259297c6e06ddf26a9]
I20260505 20:13:31.987429 8058 tablet_bootstrap.cc:492] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:31.987416 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]
I20260505 20:13:31.988065 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]
I20260505 20:13:31.989001 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea726cff03664c3d81b5e541ef738d4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.989252 7933 raft_consensus.cc:2468] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:31.989704 8619 raft_consensus.cc:493] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.989894 8619 raft_consensus.cc:515] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:31.990182 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_efe2580fbb5b4113b2ba4580914aacc4 [id=3392dc17dfb345459b94ec7f28fb17b4]
I20260505 20:13:31.990612 8619 leader_election.cc:290] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:31.990893 7598 leader_election.cc:304] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.991010 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ce82aca20d44819f28785322e935ae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.991184 8054 tablet_bootstrap.cc:492] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:31.991186 8692 raft_consensus.cc:2804] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.991285 8692 raft_consensus.cc:493] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.991353 8054 ts_tablet_manager.cc:1403] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.002s
I20260505 20:13:31.991405 8692 raft_consensus.cc:3060] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.992179 8054 raft_consensus.cc:359] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.992362 8054 raft_consensus.cc:385] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:31.992450 8054 raft_consensus.cc:740] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:31.992663 8054 consensus_queue.cc:260] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.993208 8054 ts_tablet_manager.cc:1434] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:31.993477 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_85b92a55020a404f80a0290495181ab3 [id=33b67547f90545a99f9fedd756cbf001]
I20260505 20:13:31.991195 7663 raft_consensus.cc:2468] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:31.994067 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_d3f51622819c4146803605c7494da89e [id=33e3959f29394995be644ddc2dcf0585]
I20260505 20:13:31.994410 7870 leader_election.cc:304] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:31.994475 8718 raft_consensus.cc:493] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:31.994609 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_776d125a74a244a89a055dcff3489919 [id=33fc6a636c5649dba50f235c90a0019d]
I20260505 20:13:31.994689 8619 raft_consensus.cc:2804] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:31.994637 8718 raft_consensus.cc:515] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.994786 8619 raft_consensus.cc:493] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:31.994884 8619 raft_consensus.cc:3060] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:31.995204 8718 leader_election.cc:290] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.995272 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_53010b8cbf5e426590b4f82d68e96660 [id=3505dd62d0f747cb93b233259fadc6ef]
I20260505 20:13:31.995711 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]
I20260505 20:13:31.995790 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:31.997177 8692 raft_consensus.cc:515] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:31.998243 8692 leader_election.cc:290] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:31.998282 8054 tablet_bootstrap.cc:492] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:31.989714 8058 tablet_bootstrap.cc:654] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:31.998867 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944bc61fe79c4f94bb280dae8e3cee59" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:31.999105 7935 raft_consensus.cc:2393] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:32.000072 8054 tablet_bootstrap.cc:654] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.006392 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea726cff03664c3d81b5e541ef738d4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:32.006604 7933 raft_consensus.cc:3060] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.009461 7933 raft_consensus.cc:2468] T ea726cff03664c3d81b5e541ef738d4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:32.010071 7598 leader_election.cc:304] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:32.010188 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ce82aca20d44819f28785322e935ae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.010411 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea726cff03664c3d81b5e541ef738d4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:32.010689 7797 raft_consensus.cc:3060] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.011322 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:32.013572 8639 raft_consensus.cc:493] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.013715 8639 raft_consensus.cc:515] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.014468 8639 leader_election.cc:290] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.016417 8557 raft_consensus.cc:2804] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:32.016819 7869 leader_election.cc:343] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.016846 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a82a9d144746338b3fc6550aa35d3c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.017052 7663 raft_consensus.cc:2468] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.017894 8619 raft_consensus.cc:515] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.018553 8619 leader_election.cc:290] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.010414 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea726cff03664c3d81b5e541ef738d4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.019517 7797 raft_consensus.cc:2468] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:32.020025 7737 leader_election.cc:304] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.020884 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ce82aca20d44819f28785322e935ae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.021486 7869 leader_election.cc:343] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.021827 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a82a9d144746338b3fc6550aa35d3c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.022518 7869 leader_election.cc:343] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.022887 8692 consensus_queue.cc:1048] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.023134 8718 raft_consensus.cc:3060] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.023828 8693 consensus_queue.cc:1048] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.024073 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_833aef6a6ffc466c8f56b9bee24bf1a2 [id=3734c4511d224584aeed0efd6bac453d]
I20260505 20:13:32.026391 8718 raft_consensus.cc:2749] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.029224 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]
I20260505 20:13:32.029898 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_318c908c4ab241c09ed344cd15203aea [id=3a774ed366a4499683d2c81d149d0dcf]
I20260505 20:13:32.034710 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_58b87c163c1f49a89a9bc55d655baf2f [id=42fd7d09cb3e448e9be4b7d49262f43e]
I20260505 20:13:32.037994 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]
I20260505 20:13:32.039186 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]
I20260505 20:13:32.042284 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]
I20260505 20:13:32.043462 8053 tablet_bootstrap.cc:492] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.043457 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]
I20260505 20:13:32.044927 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853]
I20260505 20:13:32.045640 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]
I20260505 20:13:32.045684 8053 tablet_bootstrap.cc:654] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.046224 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_5eb1b00bd31442779cd50c207d3a2b1e [id=49103ea0eb57491fa5482997379eda9b]
I20260505 20:13:32.046751 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]
I20260505 20:13:32.047513 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]
I20260505 20:13:32.048106 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_1f4c5959987145b594d24feb4eb6a4d1 [id=4b76ab7e66f34e8d876aff5a0f59840c]
I20260505 20:13:32.048687 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_4dda980af4a44fb3b08d9845bc9a4c2f [id=4c8b13827e834d51b935d4110f5628a1]
W20260505 20:13:32.051141 7596 leader_election.cc:343] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.051582 7596 consensus_peers.cc:597] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b596f03adbea413b813c9037d4243fae. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.051975 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_c0743365402b4252bd3c5c7a95a9e5ee [id=5579cbeef0624d4a8cb8beeac55362e9]
I20260505 20:13:32.052314 7870 leader_election.cc:304] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.052707 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_6d4b2501aefb48ae90019d3bfdb71a24 [id=5945251171634214a7e24933d7768727]
I20260505 20:13:32.052966 8619 raft_consensus.cc:2804] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.053154 8619 raft_consensus.cc:493] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.053349 8619 raft_consensus.cc:3060] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.054443 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]
I20260505 20:13:32.054728 8557 raft_consensus.cc:697] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:32.054957 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]
I20260505 20:13:32.055209 8557 consensus_queue.cc:237] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.055881 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_3f1f3578e45142bd8308041182d62265 [id=629d3a81e86945f48e462550aa1b1fee]
I20260505 20:13:32.056321 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_fde64ff0b9514797968ea93a1a179537 [id=62c3b4c1b9724e089448906fab7435c0]
I20260505 20:13:32.056596 8619 raft_consensus.cc:515] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.056921 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]
I20260505 20:13:32.057402 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_e9946c00ab714ea2b40bf99ce829d482 [id=646b864647ff42838a8cdc969b72bf7b]
I20260505 20:13:32.058251 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_3a544b60f38745948e6026aeaa005366 [id=65cc6685c1474b129203568616b14e8b]
W20260505 20:13:32.058316 7329 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 506b421a774c4929813205dba0fac32b consensus state has no leader
I20260505 20:13:32.059219 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_ac5b74d3d36f45ec9885c20f92938f45 [id=67accc85180f48418217cf187d1fee88]
I20260505 20:13:32.059383 8619 leader_election.cc:290] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.059182 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a82a9d144746338b3fc6550aa35d3c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:32.061270 7799 raft_consensus.cc:3060] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:32.065980 7869 leader_election.cc:343] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.068912 7372 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:50252 (request call id 31) took 927 ms (client timeout 1000 ms). Trace:
I20260505 20:13:32.069010 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ce82aca20d44819f28785322e935ae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.069237 7663 raft_consensus.cc:3060] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:32.069083 7372 rpcz_store.cc:269] 0505 20:13:31.141111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:31.141181 (+ 70us) service_pool.cc:224] Handling call
0505 20:13:32.068853 (+927672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:32.072134 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a82a9d144746338b3fc6550aa35d3c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.072343 7661 raft_consensus.cc:3060] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.072700 8322 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Rejecting Update request from peer 73028cd481e446daa9432a35522a7967 for earlier term 1. Current term is 2. Ops: [1.602-1.602]
I20260505 20:13:32.075531 8557 consensus_queue.cc:1048] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.076007 7661 raft_consensus.cc:2468] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.077790 7336 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Sending DeleteTablet for 3 replicas of tablet 1aaff49cb0ff4298be24603b2015c8a4
I20260505 20:13:32.077873 7663 raft_consensus.cc:2468] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.079164 7326 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 923ed274fe454cc4a625516769e6b5f3 (table default.Table_b8dc23a61d1044d387ba34de22f570cb [id=580de9a798e54694a39a898d5fe4ab1b]) successfully deleted
W20260505 20:13:32.079344 7326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 915173us
I20260505 20:13:32.079546 8058 tablet_bootstrap.cc:492] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.082190 8058 ts_tablet_manager.cc:1403] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.092s user 0.006s sys 0.002s
W20260505 20:13:32.083791 7328 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet e32ff17c39f04bc2b1c9c37a1165399b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32ff17c39f04bc2b1c9c37a1165399b already in progress: creating tablet
W20260505 20:13:32.084012 7328 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 928709us
I20260505 20:13:32.084935 7303 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskf21k8s/build/asan/bin/kudu with pid 7311
I20260505 20:13:32.085788 8053 tablet_bootstrap.cc:492] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.085947 8053 ts_tablet_manager.cc:1403] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.005s
I20260505 20:13:32.086035 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47490
I20260505 20:13:32.090329 8776 consensus_queue.cc:1048] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.091095 7870 leader_election.cc:304] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.091524 8639 raft_consensus.cc:2804] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.091696 8639 raft_consensus.cc:697] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.091959 8639 consensus_queue.cc:237] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.099126 8058 raft_consensus.cc:359] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.099462 8058 raft_consensus.cc:385] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.099562 8058 raft_consensus.cc:740] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.100183 7870 leader_election.cc:304] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.100636 8619 raft_consensus.cc:2804] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.100899 8619 raft_consensus.cc:697] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.101197 8619 consensus_queue.cc:237] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.103439 7798 raft_consensus.cc:3060] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.104103 8054 tablet_bootstrap.cc:492] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.104265 8054 ts_tablet_manager.cc:1403] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.106s user 0.007s sys 0.020s
I20260505 20:13:32.105216 8054 raft_consensus.cc:359] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.105396 8054 raft_consensus.cc:385] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.105479 8054 raft_consensus.cc:740] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.105903 8054 consensus_queue.cc:260] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.106407 8054 ts_tablet_manager.cc:1434] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:32.107569 8692 consensus_queue.cc:1048] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.110109 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_df8877e563ff4aa49f6f201934596c59 [id=68a78a47955345e5832fbef128cbe20e]
I20260505 20:13:32.113956 8557 consensus_queue.cc:1048] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.114499 8054 tablet_bootstrap.cc:492] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.116304 8054 tablet_bootstrap.cc:654] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:32.116477 7737 consensus_peers.cc:597] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 944aad58d3c14577a0c66edd95fdf5e0. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.117952 8058 consensus_queue.cc:260] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.118477 8058 ts_tablet_manager.cc:1434] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20260505 20:13:32.118916 8058 tablet_bootstrap.cc:492] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.120735 8058 tablet_bootstrap.cc:654] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.125157 8053 raft_consensus.cc:359] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.125367 8053 raft_consensus.cc:385] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.125270 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7ef38a3fc00f4cdca3666e9359a5fb38 [id=6907b9983088424f8bcc957773626fb4]
I20260505 20:13:32.125481 8053 raft_consensus.cc:740] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.125725 8053 consensus_queue.cc:260] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.129410 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_d35a015103974aae8ba25b644b320d5e [id=6d62e1270ed54b76aaff276b11d04c2f]
I20260505 20:13:32.130188 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e]
I20260505 20:13:32.132094 8619 raft_consensus.cc:493] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.132248 8619 raft_consensus.cc:515] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.132901 8619 leader_election.cc:290] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.134233 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a8adf31bc94a33a61468adf2673681" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.134476 7663 raft_consensus.cc:2468] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.135210 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a8adf31bc94a33a61468adf2673681" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.137651 7869 leader_election.cc:343] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.142917 7870 leader_election.cc:304] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.143409 8619 raft_consensus.cc:2804] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.143532 8619 raft_consensus.cc:493] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.143630 8619 raft_consensus.cc:3060] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.145033 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_6668622814b7401689dd9dfecee3a8b9 [id=74178f7425164618bd69a1653b75e5d1]
I20260505 20:13:32.146186 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a5f6228ca6384c5b88cd9242e5d25334 [id=74c243106f024592ac3c7ad007a462e2]
I20260505 20:13:32.147406 8619 raft_consensus.cc:515] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:32.148048 8261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.33.254:38755 timed out after 0.507s (SENT)
I20260505 20:13:32.151365 8619 leader_election.cc:290] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.151410 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a8adf31bc94a33a61468adf2673681" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.152107 7869 leader_election.cc:343] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.158303 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a8adf31bc94a33a61468adf2673681" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.158584 7663 raft_consensus.cc:3060] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.160768 8053 ts_tablet_manager.cc:1434] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.075s user 0.000s sys 0.002s
I20260505 20:13:32.161106 8053 tablet_bootstrap.cc:492] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.161577 7663 raft_consensus.cc:2468] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.166136 8053 tablet_bootstrap.cc:654] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.169793 8639 raft_consensus.cc:493] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.152055 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_07cd2eeb8ed74e90ac630e511f01ccb5 [id=758c5b8d77d649beb11a2d8a3d40e1e0]
I20260505 20:13:32.170086 8639 raft_consensus.cc:515] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.170475 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_3c329f8225c0482ba66b8cb2bece4f84 [id=76c82dc9119c4120bb27ac4b61c9f8fe]
I20260505 20:13:32.170828 8058 tablet_bootstrap.cc:492] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.170995 8058 ts_tablet_manager.cc:1403] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.001s
I20260505 20:13:32.171670 8639 leader_election.cc:290] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.171761 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34883b630a87480f953facb44615ef65" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.171878 8058 raft_consensus.cc:359] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.172048 8058 raft_consensus.cc:385] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.172147 8058 raft_consensus.cc:740] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.172371 8058 consensus_queue.cc:260] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:32.172407 7869 leader_election.cc:343] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.172602 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4 [id=7ae883240f114c1f96e48ac234286977]
I20260505 20:13:32.172845 8058 ts_tablet_manager.cc:1434] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:32.174185 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]
I20260505 20:13:32.174292 8054 tablet_bootstrap.cc:492] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.174437 8054 ts_tablet_manager.cc:1403] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.068s user 0.021s sys 0.010s
I20260505 20:13:32.174525 8058 tablet_bootstrap.cc:492] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.175257 8054 raft_consensus.cc:359] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.175432 8054 raft_consensus.cc:385] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.175529 8054 raft_consensus.cc:740] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.175776 8054 consensus_queue.cc:260] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.176313 8054 ts_tablet_manager.cc:1434] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:32.176481 8058 tablet_bootstrap.cc:654] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.180164 8054 tablet_bootstrap.cc:492] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.181967 8054 tablet_bootstrap.cc:654] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.186467 8053 tablet_bootstrap.cc:492] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.186650 8053 ts_tablet_manager.cc:1403] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.003s
I20260505 20:13:32.187498 8053 raft_consensus.cc:359] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.187718 8053 raft_consensus.cc:385] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.187798 8053 raft_consensus.cc:740] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.188007 8616 raft_consensus.cc:493] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.188073 8053 consensus_queue.cc:260] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.188184 8616 raft_consensus.cc:515] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.188598 8053 ts_tablet_manager.cc:1434] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:32.188830 8616 leader_election.cc:290] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.188974 8053 tablet_bootstrap.cc:492] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.190949 8053 tablet_bootstrap.cc:654] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:32.191818 7737 leader_election.cc:343] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:32.192571 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a42f0b6dc74cbd8d72ae36410f9d35" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.192812 7663 raft_consensus.cc:2468] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:32.193238 7736 leader_election.cc:304] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:32.193771 8616 raft_consensus.cc:2804] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.193874 8616 raft_consensus.cc:493] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.193956 8616 raft_consensus.cc:3060] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.196758 8616 raft_consensus.cc:515] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.198611 8775 consensus_queue.cc:1048] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.199890 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a42f0b6dc74cbd8d72ae36410f9d35" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.200124 7663 raft_consensus.cc:3060] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.203706 8616 leader_election.cc:290] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:32.204008 7737 leader_election.cc:343] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:32.204208 7663 raft_consensus.cc:2468] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:32.204826 7736 leader_election.cc:304] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:32.205483 8616 raft_consensus.cc:2804] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.205708 8616 raft_consensus.cc:697] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:32.206450 8616 consensus_queue.cc:237] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.210964 7870 leader_election.cc:304] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.211380 8639 raft_consensus.cc:2804] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.211550 8639 raft_consensus.cc:697] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.211823 8639 consensus_queue.cc:237] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.212280 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34883b630a87480f953facb44615ef65" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.212592 7663 raft_consensus.cc:2468] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.214901 7870 leader_election.cc:304] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.215256 8619 raft_consensus.cc:2804] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.215355 8619 raft_consensus.cc:493] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.215444 8619 raft_consensus.cc:3060] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.218358 8619 raft_consensus.cc:515] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.219413 8619 leader_election.cc:290] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.219565 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34883b630a87480f953facb44615ef65" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.220114 7869 leader_election.cc:343] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.221180 7598 consensus_peers.cc:597] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b596f03adbea413b813c9037d4243fae. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.223066 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34883b630a87480f953facb44615ef65" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.223412 7663 raft_consensus.cc:3060] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.227152 7663 raft_consensus.cc:2468] T 34883b630a87480f953facb44615ef65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.228040 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_d3355f0e778c4b8d86fe948da69b1976 [id=7e050176e69345a8ba527b6fa0d49da3]
I20260505 20:13:32.229346 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_d6ce8f7d9fd1457790462b4950bcee3d [id=7f07fbb5d4444ed3b62702530ed4610a]
I20260505 20:13:32.235654 8639 raft_consensus.cc:493] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.237548 8639 raft_consensus.cc:515] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.238095 8053 tablet_bootstrap.cc:492] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.238262 8053 ts_tablet_manager.cc:1403] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.049s user 0.021s sys 0.004s
I20260505 20:13:32.239058 8639 leader_election.cc:290] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.239086 8053 raft_consensus.cc:359] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.239295 8053 raft_consensus.cc:385] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.239411 8053 raft_consensus.cc:740] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.239359 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.239928 7869 leader_election.cc:343] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.242192 8053 consensus_queue.cc:260] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.243360 8053 ts_tablet_manager.cc:1434] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:32.243654 8053 tablet_bootstrap.cc:492] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.245507 8053 tablet_bootstrap.cc:654] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.247243 8054 tablet_bootstrap.cc:492] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.247411 8054 ts_tablet_manager.cc:1403] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.067s user 0.006s sys 0.021s
I20260505 20:13:32.248270 8054 raft_consensus.cc:359] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.248492 8054 raft_consensus.cc:385] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.248602 8054 raft_consensus.cc:740] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.248842 8054 consensus_queue.cc:260] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.251001 8054 ts_tablet_manager.cc:1434] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:32.251310 8054 tablet_bootstrap.cc:492] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.253098 8054 tablet_bootstrap.cc:654] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.256826 8053 tablet_bootstrap.cc:492] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.257019 8053 ts_tablet_manager.cc:1403] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260505 20:13:32.257910 8053 raft_consensus.cc:359] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.258121 8053 raft_consensus.cc:385] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.258194 8053 raft_consensus.cc:740] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.258450 8053 consensus_queue.cc:260] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.259503 8053 ts_tablet_manager.cc:1434] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:32.260217 8053 tablet_bootstrap.cc:492] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.262046 8053 tablet_bootstrap.cc:654] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.247249 8058 tablet_bootstrap.cc:492] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.256593 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.265036 8692 consensus_queue.cc:1048] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.266438 8058 ts_tablet_manager.cc:1403] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.006s
I20260505 20:13:32.266862 8616 raft_consensus.cc:493] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.267130 8616 raft_consensus.cc:515] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.267467 8058 raft_consensus.cc:359] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.267740 8058 raft_consensus.cc:385] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.267835 8058 raft_consensus.cc:740] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.268066 8058 consensus_queue.cc:260] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.268647 8058 ts_tablet_manager.cc:1434] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:32.269035 7802 raft_consensus.cc:3060] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.272928 8639 consensus_queue.cc:1048] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.273020 7870 leader_election.cc:304] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:32.273732 7870 leader_election.cc:343] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.273878 7870 leader_election.cc:304] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.274255 8619 raft_consensus.cc:2804] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.274412 8619 raft_consensus.cc:697] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.274459 8668 raft_consensus.cc:2749] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.274673 8619 consensus_queue.cc:237] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.275195 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6166653cbc58470c8ba4926048ba1384" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.275470 7661 raft_consensus.cc:2393] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:32.276535 8616 leader_election.cc:290] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.276626 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6166653cbc58470c8ba4926048ba1384" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:32.277267 7737 leader_election.cc:304] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.277570 8605 raft_consensus.cc:3060] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.278066 8058 tablet_bootstrap.cc:492] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.280304 8605 raft_consensus.cc:2749] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.280524 8058 tablet_bootstrap.cc:654] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:32.235428 7399 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.33.254:38755 timed out after 0.517s (SENT) [suppressed 4 similar messages]
I20260505 20:13:32.290513 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_aa714545b11e4ed3a0e546cddc77be98 [id=7fd3bc8f4d484299a9a21b95ada7e77f]
I20260505 20:13:32.294263 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_bc0ac75d0a8d46caa8026d33f784689d [id=81cca356ac0a4576af3226017a09f6f1]
I20260505 20:13:32.294574 8692 consensus_queue.cc:1048] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260505 20:13:32.299206 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_62aece033038452d8dd6e128877cc4e7 [id=835704ef17524d9683187bdaa11d3181]
I20260505 20:13:32.304493 8058 tablet_bootstrap.cc:492] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.304724 8058 ts_tablet_manager.cc:1403] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.005s
I20260505 20:13:32.305778 8058 raft_consensus.cc:359] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.306013 8058 raft_consensus.cc:385] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.306106 8058 raft_consensus.cc:740] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.306381 8058 consensus_queue.cc:260] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.307091 8058 ts_tablet_manager.cc:1434] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260505 20:13:32.305575 7399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 70179.4us
I20260505 20:13:32.312034 8058 tablet_bootstrap.cc:492] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.316943 8639 consensus_queue.cc:1048] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.317952 8058 tablet_bootstrap.cc:654] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.326380 8058 tablet_bootstrap.cc:492] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.326475 8054 tablet_bootstrap.cc:492] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.326566 8058 ts_tablet_manager.cc:1403] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260505 20:13:32.326623 8054 ts_tablet_manager.cc:1403] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.075s user 0.006s sys 0.025s
I20260505 20:13:32.327416 8058 raft_consensus.cc:359] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.327611 8058 raft_consensus.cc:385] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.327575 8054 raft_consensus.cc:359] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.327736 8058 raft_consensus.cc:740] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.327781 8054 raft_consensus.cc:385] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.327878 8054 raft_consensus.cc:740] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.327971 8058 consensus_queue.cc:260] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.328120 8054 consensus_queue.cc:260] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.328452 8058 ts_tablet_manager.cc:1434] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:32.328610 8054 ts_tablet_manager.cc:1434] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:32.328768 8058 tablet_bootstrap.cc:492] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.331748 8639 consensus_queue.cc:1048] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:32.334810 7598 consensus_peers.cc:597] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84fb3dcea55d4b348cbf92c3c4581dda. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.336215 8054 tablet_bootstrap.cc:492] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.336481 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_af907934b9fa4624acbd348b39f0920b [id=838329ded2324129b0955e7cd2d9a662]
I20260505 20:13:32.337076 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_45b02f2afbda4ad88bfc9c41c987aa4b [id=83bea458fe874e78a4168e6820a7f048]
I20260505 20:13:32.337718 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]
I20260505 20:13:32.338177 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_8cc3cc188c8c40d1ac809b3372dca56e [id=8615ba1d02294f9fa642bd1336064950]
I20260505 20:13:32.338400 8054 tablet_bootstrap.cc:654] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.338559 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_833db141dc5a45e683fec596edc857b5 [id=864842f5805c4e8aa36af98c0a5425a3]
I20260505 20:13:32.338997 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54]
I20260505 20:13:32.339454 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]
I20260505 20:13:32.340344 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]
I20260505 20:13:32.341015 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4 [id=89d7fca8e0d64a81964d8dca6676cbb8]
I20260505 20:13:32.341521 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f92fa7cbfb9c470fa562c941ef044c19 [id=89e7a33609724be8b189af017488a9c8]
I20260505 20:13:32.341992 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]
I20260505 20:13:32.343287 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_3b4a78f1dba2415d8d85b7dea798ed28 [id=8f922183d9054257a9e0cb61880d57cf]
I20260505 20:13:32.343870 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]
I20260505 20:13:32.344323 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]
I20260505 20:13:32.344720 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_0f1a1d7075f84270a8c989ffdfc15f6a [id=94c086eb9e3f415086757ebb469ca6c4]
I20260505 20:13:32.345152 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_bd6970923f6943358212e065fee537ea [id=950865299ac7468db8ae8fc687685655]
I20260505 20:13:32.346395 8054 tablet_bootstrap.cc:492] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.346589 8054 ts_tablet_manager.cc:1403] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260505 20:13:32.347407 8054 raft_consensus.cc:359] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.347620 8054 raft_consensus.cc:385] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.347702 8054 raft_consensus.cc:740] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.347965 8054 consensus_queue.cc:260] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.348644 8054 ts_tablet_manager.cc:1434] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:32.348978 8054 tablet_bootstrap.cc:492] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.350848 8054 tablet_bootstrap.cc:654] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.351142 8053 tablet_bootstrap.cc:492] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.351311 8053 ts_tablet_manager.cc:1403] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.091s user 0.013s sys 0.014s
I20260505 20:13:32.353789 8053 raft_consensus.cc:359] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.354017 8053 raft_consensus.cc:385] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.354104 8053 raft_consensus.cc:740] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.354337 8053 consensus_queue.cc:260] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.354959 8053 ts_tablet_manager.cc:1434] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:32.355343 8053 tablet_bootstrap.cc:492] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.356706 8605 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.356856 8605 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.357352 8053 tablet_bootstrap.cc:654] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.357596 8605 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.359274 8054 tablet_bootstrap.cc:492] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.359434 8054 ts_tablet_manager.cc:1403] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260505 20:13:32.359387 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:32.360271 8054 raft_consensus.cc:359] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.360458 8054 raft_consensus.cc:385] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.360553 8054 raft_consensus.cc:740] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.360814 8054 consensus_queue.cc:260] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.361460 8054 ts_tablet_manager.cc:1434] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:32.361789 8054 tablet_bootstrap.cc:492] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.363831 8054 tablet_bootstrap.cc:654] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.367070 8053 tablet_bootstrap.cc:492] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.367256 8053 ts_tablet_manager.cc:1403] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.001s
I20260505 20:13:32.368021 8053 raft_consensus.cc:359] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.368227 8053 raft_consensus.cc:385] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.368304 8053 raft_consensus.cc:740] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.368580 8053 consensus_queue.cc:260] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.370754 8053 ts_tablet_manager.cc:1434] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:32.370815 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_2818c22c9c4d486ea6a43294e850d902 [id=98228933cfdf4f30b5c3431bf704abea]
I20260505 20:13:32.371146 8053 tablet_bootstrap.cc:492] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.371466 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_89dfd83915c249d2bfd6edc8f86c2acf [id=98e304465ac0407c92443491641607f4]
I20260505 20:13:32.371975 8054 tablet_bootstrap.cc:492] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.372131 8054 ts_tablet_manager.cc:1403] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20260505 20:13:32.372187 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_9ee9fc9d6bc948fd90db78cd1670d21f [id=9a219602b64942a8af58f84cf59a5cdb]
I20260505 20:13:32.372850 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3]
I20260505 20:13:32.372977 8053 tablet_bootstrap.cc:654] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.372900 8054 raft_consensus.cc:359] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.373086 8054 raft_consensus.cc:385] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.373154 8054 raft_consensus.cc:740] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.373296 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_1d0db71b969c4ec3b297f64b2d0c71e8 [id=9ad5a74e0c2343c6b0781cf8dbe76f9c]
I20260505 20:13:32.373383 8054 consensus_queue.cc:260] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.373724 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_aeba5817c6974912bf3e49da09fdf85f [id=9b18678ba3204698b9a1c2c214517c50]
I20260505 20:13:32.373999 8054 ts_tablet_manager.cc:1434] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:32.374584 8054 tablet_bootstrap.cc:492] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.375149 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_06b9387992f541f584126cf0be193f38 [id=9cc065df68d949a199bc73be48314f8c]
I20260505 20:13:32.375761 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_314707634b784fa686de6f277f00aec1 [id=9f4a27a994cd4272bc7dd94a1ffde607]
I20260505 20:13:32.376168 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]
I20260505 20:13:32.376226 8054 tablet_bootstrap.cc:654] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.376605 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]
I20260505 20:13:32.377061 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2]
I20260505 20:13:32.377543 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d [id=a441a18b04ef463bb4c69e9e25f1ffd8]
I20260505 20:13:32.382589 8054 tablet_bootstrap.cc:492] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.382748 8054 ts_tablet_manager.cc:1403] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260505 20:13:32.383553 8054 raft_consensus.cc:359] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.383738 8054 raft_consensus.cc:385] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.383823 8054 raft_consensus.cc:740] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.384055 8054 consensus_queue.cc:260] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.384414 8639 raft_consensus.cc:493] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.384553 8639 raft_consensus.cc:515] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.385195 8639 leader_election.cc:290] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.385977 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b966b4bbaf9f4774af96051f857f02f7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.386324 8054 ts_tablet_manager.cc:1434] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260505 20:13:32.386651 7869 leader_election.cc:343] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.387087 8054 tablet_bootstrap.cc:492] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.389441 8054 tablet_bootstrap.cc:654] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.394665 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]
I20260505 20:13:32.395783 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]
I20260505 20:13:32.396533 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]
I20260505 20:13:32.397574 8054 tablet_bootstrap.cc:492] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.397790 8054 ts_tablet_manager.cc:1403] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20260505 20:13:32.397857 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_bf62bacfeaa24c4ca237490e17c20ad8 [id=a89cd6133fe5494cbf2d3520bc8c744a]
I20260505 20:13:32.398840 8054 raft_consensus.cc:359] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.399129 8054 raft_consensus.cc:385] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.399232 8054 raft_consensus.cc:740] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.399530 8054 consensus_queue.cc:260] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.400314 8054 ts_tablet_manager.cc:1434] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:32.400697 8054 tablet_bootstrap.cc:492] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.402798 8054 tablet_bootstrap.cc:654] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.403759 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_38d192fd0ccf420588d860dddcd2394c [id=b11d0432d00747cba7ee33cdf0d4881c]
I20260505 20:13:32.404399 8058 tablet_bootstrap.cc:654] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.405066 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa]
I20260505 20:13:32.406440 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.408443 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7864889bd60f4d50a92b38018c93ca92 [id=b7b0d663a8144e5d8124929fa88a7b62]
I20260505 20:13:32.411566 8054 tablet_bootstrap.cc:492] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.411718 8054 ts_tablet_manager.cc:1403] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260505 20:13:32.412567 8054 raft_consensus.cc:359] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.412757 8054 raft_consensus.cc:385] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.412850 8054 raft_consensus.cc:740] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.413112 8054 consensus_queue.cc:260] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.413679 8054 ts_tablet_manager.cc:1434] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:32.414008 8054 tablet_bootstrap.cc:492] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.414342 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6]
I20260505 20:13:32.415675 8054 tablet_bootstrap.cc:654] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.415176 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]
I20260505 20:13:32.418409 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]
I20260505 20:13:32.426807 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_501dd560884045e79bb35144cae9d817 [id=c75180068c5d4a11805340d9508a2738]
I20260505 20:13:32.427577 7663 raft_consensus.cc:2393] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:32.427811 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]
I20260505 20:13:32.428460 7736 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.429108 8605 raft_consensus.cc:3060] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.433254 8605 raft_consensus.cc:2749] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.434803 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_1088b8bf1039442b9962d35ee73ea794 [id=ca6c4e13eead4e5f9bd6003d9024ebd3]
I20260505 20:13:32.435527 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]
I20260505 20:13:32.435669 8058 tablet_bootstrap.cc:492] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.435882 8058 ts_tablet_manager.cc:1403] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.004s
I20260505 20:13:32.436682 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]
I20260505 20:13:32.436981 8058 raft_consensus.cc:359] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.437206 8058 raft_consensus.cc:385] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.437302 8058 raft_consensus.cc:740] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.437566 8058 consensus_queue.cc:260] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.438298 8058 ts_tablet_manager.cc:1434] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260505 20:13:32.438608 8058 tablet_bootstrap.cc:492] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.438678 8054 tablet_bootstrap.cc:492] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.438840 8054 ts_tablet_manager.cc:1403] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.015s
I20260505 20:13:32.438561 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf [id=ce67d81dbf7049bbb005069ee91d338a]
I20260505 20:13:32.439637 8054 raft_consensus.cc:359] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.439846 8054 raft_consensus.cc:385] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.439927 8054 raft_consensus.cc:740] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.440171 8054 consensus_queue.cc:260] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.440641 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_5cb3708c35b247e2b4ee66f2c5d616d4 [id=cf7b796237cc49b7a6fd29b9cd7c9dd1]
I20260505 20:13:32.440752 8054 ts_tablet_manager.cc:1434] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:32.441066 8054 tablet_bootstrap.cc:492] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.441663 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_2a37262735b9408bb4498e2ad3758f5e [id=cf8f1ee611744c0e979cbf18eebdba52]
I20260505 20:13:32.442642 8054 tablet_bootstrap.cc:654] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.454596 8616 raft_consensus.cc:493] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.454986 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]
I20260505 20:13:32.454911 8616 raft_consensus.cc:515] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.454599 7802 raft_consensus.cc:3060] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.456262 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f3fcc55304b0403ba6e8e01eaad6da3d [id=d0bbfeb85a1348a284c8fba1e1a17969]
I20260505 20:13:32.458417 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]
I20260505 20:13:32.459375 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3]
I20260505 20:13:32.459439 8619 consensus_queue.cc:1048] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.459502 8668 raft_consensus.cc:493] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.459702 8668 raft_consensus.cc:515] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.460366 8668 leader_election.cc:290] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:32.460834 8668 raft_consensus.cc:493] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.461002 8668 raft_consensus.cc:515] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.461215 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a4d496d994b799d1688cc258a181d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.461591 8668 leader_election.cc:290] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:32.462039 7869 leader_election.cc:343] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.462453 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.462937 7869 leader_election.cc:343] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.463150 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4]
I20260505 20:13:32.463387 8605 consensus_queue.cc:1048] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.463976 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_c96f5f09a5b74277ac2f72a83729e57a [id=d52c9e2e31b34773959865aaa6f1833a]
I20260505 20:13:32.464920 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_72ff1e9617b74cd2af00b37a2b306db6 [id=d86211f549eb4711904778e1cb7494b7]
I20260505 20:13:32.466045 8616 leader_election.cc:290] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.466795 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_da0af39636524879aa8f97b1af853f45 [id=d90ea7e58b5d476ea833feb67b8143c1]
I20260505 20:13:32.468289 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a98da176254eeb896c680fbcb98caa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.468505 7661 raft_consensus.cc:2468] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:32.468914 7736 leader_election.cc:304] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:32.469113 7737 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 22a98da176254eeb896c680fbcb98caa
I20260505 20:13:32.469295 8616 raft_consensus.cc:2804] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.469419 8616 raft_consensus.cc:493] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.469524 8616 raft_consensus.cc:3060] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.471350 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]
W20260505 20:13:32.471674 7872 connection.cc:582] server connection from 127.0.0.1:47490 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.471735 7737 connection.cc:582] server connection from 127.0.0.1:42664 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.471830 8261 connection.cc:582] client connection to 127.7.33.254:38755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260505 20:13:32.472150 8054 tablet_bootstrap.cc:492] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
W20260505 20:13:32.472070 8261 leader_election.cc:336] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260505 20:13:32.472301 8054 ts_tablet_manager.cc:1403] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.004s
I20260505 20:13:32.472280 8261 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98; no voters: 73028cd481e446daa9432a35522a7967, f4615fa5639440fc820498f897adf17d
I20260505 20:13:32.473150 8668 raft_consensus.cc:493] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.473263 8054 raft_consensus.cc:359] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.473318 8668 raft_consensus.cc:515] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.474066 8668 leader_election.cc:290] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.474889 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.475616 7869 leader_election.cc:343] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.475790 8054 raft_consensus.cc:385] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.475903 8054 raft_consensus.cc:740] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.476138 8054 consensus_queue.cc:260] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.476760 8054 ts_tablet_manager.cc:1434] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:32.477025 8616 raft_consensus.cc:515] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.477437 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b966b4bbaf9f4774af96051f857f02f7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.477710 7663 raft_consensus.cc:2468] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:32.479719 7991 connection.cc:582] client connection to 127.7.33.254:38755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.481101 7991 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.33.254:38755)
W20260505 20:13:32.481632 7991 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.33.254:38755)
W20260505 20:13:32.483141 7991 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.33.254:38755)
W20260505 20:13:32.483736 7991 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.33.254:38755)
I20260505 20:13:32.483826 8616 leader_election.cc:290] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.484118 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a98da176254eeb896c680fbcb98caa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.484320 7663 raft_consensus.cc:3060] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:32.484372 7737 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 22a98da176254eeb896c680fbcb98caa
I20260505 20:13:32.490597 7870 leader_election.cc:304] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.491016 8668 raft_consensus.cc:2804] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.491103 8668 raft_consensus.cc:493] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.491171 8668 raft_consensus.cc:3060] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.493880 8668 raft_consensus.cc:515] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.494819 8668 leader_election.cc:290] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.495287 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b966b4bbaf9f4774af96051f857f02f7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.495972 7869 leader_election.cc:343] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.499264 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a4d496d994b799d1688cc258a181d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:32.507041 7871 connection.cc:582] client connection to 127.7.33.254:38755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.509446 7737 connection.cc:582] client connection to 127.7.33.254:38755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.510028 7598 connection.cc:582] client connection to 127.7.33.254:38755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.512048 7399 connection.cc:582] client connection to 127.7.33.254:38755 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.515563 7399 leader_election.cc:336] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260505 20:13:32.515990 7399 leader_election.cc:336] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260505 20:13:32.517854 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_f181142ec34d41af89373e942d282285 [id=e5e18bb6866143cd80c5bd1282d890cc]
I20260505 20:13:32.518488 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_817fb0aff75f4e239ba5270ce18debd9 [id=e63a0d697e7f4e53adf694d76f0a008a]
I20260505 20:13:32.519098 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]
I20260505 20:13:32.520000 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]
I20260505 20:13:32.520982 8054 tablet_bootstrap.cc:492] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:32.522373 8832 negotiation.cc:336] Failed RPC negotiation. Trace:
0505 20:13:32.508896 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.7.33.254:38755 (local address 127.7.33.195:47015)
0505 20:13:32.509702 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0505 20:13:32.509722 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0505 20:13:32.509868 (+ 146us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0505 20:13:32.522043 (+ 12175us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":273,"threads_started":1}
I20260505 20:13:32.524928 7663 raft_consensus.cc:2468] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:32.527244 7870 leader_election.cc:343] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.527410 7870 leader_election.cc:304] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.533882 8668 raft_consensus.cc:2749] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.538323 8054 tablet_bootstrap.cc:654] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.526008 8058 tablet_bootstrap.cc:654] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.526278 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.526702 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.528750 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b966b4bbaf9f4774af96051f857f02f7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.539323 7660 raft_consensus.cc:3060] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.543076 7660 raft_consensus.cc:2468] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.543566 7661 raft_consensus.cc:2468] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.543579 8829 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:32.544957 8054 tablet_bootstrap.cc:492] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.545117 8054 ts_tablet_manager.cc:1403] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260505 20:13:32.546027 8054 raft_consensus.cc:359] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.546238 8054 raft_consensus.cc:385] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.546288 8054 raft_consensus.cc:740] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.546581 8054 consensus_queue.cc:260] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:32.546904 7870 leader_election.cc:343] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.547061 7870 leader_election.cc:304] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.548194 8668 raft_consensus.cc:2749] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.548355 8668 raft_consensus.cc:493] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.548475 8668 raft_consensus.cc:515] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.549218 8668 leader_election.cc:290] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:32.549921 7870 leader_election.cc:304] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.550406 8619 raft_consensus.cc:2804] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.550534 8619 raft_consensus.cc:697] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.550769 8619 consensus_queue.cc:237] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.551314 8322 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Refusing update from remote peer f4615fa5639440fc820498f897adf17d: Log matching property violated. Preceding OpId in replica: term: 1 index: 601. Preceding OpId from leader: term: 2 index: 603. (index mismatch)
I20260505 20:13:32.553901 8054 ts_tablet_manager.cc:1434] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260505 20:13:32.553900 7736 leader_election.cc:304] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:32.554234 8054 tablet_bootstrap.cc:492] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.554767 8605 raft_consensus.cc:2804] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.554911 8605 raft_consensus.cc:697] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:32.555198 8605 consensus_queue.cc:237] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.556071 8054 tablet_bootstrap.cc:654] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:32.557193 8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 85180.2us
W20260505 20:13:32.560937 8831 negotiation.cc:336] Failed RPC negotiation. Trace:
0505 20:13:32.488660 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.7.33.254:38755 (local address 127.0.0.1:40024)
0505 20:13:32.545474 (+ 56814us) negotiation.cc:107] Waiting for socket to connect
0505 20:13:32.545728 (+ 254us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":56641,"thread_start_us":57087,"threads_started":1}
I20260505 20:13:32.561709 7870 leader_election.cc:304] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.562402 8668 raft_consensus.cc:2804] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.562502 8668 raft_consensus.cc:493] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.562575 8668 raft_consensus.cc:3060] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.566551 8668 raft_consensus.cc:515] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.567950 8668 leader_election.cc:290] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.571014 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46c981a27ac4527a40d49714356185e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.572065 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.572351 7661 raft_consensus.cc:3060] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.572736 8054 tablet_bootstrap.cc:492] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.572898 8054 ts_tablet_manager.cc:1403] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20260505 20:13:32.573627 8054 raft_consensus.cc:359] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.573840 8054 raft_consensus.cc:385] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.573911 8054 raft_consensus.cc:740] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.574162 8054 consensus_queue.cc:260] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.574410 8639 raft_consensus.cc:493] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.574528 8639 raft_consensus.cc:515] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.575109 8639 leader_election.cc:290] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.576043 8054 ts_tablet_manager.cc:1434] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:32.576321 8054 tablet_bootstrap.cc:492] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.577011 7661 raft_consensus.cc:2468] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.577692 8668 consensus_queue.cc:1048] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.578025 8054 tablet_bootstrap.cc:654] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:32.579159 7870 leader_election.cc:343] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.580431 8616 consensus_queue.cc:1048] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.580988 7870 leader_election.cc:304] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:32.581332 8668 raft_consensus.cc:2804] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.581614 8668 raft_consensus.cc:697] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.581933 8668 consensus_queue.cc:237] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.582530 8054 tablet_bootstrap.cc:492] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.582679 8054 ts_tablet_manager.cc:1403] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260505 20:13:32.583424 8054 raft_consensus.cc:359] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.583516 8058 tablet_bootstrap.cc:492] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.583585 8054 raft_consensus.cc:385] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.583639 8054 raft_consensus.cc:740] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.583853 8058 ts_tablet_manager.cc:1403] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.145s user 0.001s sys 0.003s
I20260505 20:13:32.583889 8054 consensus_queue.cc:260] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.584499 8054 ts_tablet_manager.cc:1434] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:32.584722 8776 raft_consensus.cc:493] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.584795 8054 tablet_bootstrap.cc:492] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.584877 8776 raft_consensus.cc:515] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.585525 8776 leader_election.cc:290] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.586117 8058 raft_consensus.cc:359] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.586962 8054 tablet_bootstrap.cc:654] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.588940 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.590260 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_8595c29834684cbd83e7b51b31b8b82b [id=ebd38b39f1d2484ca108560964693461]
I20260505 20:13:32.590674 8819 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 603, Last known committed idx: 601, Time since last communication: 0.000s
I20260505 20:13:32.591614 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_1598c3fff8174cfe825ce07774d713da [id=f207462834a048e780f910f10d41a2f6]
I20260505 20:13:32.605017 8639 raft_consensus.cc:493] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.605211 8639 raft_consensus.cc:515] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.605959 8639 leader_election.cc:290] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.611369 8639 raft_consensus.cc:493] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.611507 8639 raft_consensus.cc:515] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.612095 8639 leader_election.cc:290] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.617781 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:32.618125 7936 raft_consensus.cc:2468] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:32.619572 8058 raft_consensus.cc:385] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.619740 8776 consensus_queue.cc:1048] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260505 20:13:32.619901 7661 raft_consensus.cc:2468] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.621006 7598 leader_election.cc:304] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:32.621553 8693 raft_consensus.cc:2804] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.621640 8693 raft_consensus.cc:493] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.621768 8693 raft_consensus.cc:3060] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.624682 8693 raft_consensus.cc:515] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.625317 8693 leader_election.cc:290] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.626082 8639 raft_consensus.cc:493] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.626247 8639 raft_consensus.cc:515] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.626998 8639 leader_election.cc:290] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.627851 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:32.628011 7933 raft_consensus.cc:3060] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.629106 7870 leader_election.cc:304] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:32.629343 8639 raft_consensus.cc:2804] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.629406 8639 raft_consensus.cc:493] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.629460 8639 raft_consensus.cc:3060] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.630702 7933 raft_consensus.cc:2468] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:32.631253 8058 raft_consensus.cc:740] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.631816 8058 consensus_queue.cc:260] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.632475 8058 ts_tablet_manager.cc:1434] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.048s user 0.000s sys 0.002s
I20260505 20:13:32.632026 8639 raft_consensus.cc:515] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.633522 8639 leader_election.cc:290] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.634222 8058 tablet_bootstrap.cc:492] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.637163 8053 tablet_bootstrap.cc:492] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.638082 8053 ts_tablet_manager.cc:1403] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.267s user 0.059s sys 0.118s
I20260505 20:13:32.639322 8053 raft_consensus.cc:359] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:32.640599 7399 consensus_peers.cc:597] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d -> Peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Couldn't send request to peer 73028cd481e446daa9432a35522a7967. Status: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.641371 8054 tablet_bootstrap.cc:492] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.641503 8054 ts_tablet_manager.cc:1403] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.006s
I20260505 20:13:32.642225 8054 raft_consensus.cc:359] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.642385 8054 raft_consensus.cc:385] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.642436 8054 raft_consensus.cc:740] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.642654 8054 consensus_queue.cc:260] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.643281 8054 ts_tablet_manager.cc:1434] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:32.643556 8054 tablet_bootstrap.cc:492] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.643644 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_66c5be236e674e1fb1666d4ed27efc85 [id=f27aae881c8b472080e441818f79d153]
I20260505 20:13:32.646077 8054 tablet_bootstrap.cc:654] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.649638 8053 raft_consensus.cc:385] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.649770 8053 raft_consensus.cc:740] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.650014 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.650074 8053 consensus_queue.cc:260] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:32.640130 8833 negotiation.cc:336] Failed RPC negotiation. Trace:
0505 20:13:32.510702 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.7.33.254:38755 (local address 127.7.33.194:47715)
0505 20:13:32.639621 (+128919us) negotiation.cc:107] Waiting for socket to connect
0505 20:13:32.639767 (+ 146us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":128387,"thread_start_us":128850,"threads_started":1}
I20260505 20:13:32.642632 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.645495 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:32.646425 7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46c981a27ac4527a40d49714356185e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.646922 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:32.650723 7598 leader_election.cc:304] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:32.647231 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.647553 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.647922 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.648213 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e083f131eca54d98852e5685e08ef46b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.648640 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.649488 7737 consensus_peers.cc:597] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98af33c2cdb24937858efdc7b638418f. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.651181 8776 raft_consensus.cc:2804] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:32.652086 7869 leader_election.cc:343] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.652197 7869 leader_election.cc:304] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.652549 8639 raft_consensus.cc:2749] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:32.652969 7869 leader_election.cc:343] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.646095 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_9892374ca24c4ab9a063de4b525033be [id=f74e2d63044b4e4b98c2d0b056fcc0a7]
W20260505 20:13:32.653435 7869 leader_election.cc:343] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.653439 8776 raft_consensus.cc:697] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
W20260505 20:13:32.653910 7869 leader_election.cc:343] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.653800 8776 consensus_queue.cc:237] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.655285 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]
I20260505 20:13:32.655731 8053 ts_tablet_manager.cc:1434] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260505 20:13:32.656718 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.656925 7660 raft_consensus.cc:2468] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:32.657723 7869 leader_election.cc:343] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.657948 7869 leader_election.cc:343] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.658123 7869 leader_election.cc:343] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.659636 8058 tablet_bootstrap.cc:654] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.660442 8053 tablet_bootstrap.cc:492] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.661098 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e083f131eca54d98852e5685e08ef46b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.661352 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]
I20260505 20:13:32.661798 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.662448 8760 catalog_manager.cc:679] Loaded metadata for table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]
I20260505 20:13:32.667471 8053 tablet_bootstrap.cc:654] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:32.668828 7869 consensus_peers.cc:597] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.669812 7660 raft_consensus.cc:3060] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:32.671110 7870 leader_election.cc:343] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.671248 7870 leader_election.cc:304] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.671998 7870 leader_election.cc:304] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.672289 7795 raft_consensus.cc:3060] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.672387 8668 raft_consensus.cc:2749] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.672562 8668 raft_consensus.cc:2804] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.672626 8668 raft_consensus.cc:493] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.672689 8668 raft_consensus.cc:3060] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.673125 8639 raft_consensus.cc:493] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.673256 8639 raft_consensus.cc:515] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.673858 8639 leader_election.cc:290] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:32.675518 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0677740c3f77442895361e22d616a9ba" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.675858 8668 raft_consensus.cc:515] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:32.675966 7869 leader_election.cc:343] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.679951 7660 raft_consensus.cc:2468] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.680778 8053 tablet_bootstrap.cc:492] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.680958 8053 ts_tablet_manager.cc:1403] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
W20260505 20:13:32.682992 7870 leader_election.cc:343] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.683135 7870 leader_election.cc:304] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.681730 8053 raft_consensus.cc:359] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.683851 8619 raft_consensus.cc:2749] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.683872 8053 raft_consensus.cc:385] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.683982 8053 raft_consensus.cc:740] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.684326 8053 consensus_queue.cc:260] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.685731 8557 consensus_queue.cc:1048] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.686786 8760 tablet_loader.cc:96] loaded metadata for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84])
I20260505 20:13:32.687443 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.687907 7869 leader_election.cc:343] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.688820 7737 consensus_peers.cc:597] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c12a95b0ed445c7b598db136f6ac05c. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.687434 8668 leader_election.cc:290] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:32.686990 7596 leader_election.cc:343] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.690205 7596 leader_election.cc:343] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.691020 8760 tablet_loader.cc:96] loaded metadata for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49])
I20260505 20:13:32.691506 8760 tablet_loader.cc:96] loaded metadata for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_ac5b74d3d36f45ec9885c20f92938f45 [id=67accc85180f48418217cf187d1fee88])
I20260505 20:13:32.693771 8760 tablet_loader.cc:96] loaded metadata for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70])
I20260505 20:13:32.694278 8760 tablet_loader.cc:96] loaded metadata for tablet 05ec070a0196451c9564fa24b806516c (table default.Table_62aece033038452d8dd6e128877cc4e7 [id=835704ef17524d9683187bdaa11d3181])
I20260505 20:13:32.690805 8058 tablet_bootstrap.cc:492] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.696323 8760 tablet_loader.cc:96] loaded metadata for tablet 0677740c3f77442895361e22d616a9ba (table default.Table_f92fa7cbfb9c470fa562c941ef044c19 [id=89e7a33609724be8b189af017488a9c8])
W20260505 20:13:32.696540 7737 consensus_peers.cc:597] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6acad22190b402d892d06ff97bd9476. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.696789 8058 ts_tablet_manager.cc:1403] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.002s
I20260505 20:13:32.697252 8760 tablet_loader.cc:96] loaded metadata for tablet 089517a7c2214dce9367b21beb555733 (table default.Table_aa714545b11e4ed3a0e546cddc77be98 [id=7fd3bc8f4d484299a9a21b95ada7e77f])
I20260505 20:13:32.697587 8776 consensus_queue.cc:1048] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.697836 8054 tablet_bootstrap.cc:492] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.698042 8054 ts_tablet_manager.cc:1403] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.000s
I20260505 20:13:32.698283 8058 raft_consensus.cc:359] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.698457 8058 raft_consensus.cc:385] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.698556 8058 raft_consensus.cc:740] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.698555 8760 tablet_loader.cc:96] loaded metadata for tablet 096ca710e3564d4b8db50f29dd56a5d4 (table default.Table_4dda980af4a44fb3b08d9845bc9a4c2f [id=4c8b13827e834d51b935d4110f5628a1])
I20260505 20:13:32.698537 8668 raft_consensus.cc:493] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.698671 8668 raft_consensus.cc:515] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.699227 8668 leader_election.cc:290] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:32.699280 7870 leader_election.cc:304] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.699667 8760 tablet_loader.cc:96] loaded metadata for tablet 09bb5e21649a4cc39764a3847fa41c21 (table default.Table_72ff1e9617b74cd2af00b37a2b306db6 [id=d86211f549eb4711904778e1cb7494b7])
I20260505 20:13:32.700385 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4628e33d204c452ab12acf76f754f2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.700758 8053 ts_tablet_manager.cc:1434] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20260505 20:13:32.700043 8054 raft_consensus.cc:359] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:32.700891 7869 leader_election.cc:343] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.701066 8668 raft_consensus.cc:2804] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.701108 8054 raft_consensus.cc:385] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.701393 8054 raft_consensus.cc:740] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.702757 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0677740c3f77442895361e22d616a9ba" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.703119 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4628e33d204c452ab12acf76f754f2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.703157 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.703325 7663 raft_consensus.cc:3060] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.705179 8668 raft_consensus.cc:697] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.705452 8668 consensus_queue.cc:237] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.706478 7663 raft_consensus.cc:2468] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
W20260505 20:13:32.706959 7870 leader_election.cc:343] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.707073 7870 leader_election.cc:304] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.707821 8619 raft_consensus.cc:2749] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.707940 8053 tablet_bootstrap.cc:492] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:32.708278 7870 leader_election.cc:343] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.708446 7870 leader_election.cc:304] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.708945 8639 raft_consensus.cc:2749] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.709317 7870 leader_election.cc:304] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.708490 8054 consensus_queue.cc:260] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.709873 8639 raft_consensus.cc:2804] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.710103 8616 consensus_queue.cc:1048] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.717525 8619 consensus_queue.cc:1048] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.701628 8058 consensus_queue.cc:260] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.721410 8058 ts_tablet_manager.cc:1434] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260505 20:13:32.728248 8053 tablet_bootstrap.cc:654] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.727456 8058 tablet_bootstrap.cc:492] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.731961 8058 tablet_bootstrap.cc:654] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.736200 8760 tablet_loader.cc:96] loaded metadata for tablet 0b1e6d72c57e42f09432a30295c47f1f (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623])
I20260505 20:13:32.737512 8760 tablet_loader.cc:96] loaded metadata for tablet 0ec5c094e2bb4a4481825df17becde52 (table default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d])
I20260505 20:13:32.738456 8760 tablet_loader.cc:96] loaded metadata for tablet 1315273f76db4405bb2c82a8164bc325 (table default.Table_aeba5817c6974912bf3e49da09fdf85f [id=9b18678ba3204698b9a1c2c214517c50])
I20260505 20:13:32.738785 8053 tablet_bootstrap.cc:492] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.738956 8053 ts_tablet_manager.cc:1403] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.002s
I20260505 20:13:32.739822 8619 consensus_queue.cc:1048] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.739893 8053 raft_consensus.cc:359] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.740104 8053 raft_consensus.cc:385] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.740239 8053 raft_consensus.cc:740] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.740514 8053 consensus_queue.cc:260] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.743953 8639 raft_consensus.cc:697] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.744540 8639 consensus_queue.cc:237] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.743510 8776 consensus_queue.cc:1048] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.749140 8053 ts_tablet_manager.cc:1434] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260505 20:13:32.749897 8053 tablet_bootstrap.cc:492] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.750641 7794 raft_consensus.cc:3060] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.751829 8619 consensus_queue.cc:1048] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.755796 8619 consensus_queue.cc:1048] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.758759 8053 tablet_bootstrap.cc:654] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.759632 8760 tablet_loader.cc:96] loaded metadata for tablet 18ce59c1f3b64b518e244e32ac85b216 (table default.Table_833db141dc5a45e683fec596edc857b5 [id=864842f5805c4e8aa36af98c0a5425a3])
I20260505 20:13:32.760872 8760 tablet_loader.cc:96] loaded metadata for tablet 1d417bb8f3ac4343807e9ff4971eb2ad (table default.Table_f3fcc55304b0403ba6e8e01eaad6da3d [id=d0bbfeb85a1348a284c8fba1e1a17969])
I20260505 20:13:32.761904 8760 tablet_loader.cc:96] loaded metadata for tablet 1f27847d940e46778ad10a2f4cf40d27 (table default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc])
I20260505 20:13:32.762302 8760 tablet_loader.cc:96] loaded metadata for tablet 1f317f62391b422db2bf2a97ef928f99 (table default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6])
I20260505 20:13:32.772504 8619 consensus_queue.cc:1048] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.772965 8619 raft_consensus.cc:493] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.773106 8619 raft_consensus.cc:515] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.774461 8760 tablet_loader.cc:96] loaded metadata for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0])
I20260505 20:13:32.775265 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.775326 7795 raft_consensus.cc:3060] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.776086 8619 leader_election.cc:290] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:32.776163 7870 leader_election.cc:343] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.776446 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.777204 7869 leader_election.cc:343] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.777308 7869 leader_election.cc:304] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.777704 8668 raft_consensus.cc:2749] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.780827 8557 consensus_queue.cc:1048] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.781895 8760 tablet_loader.cc:96] loaded metadata for tablet 22b7c02a4bd84e788d9fc92781c161a1 (table default.Table_28a64c3b83d5413c8d946d129380d5a1 [id=272374ee2a7a45c5ba51d6dd477f4f86])
I20260505 20:13:32.785595 8760 tablet_loader.cc:96] loaded metadata for tablet 2540ed5144664ec0bfe0b548a5386176 (table default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175])
I20260505 20:13:32.787021 8760 tablet_loader.cc:96] loaded metadata for tablet 25fc9a6e1c824305869f6634192c5e78 (table default.Table_7864889bd60f4d50a92b38018c93ca92 [id=b7b0d663a8144e5d8124929fa88a7b62])
I20260505 20:13:32.787897 8760 tablet_loader.cc:96] loaded metadata for tablet 26b143e4943343d5b151f2804cccecfb (table default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a [id=2933b254aea045eaa6d04f0fc88a5890])
I20260505 20:13:32.788659 8760 tablet_loader.cc:96] loaded metadata for tablet 28caca1a9a044701991ebda53cf75499 (table default.Table_314707634b784fa686de6f277f00aec1 [id=9f4a27a994cd4272bc7dd94a1ffde607])
I20260505 20:13:32.791275 8760 tablet_loader.cc:96] loaded metadata for tablet 296494f478244052971e12a09f0b15b4 (table default.Table_3f1f3578e45142bd8308041182d62265 [id=629d3a81e86945f48e462550aa1b1fee])
W20260505 20:13:32.793020 7869 consensus_peers.cc:597] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.795454 8829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4615fa5639440fc820498f897adf17d. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:32.795701 8861 consensus_queue.cc:1048] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.795791 8829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:32.797669 8760 tablet_loader.cc:96] loaded metadata for tablet 2b64242395794797aaf7a52ba40e0c60 (table default.Table_66c5be236e674e1fb1666d4ed27efc85 [id=f27aae881c8b472080e441818f79d153])
I20260505 20:13:32.798806 8058 tablet_bootstrap.cc:492] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.799000 8058 ts_tablet_manager.cc:1403] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.002s
I20260505 20:13:32.799782 8760 tablet_loader.cc:96] loaded metadata for tablet 2faf7c64c3c340ceb8c87e416a32a7ed (table default.Table_d35a015103974aae8ba25b644b320d5e [id=6d62e1270ed54b76aaff276b11d04c2f])
I20260505 20:13:32.799983 8058 raft_consensus.cc:359] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.800220 8058 raft_consensus.cc:385] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.800311 8058 raft_consensus.cc:740] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.800642 8760 tablet_loader.cc:96] loaded metadata for tablet 34883b630a87480f953facb44615ef65 (table default.Table_85b92a55020a404f80a0290495181ab3 [id=33b67547f90545a99f9fedd756cbf001])
I20260505 20:13:32.802942 8760 tablet_loader.cc:96] loaded metadata for tablet 3535f0c31ad5451ea5bceeb50f756eef (table default.Table_1d0db71b969c4ec3b297f64b2d0c71e8 [id=9ad5a74e0c2343c6b0781cf8dbe76f9c])
I20260505 20:13:32.803484 8760 tablet_loader.cc:96] loaded metadata for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926])
W20260505 20:13:32.803844 7598 consensus_peers.cc:597] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2676078f47c4bc19391227d9643c15f. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:32.804116 8760 tablet_loader.cc:96] loaded metadata for tablet 35ada922a36f4f329a5ff8b328dbef5f (table default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6])
I20260505 20:13:32.804590 8760 tablet_loader.cc:96] loaded metadata for tablet 3679480e55444d0d935f262217e44485 (table default.Table_c0743365402b4252bd3c5c7a95a9e5ee [id=5579cbeef0624d4a8cb8beeac55362e9])
I20260505 20:13:32.806429 8058 consensus_queue.cc:260] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.807411 8760 tablet_loader.cc:96] loaded metadata for tablet 38822ad83f51454f9203fc17ed93a32f (table default.Table_7ef38a3fc00f4cdca3666e9359a5fb38 [id=6907b9983088424f8bcc957773626fb4])
I20260505 20:13:32.808156 8760 tablet_loader.cc:96] loaded metadata for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_df8877e563ff4aa49f6f201934596c59 [id=68a78a47955345e5832fbef128cbe20e])
I20260505 20:13:32.808631 8760 tablet_loader.cc:96] loaded metadata for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214])
I20260505 20:13:32.808646 8058 ts_tablet_manager.cc:1434] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260505 20:13:32.810063 8760 tablet_loader.cc:96] loaded metadata for tablet 3ce500f525c748d999d591390dd6094b (table default.Table_89dfd83915c249d2bfd6edc8f86c2acf [id=98e304465ac0407c92443491641607f4])
I20260505 20:13:32.811515 8058 tablet_bootstrap.cc:492] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.811872 8760 tablet_loader.cc:96] loaded metadata for tablet 3dbc2221555e4f598d65835ae640fe4a (table default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3])
I20260505 20:13:32.813482 8760 tablet_loader.cc:96] loaded metadata for tablet 3f01954a7a194e159a86152625e1ff6b (table default.Table_501dd560884045e79bb35144cae9d817 [id=c75180068c5d4a11805340d9508a2738])
I20260505 20:13:32.814683 8058 tablet_bootstrap.cc:654] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.825037 8760 tablet_loader.cc:96] loaded metadata for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_bc0ac75d0a8d46caa8026d33f784689d [id=81cca356ac0a4576af3226017a09f6f1])
I20260505 20:13:32.825285 8058 tablet_bootstrap.cc:492] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.825457 8058 ts_tablet_manager.cc:1403] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260505 20:13:32.826416 8760 tablet_loader.cc:96] loaded metadata for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788])
I20260505 20:13:32.826370 8058 raft_consensus.cc:359] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.826566 8058 raft_consensus.cc:385] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.826679 8058 raft_consensus.cc:740] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.826941 8058 consensus_queue.cc:260] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.828043 8760 tablet_loader.cc:96] loaded metadata for tablet 44ddf95d810c4c80a5f78c1b7600cee4 (table default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3])
I20260505 20:13:32.827770 8054 ts_tablet_manager.cc:1434] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.130s user 0.009s sys 0.004s
I20260505 20:13:32.828284 8058 ts_tablet_manager.cc:1434] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260505 20:13:32.829991 8760 tablet_loader.cc:96] loaded metadata for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b])
I20260505 20:13:32.833415 8058 tablet_bootstrap.cc:492] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.834306 8760 tablet_loader.cc:96] loaded metadata for tablet 484c7cbed038469093dd19b39e1abbc9 (table default.Table_5cb3708c35b247e2b4ee66f2c5d616d4 [id=cf7b796237cc49b7a6fd29b9cd7c9dd1])
I20260505 20:13:32.835397 8058 tablet_bootstrap.cc:654] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.836061 8760 tablet_loader.cc:96] loaded metadata for tablet 4860b4f80ef34a799fa9f9607aac844a (table default.Table_e9946c00ab714ea2b40bf99ce829d482 [id=646b864647ff42838a8cdc969b72bf7b])
I20260505 20:13:32.837000 8760 tablet_loader.cc:96] loaded metadata for tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e])
I20260505 20:13:32.838935 8760 tablet_loader.cc:96] loaded metadata for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd])
I20260505 20:13:32.841876 8053 tablet_bootstrap.cc:492] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.842065 8053 ts_tablet_manager.cc:1403] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.093s user 0.009s sys 0.004s
I20260505 20:13:32.844966 8639 consensus_queue.cc:1048] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.846922 8760 tablet_loader.cc:96] loaded metadata for tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c])
I20260505 20:13:32.848268 8760 tablet_loader.cc:96] loaded metadata for tablet 534726d2291044d78740896ff9031fca (table default.Table_070bf3473ab74c31b33db173e8f39d20 [id=12eca25cabd8420aa872cd90cdc4dc03])
I20260505 20:13:32.848448 8829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:32.848659 8829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:32.850196 8053 raft_consensus.cc:359] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.850445 8053 raft_consensus.cc:385] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.850530 8053 raft_consensus.cc:740] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.851436 8760 tablet_loader.cc:96] loaded metadata for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1])
I20260505 20:13:32.852135 8053 consensus_queue.cc:260] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.852878 8053 ts_tablet_manager.cc:1434] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260505 20:13:32.853193 8053 tablet_bootstrap.cc:492] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.855497 8760 tablet_loader.cc:96] loaded metadata for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f])
I20260505 20:13:32.855659 8053 tablet_bootstrap.cc:654] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.855944 8760 tablet_loader.cc:96] loaded metadata for tablet 59f5348c229744ab98f0de3da40de6c5 (table default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe])
I20260505 20:13:32.856794 8760 tablet_loader.cc:96] loaded metadata for tablet 5b3595eb9b1144d9b802f1f563d01461 (table default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9])
I20260505 20:13:32.857906 8760 tablet_loader.cc:96] loaded metadata for tablet 5b60c74cfa0d4c498ed50daefe3905ab (table default.Table_fde64ff0b9514797968ea93a1a179537 [id=62c3b4c1b9724e089448906fab7435c0])
I20260505 20:13:32.858263 8760 tablet_loader.cc:96] loaded metadata for tablet 5b6326375bac48f0944eeeaa9b39682c (table default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853])
I20260505 20:13:32.858632 8760 tablet_loader.cc:96] loaded metadata for tablet 5bdd0cf6cefa43388b22cbd1cee820b6 (table default.Table_776d125a74a244a89a055dcff3489919 [id=33fc6a636c5649dba50f235c90a0019d])
I20260505 20:13:32.859797 8760 tablet_loader.cc:96] loaded metadata for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890])
I20260505 20:13:32.860702 8053 tablet_bootstrap.cc:492] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.860908 8053 ts_tablet_manager.cc:1403] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260505 20:13:32.861681 8053 raft_consensus.cc:359] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.861917 8053 raft_consensus.cc:385] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.862012 8053 raft_consensus.cc:740] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.862699 8053 consensus_queue.cc:260] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:32.863381 8053 ts_tablet_manager.cc:1434] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:32.863684 8053 tablet_bootstrap.cc:492] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.864777 8054 tablet_bootstrap.cc:492] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.865440 8053 tablet_bootstrap.cc:654] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.865650 8557 consensus_queue.cc:1048] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.866698 8760 tablet_loader.cc:96] loaded metadata for tablet 624398f68961440f8369a7859b0724c4 (table default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf])
I20260505 20:13:32.867148 8760 tablet_loader.cc:96] loaded metadata for tablet 6375582031e0445086c58402e8b189c0 (table default.Table_af907934b9fa4624acbd348b39f0920b [id=838329ded2324129b0955e7cd2d9a662])
I20260505 20:13:32.867906 8760 tablet_loader.cc:96] loaded metadata for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d])
I20260505 20:13:32.868366 8760 tablet_loader.cc:96] loaded metadata for tablet 663d16be712b40859aa92277eab0c4a2 (table default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b])
I20260505 20:13:32.869671 8760 tablet_loader.cc:96] loaded metadata for tablet 67c582e419f746b28530c0971fede09f (table default.Table_9875a3e2f0d444018fb87797fd4bcde6 [id=0b04ae6c921741049ea506fe8323865c])
I20260505 20:13:32.870208 8760 tablet_loader.cc:96] loaded metadata for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69])
I20260505 20:13:32.870630 8760 tablet_loader.cc:96] loaded metadata for tablet 6bebda2a5c5a4c43a244504837cf0923 (table default.Table_f181142ec34d41af89373e942d282285 [id=e5e18bb6866143cd80c5bd1282d890cc])
I20260505 20:13:32.871537 8760 tablet_loader.cc:96] loaded metadata for tablet 6d1fa4131acf4d23ad35aaae5ebfa5ca (table default.Table_8b0cfce2deb84e9e88ec3d8da4387fcb [id=2c8ae910936748198e221a7864a4ccf6])
I20260505 20:13:32.872208 8760 tablet_loader.cc:96] loaded metadata for tablet 6f3a4294f4c34ac886a136c2ece31531 (table default.Table_bdf29d4f05e14db4bf9cdd09c8e6266d [id=a441a18b04ef463bb4c69e9e25f1ffd8])
I20260505 20:13:32.872661 8760 tablet_loader.cc:96] loaded metadata for tablet 71a30738cb354b2c839f76b5d3b3be96 (table default.Table_0f1a1d7075f84270a8c989ffdfc15f6a [id=94c086eb9e3f415086757ebb469ca6c4])
I20260505 20:13:32.873070 8760 tablet_loader.cc:96] loaded metadata for tablet 71bfd96314244e6cbbb4d5b48841e06f (table default.Table_efe2580fbb5b4113b2ba4580914aacc4 [id=3392dc17dfb345459b94ec7f28fb17b4])
I20260505 20:13:32.874363 8054 tablet_bootstrap.cc:654] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.875239 8760 tablet_loader.cc:96] loaded metadata for tablet 7447c40ad6914e75a1b1376213218624 (table default.Table_07cd2eeb8ed74e90ac630e511f01ccb5 [id=758c5b8d77d649beb11a2d8a3d40e1e0])
I20260505 20:13:32.876225 8760 tablet_loader.cc:96] loaded metadata for tablet 753536034d2647ef90ee3cf280b13855 (table default.Table_9892374ca24c4ab9a063de4b525033be [id=f74e2d63044b4e4b98c2d0b056fcc0a7])
I20260505 20:13:32.877507 8760 tablet_loader.cc:96] loaded metadata for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450])
I20260505 20:13:32.881402 8760 tablet_loader.cc:96] loaded metadata for tablet 799f3fc33c48436da61cc0cfbf0b0218 (table default.Table_6d4b2501aefb48ae90019d3bfdb71a24 [id=5945251171634214a7e24933d7768727])
I20260505 20:13:32.882207 8760 tablet_loader.cc:96] loaded metadata for tablet 7e5497df41ba46cc9228c0debd18551b (table default.Table_a5f6228ca6384c5b88cd9242e5d25334 [id=74c243106f024592ac3c7ad007a462e2])
I20260505 20:13:32.882688 8053 tablet_bootstrap.cc:492] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.882875 8053 ts_tablet_manager.cc:1403] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.003s
I20260505 20:13:32.882879 8760 tablet_loader.cc:96] loaded metadata for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_38d192fd0ccf420588d860dddcd2394c [id=b11d0432d00747cba7ee33cdf0d4881c])
I20260505 20:13:32.883391 8760 tablet_loader.cc:96] loaded metadata for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0])
I20260505 20:13:32.883818 8760 tablet_loader.cc:96] loaded metadata for tablet 81319ed5eed64dafb9b2a121661da9ea (table default.Table_2a37262735b9408bb4498e2ad3758f5e [id=cf8f1ee611744c0e979cbf18eebdba52])
I20260505 20:13:32.883814 8053 raft_consensus.cc:359] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.884034 8053 raft_consensus.cc:385] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.884115 8053 raft_consensus.cc:740] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.884439 8053 consensus_queue.cc:260] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.885285 8053 ts_tablet_manager.cc:1434] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260505 20:13:32.885324 8058 tablet_bootstrap.cc:492] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:32.885509 8058 ts_tablet_manager.cc:1403] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260505 20:13:32.885632 8053 tablet_bootstrap.cc:492] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.885807 8760 tablet_loader.cc:96] loaded metadata for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48])
I20260505 20:13:32.887877 8053 tablet_bootstrap.cc:654] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.886467 8760 tablet_loader.cc:96] loaded metadata for tablet 880cbba188144dd795873186f8cda1e9 (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199])
I20260505 20:13:32.888171 8819 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:32.889082 8819 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:32.890376 8760 tablet_loader.cc:96] loaded metadata for tablet 8b3ebd96dc184e0db04b3e063d5b9b2d (table default.Table_1f4c5959987145b594d24feb4eb6a4d1 [id=4b76ab7e66f34e8d876aff5a0f59840c])
I20260505 20:13:32.891355 8760 tablet_loader.cc:96] loaded metadata for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_2036d69d672348c0b08335df0c49d801 [id=045845bc74254e53ba6f9ede9e6d4a0b])
I20260505 20:13:32.891814 8760 tablet_loader.cc:96] loaded metadata for tablet 8e190c973c984ec080178efa39b2def0 (table default.Table_c96f5f09a5b74277ac2f72a83729e57a [id=d52c9e2e31b34773959865aaa6f1833a])
I20260505 20:13:32.892876 8760 tablet_loader.cc:96] loaded metadata for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_3b4a78f1dba2415d8d85b7dea798ed28 [id=8f922183d9054257a9e0cb61880d57cf])
I20260505 20:13:32.893813 8760 tablet_loader.cc:96] loaded metadata for tablet 92ed62f9b81e48459c6d55664ddf1cc6 (table default.Table_13eb9bf2d4ad42d590bf5ae3c088e0f4 [id=89d7fca8e0d64a81964d8dca6676cbb8])
I20260505 20:13:32.894179 8619 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.894356 8619 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.894840 8760 tablet_loader.cc:96] loaded metadata for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647])
I20260505 20:13:32.895037 8619 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:32.895897 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.896420 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.896842 8054 tablet_bootstrap.cc:492] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
W20260505 20:13:32.896977 7869 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:32.899771 7870 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.899909 7870 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:32.900182 8619 raft_consensus.cc:2749] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:32.901922 8058 raft_consensus.cc:359] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.902186 8058 raft_consensus.cc:385] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.902278 8058 raft_consensus.cc:740] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.902673 8776 consensus_queue.cc:1048] T ea726cff03664c3d81b5e541ef738d4a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.896977 8054 ts_tablet_manager.cc:1403] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260505 20:13:32.907222 8718 consensus_queue.cc:1048] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.919889 8058 consensus_queue.cc:260] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.906589 8054 raft_consensus.cc:359] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.920544 8054 raft_consensus.cc:385] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.922135 8760 tablet_loader.cc:96] loaded metadata for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_833aef6a6ffc466c8f56b9bee24bf1a2 [id=3734c4511d224584aeed0efd6bac453d])
I20260505 20:13:32.925221 8619 raft_consensus.cc:493] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.925403 8619 raft_consensus.cc:515] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.926450 8619 leader_election.cc:290] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.927289 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62626fb4f8445e3a6e2822277181762" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.928030 7869 leader_election.cc:343] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.928772 8760 tablet_loader.cc:96] loaded metadata for tablet 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 (table default.Table_2abcfc3982a14ad59d71192e56a1f1d9 [id=2514754262884627a95e5da503db0535])
I20260505 20:13:32.930022 8619 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.930155 8619 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.930775 8619 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.931656 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:32.932317 7869 leader_election.cc:343] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.932544 8760 tablet_loader.cc:96] loaded metadata for tablet 982da795cf2c4e578f3392066b1cc1ea (table default.Table_d3f51622819c4146803605c7494da89e [id=33e3959f29394995be644ddc2dcf0585])
I20260505 20:13:32.934921 7795 raft_consensus.cc:3060] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.937713 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.937989 7663 raft_consensus.cc:2468] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.938803 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62626fb4f8445e3a6e2822277181762" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:32.938982 7660 raft_consensus.cc:2468] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:32.939864 7870 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.940313 7870 leader_election.cc:304] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.941143 8639 raft_consensus.cc:2804] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.941212 8639 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.941268 8639 raft_consensus.cc:3060] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.943039 8861 raft_consensus.cc:2804] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.943112 8861 raft_consensus.cc:493] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.943164 8861 raft_consensus.cc:3060] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.944020 8639 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.920639 8054 raft_consensus.cc:740] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.945060 8639 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.945106 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.945094 8054 consensus_queue.cc:260] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.945210 8639 consensus_queue.cc:1048] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.945297 7660 raft_consensus.cc:3060] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.945489 8058 ts_tablet_manager.cc:1434] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.060s user 0.003s sys 0.000s
I20260505 20:13:32.945894 8058 tablet_bootstrap.cc:492] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:32.945815 8861 raft_consensus.cc:515] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.947057 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62626fb4f8445e3a6e2822277181762" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.947649 7869 leader_election.cc:343] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.947976 8861 leader_election.cc:290] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:32.948410 8054 ts_tablet_manager.cc:1434] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260505 20:13:32.948676 8054 tablet_bootstrap.cc:492] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.948901 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62626fb4f8445e3a6e2822277181762" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:32.949095 7663 raft_consensus.cc:3060] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.949710 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:32.950209 7869 leader_election.cc:343] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.950376 8054 tablet_bootstrap.cc:654] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.950573 8760 tablet_loader.cc:96] loaded metadata for tablet 983ad31892394f67a7a9a727dc2bef1b (table default.Table_9b91d467468d48768be1b29a593e41d5 [id=a3200160268d450dbc28b0097c29eea2])
I20260505 20:13:32.951042 8760 tablet_loader.cc:96] loaded metadata for tablet 9845d42fafa14457bd6c54d7477786aa (table default.Table_8cc3cc188c8c40d1ac809b3372dca56e [id=8615ba1d02294f9fa642bd1336064950])
I20260505 20:13:32.952901 8877 consensus_queue.cc:1048] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:32.954351 8760 tablet_loader.cc:96] loaded metadata for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8])
I20260505 20:13:32.955206 8760 tablet_loader.cc:96] loaded metadata for tablet 9e217456754440cf90a1c5a642eb2627 (table default.Table_58b87c163c1f49a89a9bc55d655baf2f [id=42fd7d09cb3e448e9be4b7d49262f43e])
I20260505 20:13:32.955799 8760 tablet_loader.cc:96] loaded metadata for tablet 9e8d5190032443d4bf6fdb83a34fabd8 (table default.Table_6668622814b7401689dd9dfecee3a8b9 [id=74178f7425164618bd69a1653b75e5d1])
I20260505 20:13:32.956691 8760 tablet_loader.cc:96] loaded metadata for tablet 9f91a58d306e4dd7ab515498aa6ab32b (table default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14])
I20260505 20:13:32.957886 8760 tablet_loader.cc:96] loaded metadata for tablet a0d4e198c91c4a0e99d8b798a1dd3433 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e])
I20260505 20:13:32.959403 7660 raft_consensus.cc:2468] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.959595 8053 tablet_bootstrap.cc:492] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:32.959750 8053 ts_tablet_manager.cc:1403] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.020s
I20260505 20:13:32.960593 8053 raft_consensus.cc:359] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.960773 8053 raft_consensus.cc:385] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.960856 8053 raft_consensus.cc:740] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.961555 7870 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.961983 8861 raft_consensus.cc:2804] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.962098 8861 raft_consensus.cc:697] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.962340 8861 consensus_queue.cc:237] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.964741 8760 tablet_loader.cc:96] loaded metadata for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_9ee9fc9d6bc948fd90db78cd1670d21f [id=9a219602b64942a8af58f84cf59a5cdb])
I20260505 20:13:32.965250 8760 tablet_loader.cc:96] loaded metadata for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c])
I20260505 20:13:32.966128 8760 tablet_loader.cc:96] loaded metadata for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_6d292d45d5d24556b062b5b0fd05a0b1 [id=2b4a4163adc847139f13c1221f58d86a])
I20260505 20:13:32.966842 8760 tablet_loader.cc:96] loaded metadata for tablet a97a8c35af23454a9cf63193f763381e (table default.Table_da0af39636524879aa8f97b1af853f45 [id=d90ea7e58b5d476ea833feb67b8143c1])
I20260505 20:13:32.967361 8760 tablet_loader.cc:96] loaded metadata for tablet aa0b05546a4f47aea5fae1cf767b762d (table default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f])
I20260505 20:13:32.968134 8760 tablet_loader.cc:96] loaded metadata for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087])
I20260505 20:13:32.969291 8760 tablet_loader.cc:96] loaded metadata for tablet ad2fb4e615c4486b9d071b2366f85471 (table default.Table_06b9387992f541f584126cf0be193f38 [id=9cc065df68d949a199bc73be48314f8c])
I20260505 20:13:32.969807 8760 tablet_loader.cc:96] loaded metadata for tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a])
I20260505 20:13:32.971336 8053 consensus_queue.cc:260] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.971472 8760 tablet_loader.cc:96] loaded metadata for tablet b53f88d2e8b34b69bd12f53b046ed4de (table default.Table_b9ccf3e9460f4ba28802602c516ab4af [id=2935a29adff5403aab513a78d1a7faac])
I20260505 20:13:32.972007 8053 ts_tablet_manager.cc:1434] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:32.972508 8760 tablet_loader.cc:96] loaded metadata for tablet b6a3078a3ec94043b84de3d39a1f5233 (table default.Table_45b02f2afbda4ad88bfc9c41c987aa4b [id=83bea458fe874e78a4168e6820a7f048])
I20260505 20:13:32.972923 8760 tablet_loader.cc:96] loaded metadata for tablet b6dc9ec93ddb406ab956389518a9a7b3 (table default.Table_3a544b60f38745948e6026aeaa005366 [id=65cc6685c1474b129203568616b14e8b])
I20260505 20:13:32.973192 8053 tablet_bootstrap.cc:492] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:32.974753 8760 tablet_loader.cc:96] loaded metadata for tablet b9b375a4bbec4527af704aa6cd08acec (table default.Table_d3355f0e778c4b8d86fe948da69b1976 [id=7e050176e69345a8ba527b6fa0d49da3])
I20260505 20:13:32.975493 8054 tablet_bootstrap.cc:492] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.975940 8760 tablet_loader.cc:96] loaded metadata for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd])
I20260505 20:13:32.976152 8054 ts_tablet_manager.cc:1403] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.003s
I20260505 20:13:32.977072 8054 raft_consensus.cc:359] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.978034 8760 tablet_loader.cc:96] loaded metadata for tablet bc112545c3eb4e0189cb1ea45edd4fd0 (table default.Table_318c908c4ab241c09ed344cd15203aea [id=3a774ed366a4499683d2c81d149d0dcf])
I20260505 20:13:32.979295 8760 tablet_loader.cc:96] loaded metadata for tablet bda4fd8b0f214da7a1e8b944e1820c0c (table default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143])
I20260505 20:13:32.979498 8054 raft_consensus.cc:385] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:32.979626 8054 raft_consensus.cc:740] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:32.979914 8054 consensus_queue.cc:260] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.980629 8054 ts_tablet_manager.cc:1434] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:32.980947 8054 tablet_bootstrap.cc:492] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:32.981920 8058 tablet_bootstrap.cc:654] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.982594 8760 tablet_loader.cc:96] loaded metadata for tablet be05357416b24dabaaa5f2ce2f33c82e (table default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4])
I20260505 20:13:32.985102 8760 tablet_loader.cc:96] loaded metadata for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0])
I20260505 20:13:32.985524 7663 raft_consensus.cc:2468] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:32.986011 8054 tablet_bootstrap.cc:654] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:32.986346 8776 raft_consensus.cc:493] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.986512 8776 raft_consensus.cc:515] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.987095 8776 leader_election.cc:290] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:32.988955 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.990077 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:32.990263 7936 raft_consensus.cc:2468] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:32.990846 8760 tablet_loader.cc:96] loaded metadata for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_817fb0aff75f4e239ba5270ce18debd9 [id=e63a0d697e7f4e53adf694d76f0a008a])
W20260505 20:13:32.991218 7596 leader_election.cc:343] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.992262 7870 leader_election.cc:304] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.992748 8619 raft_consensus.cc:2804] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:32.992885 8619 raft_consensus.cc:697] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:32.993111 8619 consensus_queue.cc:237] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.993211 8877 raft_consensus.cc:493] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:32.993312 8877 raft_consensus.cc:515] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:32.993507 8760 tablet_loader.cc:96] loaded metadata for tablet c689df9f8285487da25b32b6c02df003 (table default.Table_2818c22c9c4d486ea6a43294e850d902 [id=98228933cfdf4f30b5c3431bf704abea])
I20260505 20:13:32.994234 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883ec65f15604346813e5f87d55802fc" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:32.994309 8877 leader_election.cc:290] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:32.994385 8760 tablet_loader.cc:96] loaded metadata for tablet c93512b85b764438aeb7bca9fe339442 (table default.Table_bd6970923f6943358212e065fee537ea [id=950865299ac7468db8ae8fc687685655])
I20260505 20:13:32.994966 8760 tablet_loader.cc:96] loaded metadata for tablet ca16deae2e4f4f9a9069822b57c5bc7f (table default.Table_b05a62cc3a7e446e915328413ead238d [id=13c456c402f444bc97f01c7428024341])
W20260505 20:13:32.995313 7869 leader_election.cc:343] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:32.995877 7598 leader_election.cc:304] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:32.996380 8692 raft_consensus.cc:2804] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:32.996558 8692 raft_consensus.cc:493] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:32.996677 8692 raft_consensus.cc:3060] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:32.996907 8760 tablet_loader.cc:96] loaded metadata for tablet cb5cfc700aff4082ae089476e2af044f (table default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3])
I20260505 20:13:32.997535 8760 tablet_loader.cc:96] loaded metadata for tablet d0943621b2d14346ad79d1b7a74e4d47 (table default.Table_d6ce8f7d9fd1457790462b4950bcee3d [id=7f07fbb5d4444ed3b62702530ed4610a])
I20260505 20:13:32.998263 8054 tablet_bootstrap.cc:492] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:32.998459 8054 ts_tablet_manager.cc:1403] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20260505 20:13:33.002722 8861 consensus_queue.cc:1048] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.003055 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883ec65f15604346813e5f87d55802fc" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.004603 7870 leader_election.cc:343] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.004726 7870 leader_election.cc:304] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.005066 8861 raft_consensus.cc:2749] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.000593 8692 raft_consensus.cc:515] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.008302 8692 leader_election.cc:290] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.008986 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:33.009328 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:33.009485 7936 raft_consensus.cc:3060] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.012212 7936 raft_consensus.cc:2468] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:32.999241 8054 raft_consensus.cc:359] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.016098 8054 raft_consensus.cc:385] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.016240 8054 raft_consensus.cc:740] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:33.012789 7596 leader_election.cc:343] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.016680 7598 leader_election.cc:304] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:33.016676 8054 consensus_queue.cc:260] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.017249 8054 ts_tablet_manager.cc:1434] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.019s user 0.000s sys 0.001s
I20260505 20:13:33.018839 8760 tablet_loader.cc:96] loaded metadata for tablet d27febef8234419caa855dd7a180fe8f (table default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466])
I20260505 20:13:33.013219 8058 tablet_bootstrap.cc:492] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:33.019404 8058 ts_tablet_manager.cc:1403] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.074s user 0.000s sys 0.004s
I20260505 20:13:33.020195 8058 raft_consensus.cc:359] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.020408 8058 raft_consensus.cc:385] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.020496 8058 raft_consensus.cc:740] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.020865 8692 raft_consensus.cc:2804] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:33.021509 8054 tablet_bootstrap.cc:492] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.023125 8692 raft_consensus.cc:697] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:33.023330 8054 tablet_bootstrap.cc:654] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.023488 8692 consensus_queue.cc:237] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.027307 8058 consensus_queue.cc:260] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.029142 8616 raft_consensus.cc:493] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.029330 8616 raft_consensus.cc:515] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:33.029361 8760 tablet_loader.cc:96] loaded metadata for tablet d411638715f747469f9f3dc490c0257c (table default.Table_53010b8cbf5e426590b4f82d68e96660 [id=3505dd62d0f747cb93b233259fadc6ef])
I20260505 20:13:33.030081 8605 raft_consensus.cc:493] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.030198 8605 raft_consensus.cc:515] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.030694 8605 leader_election.cc:290] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.030851 8760 tablet_loader.cc:96] loaded metadata for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a])
I20260505 20:13:33.031383 8760 tablet_loader.cc:96] loaded metadata for tablet d5f27d918f0945208e780bd9583f529e (table default.Table_7bf5278bb40e43bb8d43b4b63ca58dd4 [id=7ae883240f114c1f96e48ac234286977])
I20260505 20:13:33.031852 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.032075 7933 raft_consensus.cc:2393] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:33.032183 8616 leader_election.cc:290] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.033391 7795 raft_consensus.cc:3060] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.036629 8877 consensus_queue.cc:1048] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.038873 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b966b4bbaf9f4774af96051f857f02f7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.040584 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b3c646af9843048382e77b138aea44" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.040904 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b966b4bbaf9f4774af96051f857f02f7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.041265 7661 raft_consensus.cc:2393] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:33.044034 8760 tablet_loader.cc:96] loaded metadata for tablet d75821282ca446b7b875ccb5a063e784 (table default.Table_3c329f8225c0482ba66b8cb2bece4f84 [id=76c82dc9119c4120bb27ac4b61c9f8fe])
I20260505 20:13:33.044138 7736 leader_election.cc:304] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.044751 8760 tablet_loader.cc:96] loaded metadata for tablet dc1323c894d742909e2add9b8f7e2577 (table default.Table_a62884f24a7b450e86c9ec17c75bd041 [id=01f0244c225b47459ca461d8b3c0bde3])
I20260505 20:13:33.045068 8605 raft_consensus.cc:3060] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.047312 8760 tablet_loader.cc:96] loaded metadata for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_bf62bacfeaa24c4ca237490e17c20ad8 [id=a89cd6133fe5494cbf2d3520bc8c744a])
I20260505 20:13:33.047984 8605 raft_consensus.cc:2749] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.047995 8760 tablet_loader.cc:96] loaded metadata for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a])
I20260505 20:13:33.048810 8053 tablet_bootstrap.cc:654] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.049189 7736 leader_election.cc:304] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.049787 8760 tablet_loader.cc:96] loaded metadata for tablet ea726cff03664c3d81b5e541ef738d4a (table default.Table_526e839bfa8844e2a50dd64a809897ef [id=b62a5519297e451ba7e07989cacfc6fa])
I20260505 20:13:33.049912 8616 raft_consensus.cc:3060] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.050261 8760 tablet_loader.cc:96] loaded metadata for tablet ec3374a8f51d4c1a94dbd24d4a9da0af (table default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54])
I20260505 20:13:33.050980 8760 tablet_loader.cc:96] loaded metadata for tablet ede080523cb1482d8a531f4044164475 (table default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e])
I20260505 20:13:33.052181 8760 tablet_loader.cc:96] loaded metadata for tablet f1425e08c7c342e3bc05074645969b2c (table default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3])
I20260505 20:13:33.052593 8760 tablet_loader.cc:96] loaded metadata for tablet f29fd054d41e4c48ab0da8dec2b952d5 (table default.Table_a73fbe5892774352b079b4b0ce80d9c3 [id=2caf3e7ce2e84c259297c6e06ddf26a9])
I20260505 20:13:33.053011 8760 tablet_loader.cc:96] loaded metadata for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f])
I20260505 20:13:33.054212 8616 raft_consensus.cc:2749] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.054529 8760 tablet_loader.cc:96] loaded metadata for tablet f4a8adf31bc94a33a61468adf2673681 (table default.Table_5eb1b00bd31442779cd50c207d3a2b1e [id=49103ea0eb57491fa5482997379eda9b])
I20260505 20:13:33.055099 8760 tablet_loader.cc:96] loaded metadata for tablet f4d78ebf153640e4b2f518fb215f1bf1 (table default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf [id=ce67d81dbf7049bbb005069ee91d338a])
I20260505 20:13:33.055617 8058 ts_tablet_manager.cc:1434] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260505 20:13:33.056001 8058 tablet_bootstrap.cc:492] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:33.056545 8760 tablet_loader.cc:96] loaded metadata for tablet f697fa87e7fe4da0b70bfa42a8818660 (table default.Table_1088b8bf1039442b9962d35ee73ea794 [id=ca6c4e13eead4e5f9bd6003d9024ebd3])
I20260505 20:13:33.057487 8760 tablet_loader.cc:96] loaded metadata for tablet faf3775c154742c5804daf8ade2ad854 (table default.Table_8595c29834684cbd83e7b51b31b8b82b [id=ebd38b39f1d2484ca108560964693461])
I20260505 20:13:33.058024 8760 tablet_loader.cc:96] loaded metadata for tablet fca1e2a2ea424ffd83bd5260694c1b3e (table default.Table_1598c3fff8174cfe825ce07774d713da [id=f207462834a048e780f910f10d41a2f6])
I20260505 20:13:33.058712 8877 raft_consensus.cc:493] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.058856 8877 raft_consensus.cc:515] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.059175 8760 tablet_loader.cc:96] loaded metadata for tablet ff4ea5fcb558489097e518a28ad967dd (table default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4])
I20260505 20:13:33.059513 8877 leader_election.cc:290] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:33.059805 8760 catalog_manager.cc:1486] Time spent T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Loading table and tablet metadata into memory: real 1.185s user 0.154s sys 0.074s
I20260505 20:13:33.059928 8760 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260505 20:13:33.060240 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca74b1f5ccb4f02a11b5d2a1bf2d5a6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.060258 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca74b1f5ccb4f02a11b5d2a1bf2d5a6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.060863 7869 leader_election.cc:343] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:33.060984 7870 leader_election.cc:343] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.061100 7870 leader_election.cc:304] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.061328 8877 raft_consensus.cc:2749] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.064448 8877 raft_consensus.cc:493] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.064576 8877 raft_consensus.cc:515] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.065085 8877 leader_election.cc:290] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.069224 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.070042 7870 leader_election.cc:343] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.070103 8058 tablet_bootstrap.cc:654] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.070266 8760 catalog_manager.cc:1269] Loaded cluster ID: 8e14917c53ec4295b4e8c6dc8fd1b1e5
I20260505 20:13:33.070449 8760 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260505 20:13:33.071465 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.072319 8877 consensus_queue.cc:1048] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.072423 8053 tablet_bootstrap.cc:492] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.072546 8053 ts_tablet_manager.cc:1403] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.099s user 0.018s sys 0.000s
W20260505 20:13:33.072881 7869 leader_election.cc:343] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.072986 7869 leader_election.cc:304] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.073239 8053 raft_consensus.cc:359] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.073390 8877 raft_consensus.cc:2749] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.073412 8053 raft_consensus.cc:385] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.073462 8053 raft_consensus.cc:740] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.073650 8053 consensus_queue.cc:260] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.074185 8053 ts_tablet_manager.cc:1434] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:33.074465 8053 tablet_bootstrap.cc:492] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:33.081943 7869 consensus_peers.cc:597] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:33.082643 8054 tablet_bootstrap.cc:492] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:33.082780 8054 ts_tablet_manager.cc:1403] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.004s
I20260505 20:13:33.083528 8860 raft_consensus.cc:493] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.083690 8860 raft_consensus.cc:515] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.084420 8860 leader_election.cc:290] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:33.085264 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.085808 7870 leader_election.cc:343] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.086613 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.086833 8054 raft_consensus.cc:359] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.087003 8054 raft_consensus.cc:385] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.087064 8054 raft_consensus.cc:740] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:33.087152 7869 leader_election.cc:343] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.087265 8054 consensus_queue.cc:260] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.087287 7869 leader_election.cc:304] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.088230 8639 raft_consensus.cc:2749] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.087788 8054 ts_tablet_manager.cc:1434] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:33.094844 8054 tablet_bootstrap.cc:492] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.098016 8053 tablet_bootstrap.cc:654] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.105166 8054 tablet_bootstrap.cc:654] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.110286 8692 raft_consensus.cc:493] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.110518 8692 raft_consensus.cc:515] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.111194 8692 leader_election.cc:290] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.112190 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17acb52d6cde4ced988506cee48eb040" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.112385 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17acb52d6cde4ced988506cee48eb040" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.112577 8760 catalog_manager.cc:1514] Loading token signing keys...
I20260505 20:13:33.112603 7936 raft_consensus.cc:2468] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:33.113158 7598 leader_election.cc:304] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:33.113606 8053 tablet_bootstrap.cc:492] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.113801 8053 ts_tablet_manager.cc:1403] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.004s
W20260505 20:13:33.113817 7596 leader_election.cc:343] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.114790 8053 raft_consensus.cc:359] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.115005 8053 raft_consensus.cc:385] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.115072 8053 raft_consensus.cc:740] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.115307 8053 consensus_queue.cc:260] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.115828 8053 ts_tablet_manager.cc:1434] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:33.116676 8054 tablet_bootstrap.cc:492] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:33.116787 8054 ts_tablet_manager.cc:1403] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260505 20:13:33.117516 8054 raft_consensus.cc:359] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.117676 8054 raft_consensus.cc:385] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.117717 8054 raft_consensus.cc:740] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.118011 8054 consensus_queue.cc:260] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.118798 8692 raft_consensus.cc:2804] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:33.118906 8692 raft_consensus.cc:493] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:33.119010 8692 raft_consensus.cc:3060] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.120947 8054 ts_tablet_manager.cc:1434] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:33.121225 8054 tablet_bootstrap.cc:492] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.122819 8760 catalog_manager.cc:6055] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Loaded TSK: 0
I20260505 20:13:33.122864 8054 tablet_bootstrap.cc:654] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.123912 8053 tablet_bootstrap.cc:492] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.125614 8053 tablet_bootstrap.cc:654] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.129504 8639 consensus_queue.cc:1048] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.130311 8760 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260505 20:13:33.139283 8054 tablet_bootstrap.cc:492] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:33.139515 8054 ts_tablet_manager.cc:1403] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260505 20:13:33.140417 8054 raft_consensus.cc:359] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.140667 8054 raft_consensus.cc:385] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.140789 8054 raft_consensus.cc:740] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.141183 8054 consensus_queue.cc:260] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.142362 8053 tablet_bootstrap.cc:492] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.141714 8054 ts_tablet_manager.cc:1434] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:33.143718 8557 consensus_queue.cc:1048] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.149240 8054 tablet_bootstrap.cc:492] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.151036 8054 tablet_bootstrap.cc:654] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.151454 8692 raft_consensus.cc:515] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.152033 8053 ts_tablet_manager.cc:1403] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20260505 20:13:33.143316 8616 raft_consensus.cc:493] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.152402 8616 raft_consensus.cc:515] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.152859 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17acb52d6cde4ced988506cee48eb040" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:33.152944 8692 leader_election.cc:290] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.152899 8053 raft_consensus.cc:359] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.153060 8053 raft_consensus.cc:385] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.153128 8053 raft_consensus.cc:740] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.153337 8053 consensus_queue.cc:260] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.153759 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17acb52d6cde4ced988506cee48eb040" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:33.153842 8053 ts_tablet_manager.cc:1434] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:33.153928 7936 raft_consensus.cc:3060] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.154131 8053 tablet_bootstrap.cc:492] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.146692 7794 raft_consensus.cc:3060] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.155773 8053 tablet_bootstrap.cc:654] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.156775 7936 raft_consensus.cc:2468] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:33.153041 8616 leader_election.cc:290] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.158058 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.158391 7663 raft_consensus.cc:2393] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:33.159061 7598 leader_election.cc:304] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:33.159885 8557 raft_consensus.cc:2804] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:33.160030 8557 raft_consensus.cc:697] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:33.160295 8557 consensus_queue.cc:237] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:33.163445 7596 leader_election.cc:343] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.165407 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.166263 7737 leader_election.cc:304] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.166877 8616 raft_consensus.cc:3060] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.167218 8692 raft_consensus.cc:493] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.167420 8692 raft_consensus.cc:515] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.168591 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46c981a27ac4527a40d49714356185e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.169293 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46c981a27ac4527a40d49714356185e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.169528 7936 raft_consensus.cc:2468] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:33.170063 7598 leader_election.cc:304] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:33.170365 8693 raft_consensus.cc:2804] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:33.170495 8693 raft_consensus.cc:493] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:33.170607 8693 raft_consensus.cc:3060] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.170985 8616 raft_consensus.cc:2749] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.174542 8693 raft_consensus.cc:515] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.175359 8693 leader_election.cc:290] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.176506 8639 consensus_queue.cc:1048] T 34883b630a87480f953facb44615ef65 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:33.177840 7596 leader_election.cc:343] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.178212 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46c981a27ac4527a40d49714356185e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:33.178454 7936 raft_consensus.cc:3060] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.179677 8692 leader_election.cc:290] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.181844 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46c981a27ac4527a40d49714356185e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:33.182462 7596 leader_election.cc:343] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.185070 7936 raft_consensus.cc:2468] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:33.193773 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet f3b3c646af9843048382e77b138aea44 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.194792 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.198776 7598 leader_election.cc:304] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:33.199421 8693 raft_consensus.cc:2804] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:33.199891 8693 raft_consensus.cc:697] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:33.200321 8693 consensus_queue.cc:237] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.214493 7406 master_service.cc:954] ReplaceTablet: received request to replace tablet 096ca710e3564d4b8db50f29dd56a5d4 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.216086 7404 master_service.cc:954] ReplaceTablet: received request to replace tablet 880cbba188144dd795873186f8cda1e9 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.218529 8058 tablet_bootstrap.cc:492] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:33.218748 8058 ts_tablet_manager.cc:1403] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.163s user 0.027s sys 0.047s
I20260505 20:13:33.219767 8058 raft_consensus.cc:359] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.220028 8058 raft_consensus.cc:385] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.220118 8058 raft_consensus.cc:740] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.220371 8058 consensus_queue.cc:260] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.223007 8058 ts_tablet_manager.cc:1434] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260505 20:13:33.223358 8058 tablet_bootstrap.cc:492] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:33.225240 8058 tablet_bootstrap.cc:654] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.225874 8692 consensus_queue.cc:1048] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.227741 8616 raft_consensus.cc:493] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.227939 8616 raft_consensus.cc:515] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:33.228708 8616 leader_election.cc:290] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.229400 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.229465 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.230136 7737 leader_election.cc:304] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.230512 8616 raft_consensus.cc:2749] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.239820 8058 tablet_bootstrap.cc:492] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:33.240012 8058 ts_tablet_manager.cc:1403] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260505 20:13:33.241567 8058 raft_consensus.cc:359] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.241818 8058 raft_consensus.cc:385] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.241920 8058 raft_consensus.cc:740] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.242220 8058 consensus_queue.cc:260] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.243969 8058 ts_tablet_manager.cc:1434] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260505 20:13:33.245007 8058 tablet_bootstrap.cc:492] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:33.247393 8058 tablet_bootstrap.cc:654] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.249583 8692 raft_consensus.cc:493] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.249827 8692 raft_consensus.cc:515] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.250626 8692 leader_election.cc:290] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.251278 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.251518 7933 raft_consensus.cc:2468] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:33.251930 7598 leader_election.cc:304] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:33.252384 8692 raft_consensus.cc:2804] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:33.252514 8692 raft_consensus.cc:493] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:33.252653 8692 raft_consensus.cc:3060] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.259184 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.260094 8692 raft_consensus.cc:515] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:33.260378 7596 leader_election.cc:343] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.261446 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:33.262085 7596 leader_election.cc:343] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.262053 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:33.262276 7933 raft_consensus.cc:3060] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.265662 7933 raft_consensus.cc:2468] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:33.266235 7598 leader_election.cc:304] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:33.266574 8776 raft_consensus.cc:2804] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:33.267455 8639 raft_consensus.cc:493] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.267565 8639 raft_consensus.cc:515] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.268154 8639 leader_election.cc:290] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.269352 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2b417857347468529868b51ec07ab" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.270088 7870 leader_election.cc:343] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.272467 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2b417857347468529868b51ec07ab" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:33.272997 7869 leader_election.cc:343] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.273092 7869 leader_election.cc:304] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.273411 8639 raft_consensus.cc:2749] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:33.273941 7737 consensus_peers.cc:597] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:33.277006 8639 raft_consensus.cc:493] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.277134 8639 raft_consensus.cc:515] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.277789 8639 leader_election.cc:290] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.278671 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e650b297603425184ad97ddf99ec36d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.279202 7870 leader_election.cc:343] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.279186 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e650b297603425184ad97ddf99ec36d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:33.280071 7869 leader_election.cc:343] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.280251 7869 leader_election.cc:304] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.280656 8639 raft_consensus.cc:2749] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.188814 7413 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_aa714545b11e4ed3a0e546cddc77be98" } modify_external_catalogs: true
I20260505 20:13:33.285408 7413 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_aa714545b11e4ed3a0e546cddc77be98" } modify_external_catalogs: true
I20260505 20:13:33.286228 8776 raft_consensus.cc:697] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:33.286618 8776 consensus_queue.cc:237] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.189535 7410 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_2036d69d672348c0b08335df0c49d801" } new_table_name: "default.Table_d678b8a74d2946ca99c70e3a0f5b5b08" modify_external_catalogs: true
I20260505 20:13:33.191218 7409 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71" } modify_external_catalogs: true
I20260505 20:13:33.292107 7409 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71" } modify_external_catalogs: true
I20260505 20:13:33.292914 8692 leader_election.cc:290] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.191566 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_5cb3708c35b247e2b4ee66f2c5d616d4" } modify_external_catalogs: true
I20260505 20:13:33.192202 7405 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_8804fbdfa25b473486e2051929590ef4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.294807 7405 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8804fbdfa25b473486e2051929590ef4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.214183 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_035bd09058974bb3af45abcaa4ca635d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.297235 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_035bd09058974bb3af45abcaa4ca635d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.214200 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_6ffbc06ec7fd4793b25a6183080486ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.299078 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ffbc06ec7fd4793b25a6183080486ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.293654 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_5cb3708c35b247e2b4ee66f2c5d616d4" } modify_external_catalogs: true
I20260505 20:13:33.188680 7411 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_817fb0aff75f4e239ba5270ce18debd9" } new_table_name: "default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d" modify_external_catalogs: true
I20260505 20:13:33.335212 8616 raft_consensus.cc:493] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.335390 8616 raft_consensus.cc:515] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.336104 8616 leader_election.cc:290] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.337174 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.337432 7661 raft_consensus.cc:2393] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:33.337445 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.338238 7737 leader_election.cc:304] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.338792 8616 raft_consensus.cc:3060] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.342156 8616 raft_consensus.cc:2749] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:33.349290 7399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 112288us
W20260505 20:13:33.352669 7410 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ca1fb1425e347d191f3c5931d9bf224 consensus state has no leader
I20260505 20:13:33.361495 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:33.363535 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 0ec5c094e2bb4a4481825df17becde52
W20260505 20:13:33.386494 7400 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8ca1fb1425e347d191f3c5931d9bf224 consensus state has no leader
I20260505 20:13:33.390295 7303 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskf21k8s/build/asan/bin/kudu
/tmp/dist-test-taskf21k8s/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.254:38755
--webserver_interface=127.7.33.254
--webserver_port=35921
--builtin_ntp_servers=127.7.33.212:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260505 20:13:33.400444 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.400929 8053 tablet_bootstrap.cc:492] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.401090 8053 ts_tablet_manager.cc:1403] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.247s user 0.020s sys 0.058s
I20260505 20:13:33.401902 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.402379 8054 tablet_bootstrap.cc:492] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:33.402547 8054 ts_tablet_manager.cc:1403] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.253s user 0.024s sys 0.056s
I20260505 20:13:33.403347 8054 raft_consensus.cc:359] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.403548 8054 raft_consensus.cc:385] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.403638 8054 raft_consensus.cc:740] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.403846 8054 consensus_queue.cc:260] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.404414 8054 ts_tablet_manager.cc:1434] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:33.404597 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.405936 8053 raft_consensus.cc:359] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.406097 8053 raft_consensus.cc:385] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.406154 8053 raft_consensus.cc:740] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.406347 8053 consensus_queue.cc:260] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.406896 8053 ts_tablet_manager.cc:1434] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:33.407182 8053 tablet_bootstrap.cc:492] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.408852 8053 tablet_bootstrap.cc:654] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.410372 8054 tablet_bootstrap.cc:492] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.415349 8054 tablet_bootstrap.cc:654] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.440272 8058 tablet_bootstrap.cc:492] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:33.440474 8058 ts_tablet_manager.cc:1403] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.196s user 0.030s sys 0.036s
I20260505 20:13:33.442911 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_4d734c3b988341548c565edf9dd4373f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.443586 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d734c3b988341548c565edf9dd4373f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.446283 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:33.447696 7410 catalog_manager.cc:5671] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:33.448612 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0b1e6d72c57e42f09432a30295c47f1f (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]). Expected version 2 got 0
I20260505 20:13:33.446965 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_4d6492029fd442a4a8f9f68ca4726e61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:33.449004 7410 catalog_manager.cc:5671] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
W20260505 20:13:33.449528 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d6492029fd442a4a8f9f68ca4726e61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:33.451180 7409 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 50680deff6fe4dcabbf5a3aeb47ac01e consensus state has no leader
I20260505 20:13:33.451938 8718 consensus_queue.cc:1048] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.453097 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_f7765b40e19645f281ad2da563b7a009"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:33.453688 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
W20260505 20:13:33.454154 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7765b40e19645f281ad2da563b7a009 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.462575 8058 raft_consensus.cc:359] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.462827 8058 raft_consensus.cc:385] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.462906 8058 raft_consensus.cc:740] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:33.469906 7869 consensus_peers.cc:597] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:33.473301 8058 consensus_queue.cc:260] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.474865 8058 ts_tablet_manager.cc:1434] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.034s user 0.002s sys 0.001s
I20260505 20:13:33.475214 8058 tablet_bootstrap.cc:492] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:33.476171 8938 tablet_replica.cc:333] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:33.476362 8938 raft_consensus.cc:2243] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:33.476528 8938 raft_consensus.cc:2272] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:33.477849 8053 tablet_bootstrap.cc:492] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.477974 8053 ts_tablet_manager.cc:1403] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.004s
I20260505 20:13:33.478700 8054 tablet_bootstrap.cc:492] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:33.478865 8054 ts_tablet_manager.cc:1403] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.008s
I20260505 20:13:33.478895 8058 tablet_bootstrap.cc:654] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.479672 8054 raft_consensus.cc:359] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.479878 8054 raft_consensus.cc:385] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.479966 8054 raft_consensus.cc:740] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.480216 8054 consensus_queue.cc:260] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.481673 8054 ts_tablet_manager.cc:1434] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:33.482841 8054 tablet_bootstrap.cc:492] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.484549 8054 tablet_bootstrap.cc:654] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.484436 8053 raft_consensus.cc:359] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.484655 8053 raft_consensus.cc:385] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.484717 8053 raft_consensus.cc:740] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.484961 8053 consensus_queue.cc:260] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.495353 8053 ts_tablet_manager.cc:1434] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260505 20:13:33.495720 8053 tablet_bootstrap.cc:492] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.497131 8938 ts_tablet_manager.cc:1916] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:33.508414 8053 tablet_bootstrap.cc:654] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.509806 7404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 880cbba188144dd795873186f8cda1e9
I20260505 20:13:33.510383 7404 catalog_manager.cc:6741] ReplaceTablet: tablet 880cbba188144dd795873186f8cda1e9 deleted and replaced by tablet 6c20374c4df742799110a12f3fea5daa
I20260505 20:13:33.514107 7406 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:33.514580 7406 catalog_manager.cc:6741] ReplaceTablet: tablet 096ca710e3564d4b8db50f29dd56a5d4 deleted and replaced by tablet 369f4a55fdd64e4bb907666bede9f241
I20260505 20:13:33.514783 7406 master_service.cc:954] ReplaceTablet: received request to replace tablet a0d4e198c91c4a0e99d8b798a1dd3433 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.516810 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 880cbba188144dd795873186f8cda1e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c20374c4df742799110a12f3fea5daa) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.517284 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 with delete_type TABLET_DATA_DELETED (replaced by tablet 369f4a55fdd64e4bb907666bede9f241) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.521193 8860 raft_consensus.cc:493] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.521423 8860 raft_consensus.cc:515] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.522234 8860 leader_election.cc:290] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:33.523245 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096ca710e3564d4b8db50f29dd56a5d4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.523955 7870 leader_election.cc:343] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.527356 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096ca710e3564d4b8db50f29dd56a5d4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:33.528649 7869 leader_election.cc:343] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.529008 7869 leader_election.cc:304] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.529507 8860 raft_consensus.cc:2749] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.531390 8860 raft_consensus.cc:493] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.531603 8860 raft_consensus.cc:515] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.532300 8860 leader_election.cc:290] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.533018 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ce3efe875a43d9b30d40623bf8a385" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.533653 7870 leader_election.cc:343] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.534066 8775 raft_consensus.cc:493] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.534273 8775 raft_consensus.cc:515] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.535022 8775 leader_election.cc:290] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.535790 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.536015 7933 raft_consensus.cc:2468] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:33.536703 7598 leader_election.cc:304] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:33.537221 8775 raft_consensus.cc:2804] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:33.537330 8775 raft_consensus.cc:493] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:33.537431 8775 raft_consensus.cc:3060] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.540568 8938 ts_tablet_manager.cc:1929] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:33.541108 8775 raft_consensus.cc:515] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.543812 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:33.544050 7933 raft_consensus.cc:3060] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.546979 7933 raft_consensus.cc:2468] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:33.547956 7598 leader_election.cc:304] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:33.548249 8692 raft_consensus.cc:2804] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:33.550055 8692 raft_consensus.cc:697] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:33.550489 7407 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 484c7cbed038469093dd19b39e1abbc9
I20260505 20:13:33.550397 8692 consensus_queue.cc:237] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:33.551822 7411 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c398f3abe1a5439195a23dd655843720 has no consensus state
I20260505 20:13:33.542762 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.542788 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:33.543606 8053 tablet_bootstrap.cc:492] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:33.554070 7596 leader_election.cc:343] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.554288 8053 ts_tablet_manager.cc:1403] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.002s
W20260505 20:13:33.554467 7596 leader_election.cc:343] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.555810 8053 raft_consensus.cc:359] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.556109 8053 raft_consensus.cc:385] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.556233 8053 raft_consensus.cc:740] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.556686 8053 consensus_queue.cc:260] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.558176 8053 ts_tablet_manager.cc:1434] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:33.558619 8053 tablet_bootstrap.cc:492] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.560662 8776 consensus_queue.cc:1048] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.561149 8053 tablet_bootstrap.cc:654] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.561427 8938 log.cc:1199] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f3b3c646af9843048382e77b138aea44
I20260505 20:13:33.562024 8938 ts_tablet_manager.cc:1950] T f3b3c646af9843048382e77b138aea44 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:33.564268 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f3b3c646af9843048382e77b138aea44 (table default.Table_74b14c0104de480d8de826c45ff1cf37 [id=7d374a42eb6149a183cce40f5c81326f]) successfully deleted
I20260505 20:13:33.565375 8775 leader_election.cc:290] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:33.569869 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 0ec5c094e2bb4a4481825df17becde52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ec5c094e2bb4a4481825df17becde52 already in progress: creating tablet
I20260505 20:13:33.570375 8938 tablet_replica.cc:333] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:33.571244 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:33.575305 8860 consensus_queue.cc:1048] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.576138 8718 raft_consensus.cc:493] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.577859 8718 raft_consensus.cc:515] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.578655 8718 leader_election.cc:290] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.579248 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.579386 8938 raft_consensus.cc:2243] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:33.579586 8938 raft_consensus.cc:2272] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:33.584277 8053 tablet_bootstrap.cc:492] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.584481 8053 ts_tablet_manager.cc:1403] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
I20260505 20:13:33.584527 8938 ts_tablet_manager.cc:1916] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:33.585500 8053 raft_consensus.cc:359] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.585721 8053 raft_consensus.cc:385] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.585831 8053 raft_consensus.cc:740] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.586686 8053 consensus_queue.cc:260] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.588642 8053 ts_tablet_manager.cc:1434] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260505 20:13:33.591125 8053 tablet_bootstrap.cc:492] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.593232 8053 tablet_bootstrap.cc:654] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.583784 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_275f0786976d4e02b3f34fe5cfc01862"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:33.597818 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ce3efe875a43d9b30d40623bf8a385" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.598762 8938 ts_tablet_manager.cc:1929] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:33.598873 8938 log.cc:1199] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f62626fb4f8445e3a6e2822277181762
I20260505 20:13:33.599298 8938 ts_tablet_manager.cc:1950] T f62626fb4f8445e3a6e2822277181762 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:33.600860 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91ccd9761ee4386b9e80cb9c9cfa975" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.602325 8860 raft_consensus.cc:493] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.602626 8860 raft_consensus.cc:515] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.604403 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.605182 7870 leader_election.cc:343] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:33.605614 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_275f0786976d4e02b3f34fe5cfc01862 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.606016 8860 leader_election.cc:290] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.606880 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f62626fb4f8445e3a6e2822277181762 (table default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]) successfully deleted
I20260505 20:13:33.607016 7412 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_53010b8cbf5e426590b4f82d68e96660" } new_table_name: "default.Table_ea0f05ec98db400598340a9825b698ff" modify_external_catalogs: true
W20260505 20:13:33.607291 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 880cbba188144dd795873186f8cda1e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 880cbba188144dd795873186f8cda1e9 already in progress: creating tablet
W20260505 20:13:33.607570 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 096ca710e3564d4b8db50f29dd56a5d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 096ca710e3564d4b8db50f29dd56a5d4 already in progress: creating tablet
I20260505 20:13:33.606206 7411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_45bd1808371b4519abd37364b534e889"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.608381 7411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45bd1808371b4519abd37364b534e889 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.613294 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.614034 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.614166 7409 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_4dda980af4a44fb3b08d9845bc9a4c2f" } new_table_name: "default.Table_e668fd82eb274b2fb39e758534ec447c" modify_external_catalogs: true
I20260505 20:13:33.606635 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_e4b497841d1c48fc87bbb37cd4e68890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.614761 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4b497841d1c48fc87bbb37cd4e68890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.614920 8718 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.615095 8718 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:33.615943 8718 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.618297 8053 tablet_bootstrap.cc:492] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.618430 8053 ts_tablet_manager.cc:1403] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260505 20:13:33.619161 8053 raft_consensus.cc:359] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.619307 8053 raft_consensus.cc:385] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.619359 8053 raft_consensus.cc:740] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.619551 8053 consensus_queue.cc:260] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.619757 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.620052 8053 ts_tablet_manager.cc:1434] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:33.620323 8053 tablet_bootstrap.cc:492] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.622156 8053 tablet_bootstrap.cc:654] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.624393 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet 880cbba188144dd795873186f8cda1e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c20374c4df742799110a12f3fea5daa) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:33.625608 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:33.628955 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 with delete_type TABLET_DATA_DELETED (replaced by tablet 369f4a55fdd64e4bb907666bede9f241) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:33.629498 8775 raft_consensus.cc:493] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.635613 7407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_6d292d45d5d24556b062b5b0fd05a0b1" } new_table_name: "default.Table_d230cae490dd484187dccd1014a710f5" modify_external_catalogs: true
I20260505 20:13:33.638465 8775 raft_consensus.cc:515] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.639614 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0677740c3f77442895361e22d616a9ba" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:33.640209 7596 leader_election.cc:343] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.642839 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0677740c3f77442895361e22d616a9ba" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.643108 7936 raft_consensus.cc:2468] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:33.643860 7598 leader_election.cc:304] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:33.644335 8776 raft_consensus.cc:2804] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:33.644425 8776 raft_consensus.cc:493] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:33.644521 8776 raft_consensus.cc:3060] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.647294 8776 raft_consensus.cc:515] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.648159 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_d6c96dbb361b457684823113cd6727ea" } modify_external_catalogs: true
I20260505 20:13:33.648367 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_d6c96dbb361b457684823113cd6727ea" } modify_external_catalogs: true
I20260505 20:13:33.647984 8776 leader_election.cc:290] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.648896 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f32414ac94684234ab3a25f46213b70b" } modify_external_catalogs: true
I20260505 20:13:33.649066 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f32414ac94684234ab3a25f46213b70b" } modify_external_catalogs: true
I20260505 20:13:33.649436 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet 2540ed5144664ec0bfe0b548a5386176 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.649618 7410 master_service.cc:954] ReplaceTablet: received request to replace tablet 48cce2fd271641ad83c9b3e4beeb12ee from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:33.649701 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0677740c3f77442895361e22d616a9ba" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:33.650285 7596 leader_election.cc:343] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.651245 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0677740c3f77442895361e22d616a9ba" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:33.651472 7936 raft_consensus.cc:3060] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.654552 7936 raft_consensus.cc:2468] T 0677740c3f77442895361e22d616a9ba P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:33.657436 7598 leader_election.cc:304] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:33.658090 8776 raft_consensus.cc:2804] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:33.658326 8776 raft_consensus.cc:697] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:33.658850 8776 consensus_queue.cc:237] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.663451 7411 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_81e65112cd9f427cad2c364792f117bf" } new_table_name: "default.Table_1cdb392893914c328c22a672aa564e6c" modify_external_catalogs: true
I20260505 20:13:33.642068 8775 leader_election.cc:290] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.667652 8860 consensus_queue.cc:1048] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.668066 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 48cce2fd271641ad83c9b3e4beeb12ee
I20260505 20:13:33.668604 7410 catalog_manager.cc:6741] ReplaceTablet: tablet 48cce2fd271641ad83c9b3e4beeb12ee deleted and replaced by tablet a114db19f63346d9a67e9e3a8225caa4
I20260505 20:13:33.668911 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee with delete_type TABLET_DATA_DELETED (replaced by tablet a114db19f63346d9a67e9e3a8225caa4) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.668967 7410 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf" } modify_external_catalogs: true
I20260505 20:13:33.669186 8938 tablet_replica.cc:333] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:33.669121 7410 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf" } modify_external_catalogs: true
I20260505 20:13:33.669396 8938 raft_consensus.cc:2243] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:33.669715 8938 raft_consensus.cc:2272] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:33.670410 8938 ts_tablet_manager.cc:1916] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:33.675570 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee with delete_type TABLET_DATA_DELETED (replaced by tablet a114db19f63346d9a67e9e3a8225caa4) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:33.677731 8938 ts_tablet_manager.cc:1929] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:33.677943 8938 log.cc:1199] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/48cce2fd271641ad83c9b3e4beeb12ee
I20260505 20:13:33.678391 8938 ts_tablet_manager.cc:1950] T 48cce2fd271641ad83c9b3e4beeb12ee P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:33.679817 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]) successfully deleted
I20260505 20:13:33.690856 8053 tablet_bootstrap.cc:492] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.691027 8053 ts_tablet_manager.cc:1403] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.071s user 0.012s sys 0.022s
I20260505 20:13:33.691486 7737 leader_election.cc:304] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.691851 8053 raft_consensus.cc:359] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.692051 8053 raft_consensus.cc:385] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.692049 8718 raft_consensus.cc:2749] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.692147 8053 raft_consensus.cc:740] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.692334 8053 consensus_queue.cc:260] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.692811 8053 ts_tablet_manager.cc:1434] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:33.693110 8053 tablet_bootstrap.cc:492] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.696327 7795 raft_consensus.cc:3060] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.698124 8053 tablet_bootstrap.cc:654] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.700600 8693 consensus_queue.cc:1048] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.706152 8861 consensus_queue.cc:1048] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.706689 8861 raft_consensus.cc:493] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.706861 8861 raft_consensus.cc:515] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.707574 8861 leader_election.cc:290] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.708232 7781 tablet_service.cc:1511] Processing CreateTablet for tablet c398f3abe1a5439195a23dd655843720 (DEFAULT_TABLE table=default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.708668 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c398f3abe1a5439195a23dd655843720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.716493 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:33.717537 7870 leader_election.cc:343] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.718551 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:33.719118 7408 catalog_manager.cc:6741] ReplaceTablet: tablet 2540ed5144664ec0bfe0b548a5386176 deleted and replaced by tablet 335acbbc84624d61b779a422f29919fa
I20260505 20:13:33.719525 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_4678f19979234d3bba292f510282993e" } modify_external_catalogs: true
I20260505 20:13:33.719753 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_4678f19979234d3bba292f510282993e" } modify_external_catalogs: true
I20260505 20:13:33.723646 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:33.726867 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.728710 7406 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet a0d4e198c91c4a0e99d8b798a1dd3433
I20260505 20:13:33.729278 7406 catalog_manager.cc:6741] ReplaceTablet: tablet a0d4e198c91c4a0e99d8b798a1dd3433 deleted and replaced by tablet a694c65f90f4499ab96e45fbbaa9e892
I20260505 20:13:33.729653 7406 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_275f0786976d4e02b3f34fe5cfc01862" } modify_external_catalogs: true
I20260505 20:13:33.729898 7406 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_275f0786976d4e02b3f34fe5cfc01862" } modify_external_catalogs: true
I20260505 20:13:33.732328 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:33.734014 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 2540ed5144664ec0bfe0b548a5386176 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2540ed5144664ec0bfe0b548a5386176 already in progress: creating tablet
I20260505 20:13:33.735395 8718 raft_consensus.cc:493] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.735538 8718 raft_consensus.cc:515] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.736155 8718 leader_election.cc:290] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.737197 8861 consensus_queue.cc:1048] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.737540 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:33.739439 7406 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 0c562df9a03e45b088fa4be25d002a43
I20260505 20:13:33.739825 7406 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_97f41d02dd424799b34e1d9486191811"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.740387 7406 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97f41d02dd424799b34e1d9486191811 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:33.740464 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet a0d4e198c91c4a0e99d8b798a1dd3433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d4e198c91c4a0e99d8b798a1dd3433 already in progress: creating tablet
I20260505 20:13:33.742583 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 09bb5e21649a4cc39764a3847fa41c21 (DEFAULT_TABLE table=default.Table_72ff1e9617b74cd2af00b37a2b306db6 [id=d86211f549eb4711904778e1cb7494b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.742877 7628 tablet_service.cc:1511] Processing CreateTablet for tablet c398f3abe1a5439195a23dd655843720 (DEFAULT_TABLE table=default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.743160 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bb5e21649a4cc39764a3847fa41c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.743364 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c398f3abe1a5439195a23dd655843720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.744969 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a8adf31bc94a33a61468adf2673681" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.745836 8718 consensus_queue.cc:1048] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.750757 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 09bb5e21649a4cc39764a3847fa41c21 (DEFAULT_TABLE table=default.Table_72ff1e9617b74cd2af00b37a2b306db6 [id=d86211f549eb4711904778e1cb7494b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.751256 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bb5e21649a4cc39764a3847fa41c21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:33.752774 7869 leader_election.cc:343] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.752908 7869 leader_election.cc:304] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.753451 8861 raft_consensus.cc:2749] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:33.753628 8861 consensus_queue.cc:1048] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:33.755308 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.755839 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.758090 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 68718abc133e452495567232e51fb55b (DEFAULT_TABLE table=default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.758517 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68718abc133e452495567232e51fb55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.762130 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 68718abc133e452495567232e51fb55b (DEFAULT_TABLE table=default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.762506 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68718abc133e452495567232e51fb55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.770779 7406 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_ea3e50a7f8674f1bbf87cffd1ecda924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:33.771627 7406 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea3e50a7f8674f1bbf87cffd1ecda924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.779372 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc9a6e1c824305869f6634192c5e78 (DEFAULT_TABLE table=default.Table_7864889bd60f4d50a92b38018c93ca92 [id=b7b0d663a8144e5d8124929fa88a7b62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.779808 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc9a6e1c824305869f6634192c5e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.781417 8053 tablet_bootstrap.cc:492] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.781553 8053 ts_tablet_manager.cc:1403] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.010s
I20260505 20:13:33.784646 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 3f01954a7a194e159a86152625e1ff6b (DEFAULT_TABLE table=default.Table_501dd560884045e79bb35144cae9d817 [id=c75180068c5d4a11805340d9508a2738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.785179 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f01954a7a194e159a86152625e1ff6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.782341 8053 raft_consensus.cc:359] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.785868 8053 raft_consensus.cc:385] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.785949 8053 raft_consensus.cc:740] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.786154 8053 consensus_queue.cc:260] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.787451 8053 ts_tablet_manager.cc:1434] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:33.788365 8053 tablet_bootstrap.cc:492] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.788579 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 3f01954a7a194e159a86152625e1ff6b (DEFAULT_TABLE table=default.Table_501dd560884045e79bb35144cae9d817 [id=c75180068c5d4a11805340d9508a2738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.789078 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f01954a7a194e159a86152625e1ff6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.791977 8053 tablet_bootstrap.cc:654] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.793277 7406 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_76b32ec6ddb64571a8c264c3e9449741"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:33.794124 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc9a6e1c824305869f6634192c5e78 (DEFAULT_TABLE table=default.Table_7864889bd60f4d50a92b38018c93ca92 [id=b7b0d663a8144e5d8124929fa88a7b62]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:33.794270 7406 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76b32ec6ddb64571a8c264c3e9449741 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:33.796609 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc9a6e1c824305869f6634192c5e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.806005 7406 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_e4b497841d1c48fc87bbb37cd4e68890" } modify_external_catalogs: true
I20260505 20:13:33.806351 7406 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_e4b497841d1c48fc87bbb37cd4e68890" } modify_external_catalogs: true
I20260505 20:13:33.819217 8639 raft_consensus.cc:493] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.819429 8639 raft_consensus.cc:515] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.820243 8639 leader_election.cc:290] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.821996 7406 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 1c8ee6cb71ff4aec93ea192762ae31a6
I20260505 20:13:33.822234 8639 raft_consensus.cc:493] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.822402 8639 raft_consensus.cc:515] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.822990 8639 leader_election.cc:290] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:33.824147 7406 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_5eb1b00bd31442779cd50c207d3a2b1e" } new_table_name: "default.Table_5c7ee4db09f44c5099b163f37f1f6486" modify_external_catalogs: true
I20260505 20:13:33.825543 8054 tablet_bootstrap.cc:492] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:33.825695 8054 ts_tablet_manager.cc:1403] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.343s user 0.018s sys 0.051s
I20260505 20:13:33.825901 8053 tablet_bootstrap.cc:492] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.826038 8053 ts_tablet_manager.cc:1403] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.001s
I20260505 20:13:33.826568 8054 raft_consensus.cc:359] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.826808 8054 raft_consensus.cc:385] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.826936 8054 raft_consensus.cc:740] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.827193 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.827266 8054 consensus_queue.cc:260] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.827827 8053 raft_consensus.cc:359] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.828023 8053 raft_consensus.cc:385] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.828073 8053 raft_consensus.cc:740] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.828265 8053 consensus_queue.cc:260] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.828728 8054 ts_tablet_manager.cc:1434] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:33.828884 8053 ts_tablet_manager.cc:1434] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:33.829206 8054 tablet_bootstrap.cc:492] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:33.830185 8053 tablet_bootstrap.cc:492] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.831318 8054 tablet_bootstrap.cc:654] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.831707 8053 tablet_bootstrap.cc:654] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.837347 8718 raft_consensus.cc:493] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.837482 8718 raft_consensus.cc:515] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.838121 8718 leader_election.cc:290] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.850853 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 28caca1a9a044701991ebda53cf75499 (DEFAULT_TABLE table=default.Table_314707634b784fa686de6f277f00aec1 [id=9f4a27a994cd4272bc7dd94a1ffde607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.851267 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28caca1a9a044701991ebda53cf75499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.854240 7766 tablet_service.cc:1511] Processing CreateTablet for tablet be05357416b24dabaaa5f2ce2f33c82e (DEFAULT_TABLE table=default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.854737 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be05357416b24dabaaa5f2ce2f33c82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.855068 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 907b7dccd7a94115aca36915a558b103 (DEFAULT_TABLE table=default.Table_3b4a78f1dba2415d8d85b7dea798ed28 [id=8f922183d9054257a9e0cb61880d57cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.855417 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907b7dccd7a94115aca36915a558b103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.857080 7737 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.857355 8718 raft_consensus.cc:2749] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:33.857509 7737 consensus_peers.cc:597] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22a98da176254eeb896c680fbcb98caa. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:33.858378 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.858933 7796 raft_consensus.cc:3060] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.863085 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:33.868578 8957 tablet_replica.cc:333] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
W20260505 20:13:33.877666 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 880cbba188144dd795873186f8cda1e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 880cbba188144dd795873186f8cda1e9 already in progress: creating tablet
W20260505 20:13:33.878041 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 0ec5c094e2bb4a4481825df17becde52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ec5c094e2bb4a4481825df17becde52 already in progress: creating tablet
W20260505 20:13:33.878295 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 096ca710e3564d4b8db50f29dd56a5d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 096ca710e3564d4b8db50f29dd56a5d4 already in progress: creating tablet
I20260505 20:13:33.878641 8053 tablet_bootstrap.cc:492] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:33.878820 8053 ts_tablet_manager.cc:1403] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20260505 20:13:33.879915 8053 raft_consensus.cc:359] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.880169 8053 raft_consensus.cc:385] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.880241 8053 raft_consensus.cc:740] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.880478 8053 consensus_queue.cc:260] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.880590 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.881143 8053 ts_tablet_manager.cc:1434] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:33.881387 8053 tablet_bootstrap.cc:492] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:33.883148 8053 tablet_bootstrap.cc:654] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.883762 7628 tablet_service.cc:1511] Processing CreateTablet for tablet be05357416b24dabaaa5f2ce2f33c82e (DEFAULT_TABLE table=default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.884275 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be05357416b24dabaaa5f2ce2f33c82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.888127 8957 raft_consensus.cc:2243] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:33.893380 8957 raft_consensus.cc:2272] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:33.894184 8957 ts_tablet_manager.cc:1916] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:33.895689 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.895752 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:33.898963 7766 tablet_service.cc:1511] Processing CreateTablet for tablet e2c99f02ea514a2581f0697dc3ef6461 (DEFAULT_TABLE table=default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.899385 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c99f02ea514a2581f0697dc3ef6461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.899722 8058 tablet_bootstrap.cc:492] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:33.899863 8058 ts_tablet_manager.cc:1403] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.425s user 0.093s sys 0.118s
I20260505 20:13:33.901171 8058 raft_consensus.cc:359] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.901350 8058 raft_consensus.cc:385] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.901429 8058 raft_consensus.cc:740] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.901623 8058 consensus_queue.cc:260] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.901921 8718 raft_consensus.cc:493] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.902047 8718 raft_consensus.cc:515] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.902460 8058 ts_tablet_manager.cc:1434] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:33.902571 8718 leader_election.cc:290] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:33.902748 8058 tablet_bootstrap.cc:492] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:33.904371 8058 tablet_bootstrap.cc:654] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.897684 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 28caca1a9a044701991ebda53cf75499 (DEFAULT_TABLE table=default.Table_314707634b784fa686de6f277f00aec1 [id=9f4a27a994cd4272bc7dd94a1ffde607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.913422 7799 raft_consensus.cc:3060] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:33.913882 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 09bb5e21649a4cc39764a3847fa41c21 (DEFAULT_TABLE table=default.Table_72ff1e9617b74cd2af00b37a2b306db6 [id=d86211f549eb4711904778e1cb7494b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.914288 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bb5e21649a4cc39764a3847fa41c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.914641 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 68718abc133e452495567232e51fb55b (DEFAULT_TABLE table=default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.915045 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68718abc133e452495567232e51fb55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.916555 7913 tablet_service.cc:1511] Processing CreateTablet for tablet c398f3abe1a5439195a23dd655843720 (DEFAULT_TABLE table=default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.916898 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c398f3abe1a5439195a23dd655843720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.924171 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 3f01954a7a194e159a86152625e1ff6b (DEFAULT_TABLE table=default.Table_501dd560884045e79bb35144cae9d817 [id=c75180068c5d4a11805340d9508a2738]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.924541 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f01954a7a194e159a86152625e1ff6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.848668 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a8adf31bc94a33a61468adf2673681" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.856247 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:33.856735 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee with delete_type TABLET_DATA_DELETED (replaced by tablet a114db19f63346d9a67e9e3a8225caa4) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:33.856904 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:33.857038 7915 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:33.857784 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 880cbba188144dd795873186f8cda1e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c20374c4df742799110a12f3fea5daa) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:33.857983 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 with delete_type TABLET_DATA_DELETED (replaced by tablet 369f4a55fdd64e4bb907666bede9f241) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:33.864717 8860 raft_consensus.cc:493] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.925266 8860 raft_consensus.cc:515] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.925988 8860 leader_election.cc:290] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:33.865047 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:33.884109 8639 raft_consensus.cc:493] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:33.926332 8639 raft_consensus.cc:515] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.926857 8639 leader_election.cc:290] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:33.889359 7870 leader_election.cc:343] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.927220 7933 raft_consensus.cc:2393] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
W20260505 20:13:33.928071 7870 leader_election.cc:343] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.930305 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc9a6e1c824305869f6634192c5e78 (DEFAULT_TABLE table=default.Table_7864889bd60f4d50a92b38018c93ca92 [id=b7b0d663a8144e5d8124929fa88a7b62]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:33.930492 7869 leader_election.cc:343] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.930649 7869 leader_election.cc:304] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:33.930995 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 28caca1a9a044701991ebda53cf75499 (DEFAULT_TABLE table=default.Table_314707634b784fa686de6f277f00aec1 [id=9f4a27a994cd4272bc7dd94a1ffde607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.931571 7915 tablet_service.cc:1511] Processing CreateTablet for tablet be05357416b24dabaaa5f2ce2f33c82e (DEFAULT_TABLE table=default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.932157 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 907b7dccd7a94115aca36915a558b103 (DEFAULT_TABLE table=default.Table_3b4a78f1dba2415d8d85b7dea798ed28 [id=8f922183d9054257a9e0cb61880d57cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.930714 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc9a6e1c824305869f6634192c5e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.933979 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28caca1a9a044701991ebda53cf75499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.936854 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 1f317f62391b422db2bf2a97ef928f99 (DEFAULT_TABLE table=default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.937263 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f317f62391b422db2bf2a97ef928f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.939893 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47720452d3f44e18b16a06ae296b4c51" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.941517 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907b7dccd7a94115aca36915a558b103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.942001 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.946036 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be05357416b24dabaaa5f2ce2f33c82e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.948802 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 9e217456754440cf90a1c5a642eb2627 (DEFAULT_TABLE table=default.Table_58b87c163c1f49a89a9bc55d655baf2f [id=42fd7d09cb3e448e9be4b7d49262f43e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.949288 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e217456754440cf90a1c5a642eb2627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.953513 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28caca1a9a044701991ebda53cf75499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.954658 8058 tablet_bootstrap.cc:492] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:33.954895 8058 ts_tablet_manager.cc:1403] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.001s
I20260505 20:13:33.955458 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bdc29641404cee850f27e9c392fbc0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.955834 8058 raft_consensus.cc:359] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.964920 8058 raft_consensus.cc:385] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:33.965090 8058 raft_consensus.cc:740] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:33.965372 8058 consensus_queue.cc:260] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:33.967089 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 1f317f62391b422db2bf2a97ef928f99 (DEFAULT_TABLE table=default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.967501 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f317f62391b422db2bf2a97ef928f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.967777 8058 ts_tablet_manager.cc:1434] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.002s sys 0.002s
I20260505 20:13:33.968128 8058 tablet_bootstrap.cc:492] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:33.970069 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 9e217456754440cf90a1c5a642eb2627 (DEFAULT_TABLE table=default.Table_58b87c163c1f49a89a9bc55d655baf2f [id=42fd7d09cb3e448e9be4b7d49262f43e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.970468 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e217456754440cf90a1c5a642eb2627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.972740 8058 tablet_bootstrap.cc:654] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:33.974946 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aad2a9f37ac4cbfa127ecceb132c8bb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:33.977861 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 81319ed5eed64dafb9b2a121661da9ea (DEFAULT_TABLE table=default.Table_2a37262735b9408bb4498e2ad3758f5e [id=cf8f1ee611744c0e979cbf18eebdba52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.978374 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81319ed5eed64dafb9b2a121661da9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:33.984724 8957 ts_tablet_manager.cc:1929] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260505 20:13:33.994479 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 64028us
W20260505 20:13:33.995718 7869 leader_election.cc:343] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:33.996803 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:33.997406 7405 catalog_manager.cc:5671] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
I20260505 20:13:33.997844 8957 log.cc:1199] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/48cce2fd271641ad83c9b3e4beeb12ee
I20260505 20:13:33.998394 8957 ts_tablet_manager.cc:1950] T 48cce2fd271641ad83c9b3e4beeb12ee P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:33.999955 7625 tablet_service.cc:1511] Processing CreateTablet for tablet e2c99f02ea514a2581f0697dc3ef6461 (DEFAULT_TABLE table=default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.000626 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c99f02ea514a2581f0697dc3ef6461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.002370 7782 tablet_service.cc:1511] Processing CreateTablet for tablet ca16deae2e4f4f9a9069822b57c5bc7f (DEFAULT_TABLE table=default.Table_b05a62cc3a7e446e915328413ead238d [id=13c456c402f444bc97f01c7428024341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:33.999513 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]) successfully deleted
W20260505 20:13:34.004050 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 2540ed5144664ec0bfe0b548a5386176 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2540ed5144664ec0bfe0b548a5386176 already in progress: creating tablet
I20260505 20:13:33.999965 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 81319ed5eed64dafb9b2a121661da9ea (DEFAULT_TABLE table=default.Table_2a37262735b9408bb4498e2ad3758f5e [id=cf8f1ee611744c0e979cbf18eebdba52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.006273 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81319ed5eed64dafb9b2a121661da9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.011277 7632 tablet_service.cc:1511] Processing CreateTablet for tablet ca16deae2e4f4f9a9069822b57c5bc7f (DEFAULT_TABLE table=default.Table_b05a62cc3a7e446e915328413ead238d [id=13c456c402f444bc97f01c7428024341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.011729 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca16deae2e4f4f9a9069822b57c5bc7f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:34.012495 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet a0d4e198c91c4a0e99d8b798a1dd3433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d4e198c91c4a0e99d8b798a1dd3433 already in progress: creating tablet
I20260505 20:13:34.014686 7869 leader_election.cc:304] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.016309 8984 raft_consensus.cc:2749] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:34.017731 7869 leader_election.cc:343] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.018122 7869 leader_election.cc:304] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.018426 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:34.018195 8984 raft_consensus.cc:2749] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.019850 8984 raft_consensus.cc:2749] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.023278 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:34.026302 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 5b60c74cfa0d4c498ed50daefe3905ab (DEFAULT_TABLE table=default.Table_fde64ff0b9514797968ea93a1a179537 [id=62c3b4c1b9724e089448906fab7435c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.026861 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b60c74cfa0d4c498ed50daefe3905ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.032658 7796 raft_consensus.cc:3060] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.033247 8775 consensus_queue.cc:1048] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.035501 7405 catalog_manager.cc:5671] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
I20260505 20:13:34.036334 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:34.039700 7768 tablet_service.cc:1511] Processing CreateTablet for tablet d27febef8234419caa855dd7a180fe8f (DEFAULT_TABLE table=default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.040755 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27febef8234419caa855dd7a180fe8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:34.041910 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 113495us
W20260505 20:13:34.042480 7870 leader_election.cc:343] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.048758 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 5b60c74cfa0d4c498ed50daefe3905ab (DEFAULT_TABLE table=default.Table_fde64ff0b9514797968ea93a1a179537 [id=62c3b4c1b9724e089448906fab7435c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.049656 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b60c74cfa0d4c498ed50daefe3905ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.052340 8983 raft_consensus.cc:493] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.052560 8983 raft_consensus.cc:515] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.053294 8983 leader_election.cc:290] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:34.051182 7628 tablet_service.cc:1511] Processing CreateTablet for tablet d27febef8234419caa855dd7a180fe8f (DEFAULT_TABLE table=default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.055255 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27febef8234419caa855dd7a180fe8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.056672 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca16deae2e4f4f9a9069822b57c5bc7f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:34.065654 7870 leader_election.cc:343] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.073902 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ddf95d810c4c80a5f78c1b7600cee4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.074715 8926 raft_consensus.cc:493] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.074894 8926 raft_consensus.cc:515] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.075603 8926 leader_election.cc:290] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.051769 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:34.080467 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:34.081990 8977 tablet_replica.cc:333] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:34.082288 8977 raft_consensus.cc:2243] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:34.082504 8977 raft_consensus.cc:2272] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:34.083109 8977 ts_tablet_manager.cc:1916] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:34.084204 7781 tablet_service.cc:1511] Processing CreateTablet for tablet b6dc9ec93ddb406ab956389518a9a7b3 (DEFAULT_TABLE table=default.Table_3a544b60f38745948e6026aeaa005366 [id=65cc6685c1474b129203568616b14e8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.084735 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6dc9ec93ddb406ab956389518a9a7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.090471 8058 tablet_bootstrap.cc:492] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.090651 8058 ts_tablet_manager.cc:1403] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.123s user 0.010s sys 0.012s
I20260505 20:13:34.091579 8058 raft_consensus.cc:359] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.091770 8058 raft_consensus.cc:385] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.091883 8058 raft_consensus.cc:740] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.092088 8058 consensus_queue.cc:260] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.092571 8054 tablet_bootstrap.cc:492] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.092588 8058 ts_tablet_manager.cc:1434] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:34.092829 8054 ts_tablet_manager.cc:1403] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.264s user 0.003s sys 0.007s
I20260505 20:13:34.092900 8058 tablet_bootstrap.cc:492] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:34.093385 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 54756.5us
I20260505 20:13:34.093825 8054 raft_consensus.cc:359] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.094044 8054 raft_consensus.cc:385] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.094095 8054 raft_consensus.cc:740] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:34.094281 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 75618.2us
I20260505 20:13:34.094365 8054 consensus_queue.cc:260] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:34.094630 7869 leader_election.cc:343] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.094774 7869 leader_election.cc:304] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.095528 8984 raft_consensus.cc:2749] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.095683 8984 consensus_queue.cc:1048] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.095130 8054 ts_tablet_manager.cc:1434] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:34.098309 8054 tablet_bootstrap.cc:492] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:34.098809 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 0ec5c094e2bb4a4481825df17becde52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ec5c094e2bb4a4481825df17becde52 already in progress: creating tablet
I20260505 20:13:34.099951 8054 tablet_bootstrap.cc:654] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.100425 8692 raft_consensus.cc:493] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.100651 8692 raft_consensus.cc:515] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.101377 8692 leader_election.cc:290] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.101433 7405 catalog_manager.cc:5671] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } }
I20260505 20:13:34.101979 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:34.102267 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:34.102733 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 0b1e6d72c57e42f09432a30295c47f1f (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]). Expected version 2 got 0
I20260505 20:13:34.103171 8058 tablet_bootstrap.cc:654] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.103262 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdda1cc266cd47c993b5d1a0a78c7df9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.103107 7405 catalog_manager.cc:5671] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:34.103523 7936 raft_consensus.cc:2393] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:34.103789 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:34.104171 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 1 got 0
I20260505 20:13:34.104449 7405 catalog_manager.cc:5671] T ea726cff03664c3d81b5e541ef738d4a P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
I20260505 20:13:34.104763 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 1f317f62391b422db2bf2a97ef928f99 (DEFAULT_TABLE table=default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.105268 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f317f62391b422db2bf2a97ef928f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.113191 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 05ec070a0196451c9564fa24b806516c (DEFAULT_TABLE table=default.Table_62aece033038452d8dd6e128877cc4e7 [id=835704ef17524d9683187bdaa11d3181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.113641 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ec070a0196451c9564fa24b806516c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.113940 7900 tablet_service.cc:1511] Processing CreateTablet for tablet e2c99f02ea514a2581f0697dc3ef6461 (DEFAULT_TABLE table=default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.114326 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c99f02ea514a2581f0697dc3ef6461. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:34.115566 7870 leader_election.cc:343] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.116106 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 907b7dccd7a94115aca36915a558b103 (DEFAULT_TABLE table=default.Table_3b4a78f1dba2415d8d85b7dea798ed28 [id=8f922183d9054257a9e0cb61880d57cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.116287 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 81319ed5eed64dafb9b2a121661da9ea (DEFAULT_TABLE table=default.Table_2a37262735b9408bb4498e2ad3758f5e [id=cf8f1ee611744c0e979cbf18eebdba52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.116492 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907b7dccd7a94115aca36915a558b103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.116786 8058 tablet_bootstrap.cc:492] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.116875 7915 tablet_service.cc:1511] Processing CreateTablet for tablet ca16deae2e4f4f9a9069822b57c5bc7f (DEFAULT_TABLE table=default.Table_b05a62cc3a7e446e915328413ead238d [id=13c456c402f444bc97f01c7428024341]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.116981 8058 ts_tablet_manager.cc:1403] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20260505 20:13:34.117417 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 5b60c74cfa0d4c498ed50daefe3905ab (DEFAULT_TABLE table=default.Table_fde64ff0b9514797968ea93a1a179537 [id=62c3b4c1b9724e089448906fab7435c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.118052 7906 tablet_service.cc:1511] Processing CreateTablet for tablet d27febef8234419caa855dd7a180fe8f (DEFAULT_TABLE table=default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.118696 7913 tablet_service.cc:1511] Processing CreateTablet for tablet b6dc9ec93ddb406ab956389518a9a7b3 (DEFAULT_TABLE table=default.Table_3a544b60f38745948e6026aeaa005366 [id=65cc6685c1474b129203568616b14e8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.119364 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 05ec070a0196451c9564fa24b806516c (DEFAULT_TABLE table=default.Table_62aece033038452d8dd6e128877cc4e7 [id=835704ef17524d9683187bdaa11d3181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.119390 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 9e217456754440cf90a1c5a642eb2627 (DEFAULT_TABLE table=default.Table_58b87c163c1f49a89a9bc55d655baf2f [id=42fd7d09cb3e448e9be4b7d49262f43e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.119732 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ec070a0196451c9564fa24b806516c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.119706 7737 leader_election.cc:304] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.120163 7737 leader_election.cc:304] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.120522 7737 leader_election.cc:304] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.121147 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bdc29641404cee850f27e9c392fbc0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.121315 8989 raft_consensus.cc:2749] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.121547 8989 raft_consensus.cc:3060] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.122939 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81319ed5eed64dafb9b2a121661da9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.124495 8989 raft_consensus.cc:2749] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.124666 8989 raft_consensus.cc:2749] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.125674 8058 raft_consensus.cc:359] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.125977 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca16deae2e4f4f9a9069822b57c5bc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.125978 8058 raft_consensus.cc:385] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.126062 8058 raft_consensus.cc:740] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.126288 8058 consensus_queue.cc:260] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.129328 8693 consensus_queue.cc:1048] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.129515 7628 tablet_service.cc:1511] Processing CreateTablet for tablet b6dc9ec93ddb406ab956389518a9a7b3 (DEFAULT_TABLE table=default.Table_3a544b60f38745948e6026aeaa005366 [id=65cc6685c1474b129203568616b14e8b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:34.129884 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 63225.4us
I20260505 20:13:34.129957 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6dc9ec93ddb406ab956389518a9a7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.129966 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b60c74cfa0d4c498ed50daefe3905ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.130209 8693 consensus_queue.cc:1048] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.130784 8692 consensus_queue.cc:1048] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.130941 8926 consensus_queue.cc:1048] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.132691 8058 ts_tablet_manager.cc:1434] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s
I20260505 20:13:34.133023 8058 tablet_bootstrap.cc:492] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:34.134089 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27febef8234419caa855dd7a180fe8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.134477 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6dc9ec93ddb406ab956389518a9a7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.139181 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e083f131eca54d98852e5685e08ef46b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.139362 7934 raft_consensus.cc:2468] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:34.141116 8058 tablet_bootstrap.cc:654] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.143076 7598 leader_election.cc:304] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.143119 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 3a96ed0d53064aa480d93420c6b41bc2 (DEFAULT_TABLE table=default.Table_df8877e563ff4aa49f6f201934596c59 [id=68a78a47955345e5832fbef128cbe20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.143355 8926 raft_consensus.cc:2804] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:34.143443 8926 raft_consensus.cc:493] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:34.143539 8926 raft_consensus.cc:3060] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.143653 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a96ed0d53064aa480d93420c6b41bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.146128 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 3a96ed0d53064aa480d93420c6b41bc2 (DEFAULT_TABLE table=default.Table_df8877e563ff4aa49f6f201934596c59 [id=68a78a47955345e5832fbef128cbe20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.146253 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.146474 7936 raft_consensus.cc:2468] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:34.146471 8926 raft_consensus.cc:515] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.146704 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a96ed0d53064aa480d93420c6b41bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.147117 8926 leader_election.cc:290] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.147862 7598 leader_election.cc:304] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.148159 8926 raft_consensus.cc:2804] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:34.148288 8926 raft_consensus.cc:493] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:34.148579 8926 raft_consensus.cc:3060] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.148998 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e083f131eca54d98852e5685e08ef46b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:34.149181 7936 raft_consensus.cc:3060] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.151499 8926 raft_consensus.cc:515] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.151857 7936 raft_consensus.cc:2468] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.152163 8926 leader_election.cc:290] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.153446 7598 leader_election.cc:304] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.153931 8926 raft_consensus.cc:2804] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:34.154338 8926 raft_consensus.cc:697] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:34.154659 8926 consensus_queue.cc:237] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.159765 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:34.160281 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:34.160583 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:34.160866 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:34.160938 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e217456754440cf90a1c5a642eb2627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.161221 7405 catalog_manager.cc:5671] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:34.161890 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:34.162374 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:34.162644 7405 catalog_manager.cc:5671] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
I20260505 20:13:34.163635 8998 tablet.cc:1724] T 0b1e6d72c57e42f09432a30295c47f1f P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:34.166316 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:34.166603 7936 raft_consensus.cc:3060] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.167205 7626 tablet_service.cc:1511] Processing CreateTablet for tablet ad2fb4e615c4486b9d071b2366f85471 (DEFAULT_TABLE table=default.Table_06b9387992f541f584126cf0be193f38 [id=9cc065df68d949a199bc73be48314f8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.167707 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2fb4e615c4486b9d071b2366f85471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.169534 8053 tablet_bootstrap.cc:492] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.169677 8053 ts_tablet_manager.cc:1403] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.288s user 0.014s sys 0.026s
I20260505 20:13:34.170472 8053 raft_consensus.cc:359] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.170641 8053 raft_consensus.cc:385] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.170687 8053 raft_consensus.cc:740] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.170876 8053 consensus_queue.cc:260] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.171567 8053 ts_tablet_manager.cc:1434] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:34.171888 8053 tablet_bootstrap.cc:492] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.173429 8053 tablet_bootstrap.cc:654] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.181420 8978 raft_consensus.cc:493] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.181610 8978 raft_consensus.cc:515] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.182561 8978 leader_election.cc:290] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:34.184828 7781 tablet_service.cc:1511] Processing CreateTablet for tablet ad2fb4e615c4486b9d071b2366f85471 (DEFAULT_TABLE table=default.Table_06b9387992f541f584126cf0be193f38 [id=9cc065df68d949a199bc73be48314f8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.185433 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2fb4e615c4486b9d071b2366f85471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.185441 7936 raft_consensus.cc:2468] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.191085 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aad2a9f37ac4cbfa127ecceb132c8bb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.192338 7794 raft_consensus.cc:3060] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.192967 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ddf95d810c4c80a5f78c1b7600cee4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.193364 7800 raft_consensus.cc:3060] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.196028 8054 tablet_bootstrap.cc:492] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.196237 8054 ts_tablet_manager.cc:1403] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.003s
I20260505 20:13:34.197329 8054 raft_consensus.cc:359] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.197616 8054 raft_consensus.cc:385] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.197729 8054 raft_consensus.cc:740] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.198083 8054 consensus_queue.cc:260] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.198961 8054 ts_tablet_manager.cc:1434] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:34.201462 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:34.202428 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:34.202739 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:34.205266 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 1315273f76db4405bb2c82a8164bc325 (DEFAULT_TABLE table=default.Table_aeba5817c6974912bf3e49da09fdf85f [id=9b18678ba3204698b9a1c2c214517c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.205801 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1315273f76db4405bb2c82a8164bc325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.206101 7912 tablet_service.cc:1511] Processing CreateTablet for tablet ad2fb4e615c4486b9d071b2366f85471 (DEFAULT_TABLE table=default.Table_06b9387992f541f584126cf0be193f38 [id=9cc065df68d949a199bc73be48314f8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.206550 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2fb4e615c4486b9d071b2366f85471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.210114 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 3a96ed0d53064aa480d93420c6b41bc2 (DEFAULT_TABLE table=default.Table_df8877e563ff4aa49f6f201934596c59 [id=68a78a47955345e5832fbef128cbe20e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.210631 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a96ed0d53064aa480d93420c6b41bc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.212405 8053 tablet_bootstrap.cc:492] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.212551 8053 ts_tablet_manager.cc:1403] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.005s
I20260505 20:13:34.213371 8053 raft_consensus.cc:359] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.213547 8053 raft_consensus.cc:385] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.213600 8053 raft_consensus.cc:740] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.213977 8053 consensus_queue.cc:260] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.214100 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 05ec070a0196451c9564fa24b806516c (DEFAULT_TABLE table=default.Table_62aece033038452d8dd6e128877cc4e7 [id=835704ef17524d9683187bdaa11d3181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.214517 8053 ts_tablet_manager.cc:1434] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:34.214715 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ec070a0196451c9564fa24b806516c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.214782 8053 tablet_bootstrap.cc:492] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.215209 8054 tablet_bootstrap.cc:492] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:34.216373 8053 tablet_bootstrap.cc:654] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.216524 8054 tablet_bootstrap.cc:654] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:34.217877 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 58686.6us
I20260505 20:13:34.218597 8775 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.219074 8775 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.220757 7766 tablet_service.cc:1511] Processing CreateTablet for tablet d0943621b2d14346ad79d1b7a74e4d47 (DEFAULT_TABLE table=default.Table_d6ce8f7d9fd1457790462b4950bcee3d [id=7f07fbb5d4444ed3b62702530ed4610a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.221246 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0943621b2d14346ad79d1b7a74e4d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.226281 9002 tablet.cc:1724] T 0b1e6d72c57e42f09432a30295c47f1f P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:34.226598 7598 leader_election.cc:304] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.229184 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:34.229988 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:34.230448 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]). Expected version 1 got 0
I20260505 20:13:34.230701 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:34.231760 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:34.232100 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]). Expected version 1 got 0
I20260505 20:13:34.232479 7405 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:34.233657 8989 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.233896 8989 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.234216 8977 ts_tablet_manager.cc:1929] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:34.234972 8989 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.238808 7799 raft_consensus.cc:3060] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.238843 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880cbba188144dd795873186f8cda1e9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.252501 7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.252640 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e083f131eca54d98852e5685e08ef46b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:34.252739 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:34.253799 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e083f131eca54d98852e5685e08ef46b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.261797 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 1315273f76db4405bb2c82a8164bc325 (DEFAULT_TABLE table=default.Table_aeba5817c6974912bf3e49da09fdf85f [id=9b18678ba3204698b9a1c2c214517c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.262383 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1315273f76db4405bb2c82a8164bc325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.264638 8775 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.264784 8692 raft_consensus.cc:2804] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:34.264928 8692 raft_consensus.cc:697] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:34.265085 9014 tablet.cc:1724] T 0b1e6d72c57e42f09432a30295c47f1f P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:34.273600 7782 tablet_service.cc:1511] Processing CreateTablet for tablet a97a8c35af23454a9cf63193f763381e (DEFAULT_TABLE table=default.Table_da0af39636524879aa8f97b1af853f45 [id=d90ea7e58b5d476ea833feb67b8143c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.274160 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97a8c35af23454a9cf63193f763381e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.275126 8977 log.cc:1199] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/48cce2fd271641ad83c9b3e4beeb12ee
W20260505 20:13:34.267611 7869 leader_election.cc:343] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.275429 7869 leader_election.cc:304] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.275780 8639 raft_consensus.cc:2749] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:34.276598 7869 leader_election.cc:343] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.276782 7869 leader_election.cc:304] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.277034 8639 raft_consensus.cc:2749] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.277511 8639 consensus_queue.cc:1048] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:34.278579 7869 leader_election.cc:343] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.278748 7869 leader_election.cc:304] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.278976 8639 raft_consensus.cc:2749] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:34.280357 7869 consensus_peers.cc:597] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f62626fb4f8445e3a6e2822277181762. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:34.280298 7768 tablet_service.cc:1511] Processing CreateTablet for tablet f1425e08c7c342e3bc05074645969b2c (DEFAULT_TABLE table=default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:34.280627 7869 leader_election.cc:343] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.280768 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1425e08c7c342e3bc05074645969b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.281607 8639 consensus_queue.cc:1048] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.282083 7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.269357 8054 tablet_bootstrap.cc:492] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.272171 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.284278 8054 ts_tablet_manager.cc:1403] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.002s
I20260505 20:13:34.284309 7933 raft_consensus.cc:2468] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:34.274525 7900 tablet_service.cc:1511] Processing CreateTablet for tablet d0943621b2d14346ad79d1b7a74e4d47 (DEFAULT_TABLE table=default.Table_d6ce8f7d9fd1457790462b4950bcee3d [id=7f07fbb5d4444ed3b62702530ed4610a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.285135 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0943621b2d14346ad79d1b7a74e4d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.285545 8977 ts_tablet_manager.cc:1950] T 48cce2fd271641ad83c9b3e4beeb12ee P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:34.288806 8776 consensus_queue.cc:1048] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260505 20:13:34.301443 8977 tablet_replica.cc:333] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:34.301662 8977 raft_consensus.cc:2243] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:34.301856 8977 raft_consensus.cc:2272] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:34.296984 7632 tablet_service.cc:1511] Processing CreateTablet for tablet d0943621b2d14346ad79d1b7a74e4d47 (DEFAULT_TABLE table=default.Table_d6ce8f7d9fd1457790462b4950bcee3d [id=7f07fbb5d4444ed3b62702530ed4610a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.308621 8977 ts_tablet_manager.cc:1916] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:34.285077 8054 raft_consensus.cc:359] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.309406 8054 raft_consensus.cc:385] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.309495 8054 raft_consensus.cc:740] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.309711 8054 consensus_queue.cc:260] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.310951 8054 ts_tablet_manager.cc:1434] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260505 20:13:34.311616 8054 tablet_bootstrap.cc:492] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:34.299609 7913 tablet_service.cc:1511] Processing CreateTablet for tablet a97a8c35af23454a9cf63193f763381e (DEFAULT_TABLE table=default.Table_da0af39636524879aa8f97b1af853f45 [id=d90ea7e58b5d476ea833feb67b8143c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.312237 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97a8c35af23454a9cf63193f763381e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.250725 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 1315273f76db4405bb2c82a8164bc325 (DEFAULT_TABLE table=default.Table_aeba5817c6974912bf3e49da09fdf85f [id=9b18678ba3204698b9a1c2c214517c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.314246 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1315273f76db4405bb2c82a8164bc325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.317091 8054 tablet_bootstrap.cc:654] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.317502 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 48cce2fd271641ad83c9b3e4beeb12ee (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]) successfully deleted
W20260505 20:13:34.318099 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 2540ed5144664ec0bfe0b548a5386176 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2540ed5144664ec0bfe0b548a5386176 already in progress: creating tablet
W20260505 20:13:34.319052 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet a0d4e198c91c4a0e99d8b798a1dd3433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d4e198c91c4a0e99d8b798a1dd3433 already in progress: creating tablet
I20260505 20:13:34.319715 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 26b143e4943343d5b151f2804cccecfb (DEFAULT_TABLE table=default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a [id=2933b254aea045eaa6d04f0fc88a5890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.320145 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b143e4943343d5b151f2804cccecfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.326169 7906 tablet_service.cc:1511] Processing CreateTablet for tablet f1425e08c7c342e3bc05074645969b2c (DEFAULT_TABLE table=default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.326750 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1425e08c7c342e3bc05074645969b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.327031 8692 consensus_queue.cc:237] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.304054 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880cbba188144dd795873186f8cda1e9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.329679 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:34.330240 7915 tablet_service.cc:1511] Processing CreateTablet for tablet ec3374a8f51d4c1a94dbd24d4a9da0af (DEFAULT_TABLE table=default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.330567 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3374a8f51d4c1a94dbd24d4a9da0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.341382 7800 raft_consensus.cc:3060] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.343137 7773 tablet_service.cc:1511] Processing CreateTablet for tablet c93512b85b764438aeb7bca9fe339442 (DEFAULT_TABLE table=default.Table_bd6970923f6943358212e065fee537ea [id=950865299ac7468db8ae8fc687685655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.343559 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93512b85b764438aeb7bca9fe339442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.343730 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 26b143e4943343d5b151f2804cccecfb (DEFAULT_TABLE table=default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a [id=2933b254aea045eaa6d04f0fc88a5890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.344029 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b143e4943343d5b151f2804cccecfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.345264 7766 tablet_service.cc:1511] Processing CreateTablet for tablet ec3374a8f51d4c1a94dbd24d4a9da0af (DEFAULT_TABLE table=default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.345939 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.346529 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3374a8f51d4c1a94dbd24d4a9da0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.349444 8639 consensus_queue.cc:1048] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:34.350260 7870 leader_election.cc:343] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.350394 7870 leader_election.cc:304] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:34.350616 7870 raft_consensus.cc:2686] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:34.352613 7798 raft_consensus.cc:3060] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.342873 7625 tablet_service.cc:1511] Processing CreateTablet for tablet a97a8c35af23454a9cf63193f763381e (DEFAULT_TABLE table=default.Table_da0af39636524879aa8f97b1af853f45 [id=d90ea7e58b5d476ea833feb67b8143c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.367249 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:34.368271 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:34.368799 7906 tablet_service.cc:1511] Processing CreateTablet for tablet c93512b85b764438aeb7bca9fe339442 (DEFAULT_TABLE table=default.Table_bd6970923f6943358212e065fee537ea [id=950865299ac7468db8ae8fc687685655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.369088 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:34.369282 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93512b85b764438aeb7bca9fe339442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.369496 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:34.369663 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:34.369824 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:34.369994 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:34.370251 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:34.370398 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:34.370782 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:34.371083 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:34.371308 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 0b1e6d72c57e42f09432a30295c47f1f (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]). Expected version 2 got 0
I20260505 20:13:34.371496 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_81e65112cd9f427cad2c364792f117bf [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 1 got 0
I20260505 20:13:34.372311 7800 raft_consensus.cc:3060] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.372661 7657 raft_consensus.cc:2393] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:34.372962 8776 raft_consensus.cc:493] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.373178 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.373611 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:34.374014 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:34.374238 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:34.374431 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:34.374577 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:34.374892 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:34.375224 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:34.375599 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]). Expected version 1 got 0
I20260505 20:13:34.375986 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:34.376578 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:34.376778 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]). Expected version 1 got 0
I20260505 20:13:34.377123 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:34.377429 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:34.377905 7404 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
W20260505 20:13:34.378875 7411 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 578a9ebf768d4c73990fb2a28a9d4ccb consensus state has no leader
I20260505 20:13:34.383394 8058 tablet_bootstrap.cc:492] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.385718 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
W20260505 20:13:34.390100 7407 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5fcaee384c440bcb3307cba455e2ffa consensus state has no leader
I20260505 20:13:34.390519 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:34.391614 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:34.391543 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_7f422e1acade4a9b8d1c6d3056843c5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.392207 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f422e1acade4a9b8d1c6d3056843c5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.392256 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0943621b2d14346ad79d1b7a74e4d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.392383 8053 tablet_bootstrap.cc:492] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.392508 8053 ts_tablet_manager.cc:1403] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.178s user 0.002s sys 0.007s
W20260505 20:13:34.392485 7596 leader_election.cc:343] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.393385 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:34.393452 7412 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d411638715f747469f9f3dc490c0257c consensus state has no leader
I20260505 20:13:34.394322 8058 ts_tablet_manager.cc:1403] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.251s user 0.007s sys 0.028s
W20260505 20:13:34.394399 7409 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 369f4a55fdd64e4bb907666bede9f241 has no consensus state
I20260505 20:13:34.394891 7413 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 089517a7c2214dce9367b21beb555733
I20260505 20:13:34.395403 7413 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 8) took 1206 ms. Trace:
I20260505 20:13:34.396867 8053 raft_consensus.cc:359] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.397042 8053 raft_consensus.cc:385] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.397102 8053 raft_consensus.cc:740] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.395527 7413 rpcz_store.cc:276] 0505 20:13:33.188427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:33.188487 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:33.285637 (+ 97150us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:33.286095 (+ 458us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:33.286308 (+ 213us) catalog_manager.cc:2824] Locking tablets
0505 20:13:33.286658 (+ 350us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:33.513828 (+227170us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:33.513911 (+ 83us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:34.394844 (+880933us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:34.395347 (+ 503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:33.353566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:33.353697 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:33.353703 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:33.353705 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:33.353852 (+ 147us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:33.353864 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:33.353868 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:33.353990 (+ 122us) tablet.cc:701] Row locks acquired
0505 20:13:33.353994 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:33.354034 (+ 40us) write_op.cc:270] Start()
0505 20:13:33.354082 (+ 48us) write_op.cc:276] Timestamp: P: 1778012013354023 usec, L: 0
0505 20:13:33.354086 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:33.354261 (+ 175us) log.cc:844] Serialized 759 byte log entry
0505 20:13:33.507272 (+153011us) op_driver.cc:464] REPLICATION: finished
0505 20:13:33.508402 (+ 1130us) write_op.cc:301] APPLY: starting
0505 20:13:33.508414 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:33.508450 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:33.508473 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:33.508529 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:33.508556 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:33.508561 (+ 5us) write_op.cc:312] APPLY: finished
0505 20:13:33.508616 (+ 55us) log.cc:844] Serialized 29 byte log entry
0505 20:13:33.508660 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.508674 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:33.508680 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:33.508739 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.508742 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1094,"apply.run_cpu_time_us":331,"apply.run_wall_time_us":332,"num_ops":2,"prepare.queue_time_us":48169,"prepare.run_cpu_time_us":19760,"prepare.run_wall_time_us":78963,"raft.queue_time_us":273,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":153170,"thread_start_us":78169,"threads_started":1}]]}
I20260505 20:13:34.398219 7626 tablet_service.cc:1511] Processing CreateTablet for tablet ec3374a8f51d4c1a94dbd24d4a9da0af (DEFAULT_TABLE table=default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.397382 7627 tablet_service.cc:1511] Processing CreateTablet for tablet f1425e08c7c342e3bc05074645969b2c (DEFAULT_TABLE table=default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:34.399276 9004 log.cc:927] Time spent T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20260505 20:13:34.403544 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 089517a7c2214dce9367b21beb555733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:34.403957 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 089517a7c2214dce9367b21beb555733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:34.397663 7413 master_service.cc:954] ReplaceTablet: received request to replace tablet 1f27847d940e46778ad10a2f4cf40d27 from {username='slave'} at 127.0.0.1:39198
W20260505 20:13:34.402209 7399 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 578a9ebf768d4c73990fb2a28a9d4ccb consensus state has no leader
I20260505 20:13:34.405377 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 26b143e4943343d5b151f2804cccecfb (DEFAULT_TABLE table=default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a [id=2933b254aea045eaa6d04f0fc88a5890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.405712 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet f4d78ebf153640e4b2f518fb215f1bf1
I20260505 20:13:34.405763 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:34.406638 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_0af890deafbf4b8a901edea12e3c1e22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.407399 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0af890deafbf4b8a901edea12e3c1e22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.407881 8989 raft_consensus.cc:493] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.408322 8989 raft_consensus.cc:515] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.409178 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:34.409482 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:34.410281 8989 leader_election.cc:290] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.412091 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:34.417560 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 44ddf95d810c4c80a5f78c1b7600cee4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44ddf95d810c4c80a5f78c1b7600cee4 already in progress: creating tablet
I20260505 20:13:34.418540 8926 raft_consensus.cc:493] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:34.420536 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 089517a7c2214dce9367b21beb555733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:34.420737 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:34.421620 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 089517a7c2214dce9367b21beb555733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 089517a7c2214dce9367b21beb555733 already in progress: creating tablet
W20260505 20:13:34.422014 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f4d78ebf153640e4b2f518fb215f1bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d78ebf153640e4b2f518fb215f1bf1 already in progress: creating tablet
W20260505 20:13:34.423941 7596 leader_election.cc:343] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:34.424342 7596 leader_election.cc:343] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.430027 8639 raft_consensus.cc:493] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.430200 8639 raft_consensus.cc:515] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.430874 8639 leader_election.cc:290] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:34.434110 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97a8c35af23454a9cf63193f763381e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.434890 8058 raft_consensus.cc:359] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.435099 8058 raft_consensus.cc:385] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:34.435413 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 44ddf95d810c4c80a5f78c1b7600cee4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44ddf95d810c4c80a5f78c1b7600cee4 already in progress: creating tablet
I20260505 20:13:34.435437 8058 raft_consensus.cc:740] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.435266 8053 consensus_queue.cc:260] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.435659 8058 consensus_queue.cc:260] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.436700 8053 ts_tablet_manager.cc:1434] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.044s user 0.001s sys 0.002s
I20260505 20:13:34.437335 8053 tablet_bootstrap.cc:492] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.441526 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b143e4943343d5b151f2804cccecfb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:34.442111 7596 consensus_peers.cc:597] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3b3c646af9843048382e77b138aea44. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:34.442683 7633 tablet_service.cc:1511] Processing CreateTablet for tablet c93512b85b764438aeb7bca9fe339442 (DEFAULT_TABLE table=default.Table_bd6970923f6943358212e065fee537ea [id=950865299ac7468db8ae8fc687685655]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:34.443774 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 089517a7c2214dce9367b21beb555733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 089517a7c2214dce9367b21beb555733 already in progress: creating tablet
I20260505 20:13:34.448199 7407 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 29) took 1254 ms. Trace:
I20260505 20:13:34.448339 7407 rpcz_store.cc:276] 0505 20:13:33.193271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:33.628981 (+435710us) service_pool.cc:224] Handling call
0505 20:13:33.635539 (+ 6558us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9743da6 00007f70d01d9146 00007f70d01d8e75 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:33.635852 (+ 313us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:33.636086 (+ 234us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:33.636301 (+ 215us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:33.636395 (+ 94us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:33.671843 (+ 35448us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:34.448142 (+776299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:33.654188 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:33.654326 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:33.654333 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:33.654337 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:33.654435 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:33.654446 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:33.654453 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:33.654510 (+ 57us) tablet.cc:701] Row locks acquired
0505 20:13:33.654514 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:33.654542 (+ 28us) write_op.cc:270] Start()
0505 20:13:33.654571 (+ 29us) write_op.cc:276] Timestamp: P: 1778012013654654 usec, L: 0
0505 20:13:33.654576 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:33.654750 (+ 174us) log.cc:844] Serialized 405 byte log entry
0505 20:13:33.660583 (+ 5833us) op_driver.cc:464] REPLICATION: finished
0505 20:13:33.661631 (+ 1048us) write_op.cc:301] APPLY: starting
0505 20:13:33.661643 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:33.661684 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:33.661727 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:33.661812 (+ 85us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:33.661853 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:33.661863 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:33.661939 (+ 76us) log.cc:844] Serialized 23 byte log entry
0505 20:13:33.661993 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.662010 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:33.662017 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:33.662097 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.662104 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":13907200,"child_traces":[["op",{"apply.queue_time_us":1010,"apply.run_cpu_time_us":452,"apply.run_wall_time_us":452,"num_ops":1,"prepare.queue_time_us":17267,"prepare.run_cpu_time_us":650,"prepare.run_wall_time_us":648,"replication_time_us":5987,"spinlock_wait_cycles":33024}]]}
I20260505 20:13:34.449222 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_8eedf90fb41d454599dc92dc088b5dfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:34.449445 7598 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:34.449708 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 80567.8us
W20260505 20:13:34.449862 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eedf90fb41d454599dc92dc088b5dfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.450258 8926 raft_consensus.cc:515] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.450901 8926 leader_election.cc:290] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.451067 8926 raft_consensus.cc:493] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.451184 8926 raft_consensus.cc:515] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.451249 8557 raft_consensus.cc:2804] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:34.451366 8557 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:34.451449 8557 raft_consensus.cc:3060] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.451738 8926 leader_election.cc:290] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.451510 8977 ts_tablet_manager.cc:1929] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:34.452241 8977 log.cc:1199] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/880cbba188144dd795873186f8cda1e9
I20260505 20:13:34.453898 7409 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 28) took 1260 ms. Trace:
I20260505 20:13:34.454263 8977 ts_tablet_manager.cc:1950] T 880cbba188144dd795873186f8cda1e9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:34.454005 7409 rpcz_store.cc:276] 0505 20:13:33.193176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:33.577766 (+384590us) service_pool.cc:224] Handling call
0505 20:13:33.610124 (+ 32358us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9743da6 00007f70d01d9146 00007f70d01d8e75 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:33.618594 (+ 8470us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:33.618809 (+ 215us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:33.618957 (+ 148us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:33.619013 (+ 56us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:33.639869 (+ 20856us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:34.453846 (+813977us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:33.634022 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:33.634174 (+ 152us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:33.634180 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:33.634184 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:33.634318 (+ 134us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:33.634334 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:33.634341 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:33.634414 (+ 73us) tablet.cc:701] Row locks acquired
0505 20:13:33.634418 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:33.634457 (+ 39us) write_op.cc:270] Start()
0505 20:13:33.634491 (+ 34us) write_op.cc:276] Timestamp: P: 1778012013634558 usec, L: 0
0505 20:13:33.634496 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:33.634695 (+ 199us) log.cc:844] Serialized 405 byte log entry
0505 20:13:33.638518 (+ 3823us) op_driver.cc:464] REPLICATION: finished
0505 20:13:33.638856 (+ 338us) write_op.cc:301] APPLY: starting
0505 20:13:33.638873 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:33.638913 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:33.638943 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:33.639006 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:33.639035 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:33.639043 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:33.639112 (+ 69us) log.cc:844] Serialized 23 byte log entry
0505 20:13:33.639175 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.639193 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:33.639201 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:33.641291 (+ 2090us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.641299 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":12663040,"child_traces":[["op",{"apply.queue_time_us":278,"apply.run_cpu_time_us":417,"apply.run_wall_time_us":417,"num_ops":1,"prepare.queue_time_us":14578,"prepare.run_cpu_time_us":841,"prepare.run_wall_time_us":7253,"raft.queue_time_us":70,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"replication_time_us":3992}]]}
I20260505 20:13:34.454663 7409 master_service.cc:954] ReplaceTablet: received request to replace tablet 1e453fdf9a424fe8974076fac3ad74bf from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:34.455230 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_b03dacb5543b47f18022d67498030fd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.455768 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b03dacb5543b47f18022d67498030fd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.457907 7406 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_fdf9cb8321b64150bc72c38e08184712"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.458397 7406 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdf9cb8321b64150bc72c38e08184712 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.460270 7412 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 27) took 1267 ms. Trace:
I20260505 20:13:34.460366 7412 rpcz_store.cc:276] 0505 20:13:33.193074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:33.577236 (+384162us) service_pool.cc:224] Handling call
0505 20:13:33.606905 (+ 29669us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9743da6 00007f70d01d9146 00007f70d01d8e75 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:33.618388 (+ 11483us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:33.618620 (+ 232us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:33.618753 (+ 133us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:33.618835 (+ 82us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:33.629154 (+ 10319us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:34.460207 (+831053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:33.619330 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:33.619424 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:33.619429 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:33.619431 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:33.619512 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:33.619527 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:33.619531 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:33.619577 (+ 46us) tablet.cc:701] Row locks acquired
0505 20:13:33.619579 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:33.619609 (+ 30us) write_op.cc:270] Start()
0505 20:13:33.619638 (+ 29us) write_op.cc:276] Timestamp: P: 1778012013619706 usec, L: 0
0505 20:13:33.619642 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:33.619771 (+ 129us) log.cc:844] Serialized 405 byte log entry
0505 20:13:33.627476 (+ 7705us) op_driver.cc:464] REPLICATION: finished
0505 20:13:33.628685 (+ 1209us) write_op.cc:301] APPLY: starting
0505 20:13:33.628698 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:33.628734 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:33.628764 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:33.628815 (+ 51us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:33.628847 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:33.628854 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:33.628910 (+ 56us) log.cc:844] Serialized 23 byte log entry
0505 20:13:33.628955 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.628971 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:33.628978 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:33.633903 (+ 4925us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:33.633911 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":45037440,"child_traces":[["op",{"apply.queue_time_us":1172,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":1,"prepare.queue_time_us":82,"prepare.run_cpu_time_us":6281,"prepare.run_wall_time_us":14552,"raft.queue_time_us":1751,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":7812,"thread_start_us":13946,"threads_started":1}]]}
I20260505 20:13:34.461207 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_dde336fdd3fd43cc857271e351be6fdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:34.461267 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_db1068a01b8646a5b81f675ce7a1e865"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.461827 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db1068a01b8646a5b81f675ce7a1e865 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.462491 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 880cbba188144dd795873186f8cda1e9 (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]) successfully deleted
W20260505 20:13:34.461688 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dde336fdd3fd43cc857271e351be6fdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.465951 8977 tablet_replica.cc:333] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:34.467433 8557 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.466809 8977 raft_consensus.cc:2243] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:34.468057 8557 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.468828 8977 raft_consensus.cc:2272] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:34.473795 8053 tablet_bootstrap.cc:654] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:34.475134 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f4d78ebf153640e4b2f518fb215f1bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d78ebf153640e4b2f518fb215f1bf1 already in progress: creating tablet
I20260505 20:13:34.478024 8977 ts_tablet_manager.cc:1916] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:34.483978 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:34.491163 8053 tablet_bootstrap.cc:492] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.493115 8053 ts_tablet_manager.cc:1403] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.000s
I20260505 20:13:34.504858 8053 raft_consensus.cc:359] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.507177 8053 raft_consensus.cc:385] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.507824 8053 raft_consensus.cc:740] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.510286 9002 tablet.cc:1724] T f4a8adf31bc94a33a61468adf2673681 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:34.512363 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bebda2a5c5a4c43a244504837cf0923" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:34.514158 7869 leader_election.cc:343] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.514798 9014 tablet.cc:1724] T f4a8adf31bc94a33a61468adf2673681 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:34.516485 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1425e08c7c342e3bc05074645969b2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:34.516757 7596 leader_election.cc:343] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.516507 8053 consensus_queue.cc:260] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.520198 8053 ts_tablet_manager.cc:1434] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260505 20:13:34.521493 8058 ts_tablet_manager.cc:1434] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.042s user 0.001s sys 0.001s
W20260505 20:13:34.523182 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 74634.1us
I20260505 20:13:34.523775 8058 tablet_bootstrap.cc:492] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:34.526302 7596 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.527165 8775 consensus_queue.cc:1048] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.528682 8639 consensus_queue.cc:1048] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.527885 8775 consensus_queue.cc:1048] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260505 20:13:34.530537 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3374a8f51d4c1a94dbd24d4a9da0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.533236 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93512b85b764438aeb7bca9fe339442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.534909 8058 tablet_bootstrap.cc:654] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.563191 8053 tablet_bootstrap.cc:492] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.568118 8977 ts_tablet_manager.cc:1929] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:34.568272 8977 log.cc:1199] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:34.568588 8977 ts_tablet_manager.cc:1950] T 096ca710e3564d4b8db50f29dd56a5d4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:34.570591 8053 tablet_bootstrap.cc:654] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.573128 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_13e34bc0465a46e392ef089f7b07a2c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:34.573940 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bebda2a5c5a4c43a244504837cf0923" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.574549 7410 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_fb996331a7e24a51a33fa182ef600060" } modify_external_catalogs: true
I20260505 20:13:34.574769 7410 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_fb996331a7e24a51a33fa182ef600060" } modify_external_catalogs: true
W20260505 20:13:34.579185 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13e34bc0465a46e392ef089f7b07a2c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:34.579665 7870 leader_election.cc:343] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.579804 7870 leader_election.cc:304] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.580024 8639 raft_consensus.cc:2749] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.591586 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 096ca710e3564d4b8db50f29dd56a5d4 (table default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:34.601164 8977 tablet_replica.cc:333] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:34.602815 8977 raft_consensus.cc:2243] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:34.604955 8977 raft_consensus.cc:2272] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:34.607388 8977 ts_tablet_manager.cc:1916] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:34.610915 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet ae8bd19470294a1db91855afe49be6a5 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:34.612633 8054 tablet_bootstrap.cc:492] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.612769 8054 ts_tablet_manager.cc:1403] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.302s user 0.002s sys 0.005s
I20260505 20:13:34.613729 8054 raft_consensus.cc:359] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.613934 8054 raft_consensus.cc:385] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.613988 8054 raft_consensus.cc:740] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.614166 8054 consensus_queue.cc:260] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.614611 8054 ts_tablet_manager.cc:1434] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:34.614928 8054 tablet_bootstrap.cc:492] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:34.618783 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca74b1f5ccb4f02a11b5d2a1bf2d5a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.618999 7800 raft_consensus.cc:2468] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:34.619333 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:34.623080 7626 tablet_service.cc:1511] Processing CreateTablet for tablet faf3775c154742c5804daf8ade2ad854 (DEFAULT_TABLE table=default.Table_8595c29834684cbd83e7b51b31b8b82b [id=ebd38b39f1d2484ca108560964693461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.624050 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf3775c154742c5804daf8ade2ad854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.629632 7900 tablet_service.cc:1511] Processing CreateTablet for tablet faf3775c154742c5804daf8ade2ad854 (DEFAULT_TABLE table=default.Table_8595c29834684cbd83e7b51b31b8b82b [id=ebd38b39f1d2484ca108560964693461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.630318 8054 tablet_bootstrap.cc:654] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.632854 7596 leader_election.cc:304] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.638334 8693 raft_consensus.cc:2804] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260505 20:13:34.638389 7596 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.638446 8693 raft_consensus.cc:493] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:34.638526 8693 raft_consensus.cc:3060] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:34.638643 7596 leader_election.cc:343] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:34.648710 7768 tablet_service.cc:1511] Processing CreateTablet for tablet faf3775c154742c5804daf8ade2ad854 (DEFAULT_TABLE table=default.Table_8595c29834684cbd83e7b51b31b8b82b [id=ebd38b39f1d2484ca108560964693461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:34.650162 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf3775c154742c5804daf8ade2ad854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.662915 8639 raft_consensus.cc:493] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.663092 8639 raft_consensus.cc:515] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.663761 8639 leader_election.cc:290] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:34.671293 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf3775c154742c5804daf8ade2ad854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:34.671250 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.671717 8998 tablet.cc:1724] T f4a8adf31bc94a33a61468adf2673681 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:34.673264 7870 leader_election.cc:343] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.677361 8053 tablet_bootstrap.cc:492] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.677512 8053 ts_tablet_manager.cc:1403] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.157s user 0.002s sys 0.006s
I20260505 20:13:34.678233 8053 raft_consensus.cc:359] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.678411 8053 raft_consensus.cc:385] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.678462 8053 raft_consensus.cc:740] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.678685 8053 consensus_queue.cc:260] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.679277 8053 ts_tablet_manager.cc:1434] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:34.679618 8053 tablet_bootstrap.cc:492] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.681663 8053 tablet_bootstrap.cc:654] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.690570 8054 tablet_bootstrap.cc:492] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.690810 8054 ts_tablet_manager.cc:1403] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.008s
I20260505 20:13:34.691669 8054 raft_consensus.cc:359] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.691933 8054 raft_consensus.cc:385] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.692030 8054 raft_consensus.cc:740] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.692334 8054 consensus_queue.cc:260] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.692984 8054 ts_tablet_manager.cc:1434] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:34.693648 8054 tablet_bootstrap.cc:492] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:34.694911 8977 ts_tablet_manager.cc:1929] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:34.698338 8977 log.cc:1199] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:34.698853 8977 ts_tablet_manager.cc:1950] T 44ddf95d810c4c80a5f78c1b7600cee4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:34.700230 8693 raft_consensus.cc:515] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.700841 8693 leader_election.cc:290] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.706326 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 44ddf95d810c4c80a5f78c1b7600cee4 (table default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]) successfully deleted
I20260505 20:13:34.706781 8977 tablet_replica.cc:333] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:34.707037 8977 raft_consensus.cc:2243] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:34.707259 8977 raft_consensus.cc:2272] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:34.713495 8053 tablet_bootstrap.cc:492] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:34.716353 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 266351us
I20260505 20:13:34.717859 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:34.718031 7934 raft_consensus.cc:3060] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.719002 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca74b1f5ccb4f02a11b5d2a1bf2d5a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:34.719192 7930 raft_consensus.cc:3060] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.720906 7934 raft_consensus.cc:2468] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.721047 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca74b1f5ccb4f02a11b5d2a1bf2d5a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.722371 7930 raft_consensus.cc:2468] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.737375 8977 ts_tablet_manager.cc:1916] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:34.737648 9028 consensus_queue.cc:1048] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260505 20:13:34.717170 7736 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.740754 8987 raft_consensus.cc:2749] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.733451 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.733597 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca74b1f5ccb4f02a11b5d2a1bf2d5a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:34.741351 7795 raft_consensus.cc:3060] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.743499 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17da5cf513647d9b8e582a9b3b460a1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.745674 7736 leader_election.cc:304] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.746390 8718 raft_consensus.cc:2749] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:34.750550 7795 raft_consensus.cc:2468] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.752476 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_9b8219e65d994d0a9766561a882b6eb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.753310 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b8219e65d994d0a9766561a882b6eb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.754216 7413 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 1f27847d940e46778ad10a2f4cf40d27
I20260505 20:13:34.754750 7413 catalog_manager.cc:6741] ReplaceTablet: tablet 1f27847d940e46778ad10a2f4cf40d27 deleted and replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2
I20260505 20:13:34.755013 7413 master_service.cc:954] ReplaceTablet: received request to replace tablet 3d74dbab83b840d9b2bd103e946d3032 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:34.755586 7413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_be46b106277f46f99625e18345a7b985"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:34.756111 7413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be46b106277f46f99625e18345a7b985 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:34.757929 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:34.759654 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:34.761418 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 1f27847d940e46778ad10a2f4cf40d27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f27847d940e46778ad10a2f4cf40d27 already in progress: creating tablet
I20260505 20:13:34.763712 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:34.764544 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 1f27847d940e46778ad10a2f4cf40d27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f27847d940e46778ad10a2f4cf40d27 already in progress: creating tablet
I20260505 20:13:34.765079 8053 ts_tablet_manager.cc:1403] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.001s
W20260505 20:13:34.766006 7869 leader_election.cc:343] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:34.766155 7869 leader_election.cc:304] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.766353 8053 raft_consensus.cc:359] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.766573 8053 raft_consensus.cc:385] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.766593 8986 raft_consensus.cc:2749] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.766661 8053 raft_consensus.cc:740] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.766918 8053 consensus_queue.cc:260] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.767778 8053 ts_tablet_manager.cc:1434] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:34.767905 7596 leader_election.cc:304] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.768235 8693 raft_consensus.cc:2804] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:34.768389 8693 raft_consensus.cc:697] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:34.768633 8693 consensus_queue.cc:237] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.768767 8053 tablet_bootstrap.cc:492] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.770645 8053 tablet_bootstrap.cc:654] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.776396 8058 tablet_bootstrap.cc:492] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.776537 8058 ts_tablet_manager.cc:1403] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.253s user 0.003s sys 0.008s
I20260505 20:13:34.777299 8058 raft_consensus.cc:359] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.777459 8058 raft_consensus.cc:385] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.777519 8058 raft_consensus.cc:740] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.783236 8054 tablet_bootstrap.cc:654] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.784809 8058 consensus_queue.cc:260] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.788609 8058 ts_tablet_manager.cc:1434] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:34.788933 8058 tablet_bootstrap.cc:492] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:34.794579 8058 tablet_bootstrap.cc:654] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:34.745704 7598 leader_election.cc:343] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:34.796187 7598 leader_election.cc:304] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:34.796422 8693 raft_consensus.cc:2749] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:34.796492 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 50823.8us
I20260505 20:13:34.797041 8926 consensus_queue.cc:1048] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.803743 8977 ts_tablet_manager.cc:1929] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:34.803907 8977 log.cc:1199] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/089517a7c2214dce9367b21beb555733
I20260505 20:13:34.804289 8977 ts_tablet_manager.cc:1950] T 089517a7c2214dce9367b21beb555733 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:34.807037 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 089517a7c2214dce9367b21beb555733 (table default.Table_aa714545b11e4ed3a0e546cddc77be98 [id=7fd3bc8f4d484299a9a21b95ada7e77f]) successfully deleted
W20260505 20:13:34.808199 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f4d78ebf153640e4b2f518fb215f1bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d78ebf153640e4b2f518fb215f1bf1 already in progress: creating tablet
W20260505 20:13:34.810405 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 1f27847d940e46778ad10a2f4cf40d27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f27847d940e46778ad10a2f4cf40d27 already in progress: creating tablet
I20260505 20:13:34.813618 7598 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:34.814091 8926 raft_consensus.cc:2804] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:34.814262 8926 raft_consensus.cc:697] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:34.814513 8926 consensus_queue.cc:237] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.823274 7799 raft_consensus.cc:3060] T 0677740c3f77442895361e22d616a9ba P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.823364 8058 tablet_bootstrap.cc:492] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.823640 8058 ts_tablet_manager.cc:1403] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.035s user 0.014s sys 0.001s
I20260505 20:13:34.822314 8776 raft_consensus.cc:515] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.824594 8776 leader_election.cc:290] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.830757 8054 tablet_bootstrap.cc:492] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.831001 8054 ts_tablet_manager.cc:1403] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.137s user 0.002s sys 0.003s
I20260505 20:13:34.831918 8054 raft_consensus.cc:359] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.832162 8054 raft_consensus.cc:385] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.832278 8054 raft_consensus.cc:740] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.832600 8054 consensus_queue.cc:260] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.839794 8058 raft_consensus.cc:359] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.839969 8058 raft_consensus.cc:385] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.840018 8058 raft_consensus.cc:740] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.840173 8058 consensus_queue.cc:260] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.840670 8058 ts_tablet_manager.cc:1434] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260505 20:13:34.840926 8058 tablet_bootstrap.cc:492] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:34.841938 8926 consensus_queue.cc:1048] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.844111 8058 tablet_bootstrap.cc:654] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.851310 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4628e33d204c452ab12acf76f754f2ad" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.851575 7930 raft_consensus.cc:2468] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:34.852917 7598 leader_election.cc:304] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.853215 8693 raft_consensus.cc:2804] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:34.853298 8693 raft_consensus.cc:493] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:34.853374 8693 raft_consensus.cc:3060] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.856485 8693 raft_consensus.cc:515] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.857486 8693 leader_election.cc:290] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.859822 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4628e33d204c452ab12acf76f754f2ad" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:34.859998 7800 raft_consensus.cc:3060] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.860291 8053 tablet_bootstrap.cc:492] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.860409 8053 ts_tablet_manager.cc:1403] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.092s user 0.011s sys 0.029s
I20260505 20:13:34.861143 8053 raft_consensus.cc:359] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.861286 8053 raft_consensus.cc:385] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.861326 8053 raft_consensus.cc:740] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.861497 8053 consensus_queue.cc:260] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.861975 8053 ts_tablet_manager.cc:1434] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260505 20:13:34.862354 8053 tablet_bootstrap.cc:492] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:34.862572 9047 raft_consensus.cc:493] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.862653 7800 raft_consensus.cc:2468] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.862689 9047 raft_consensus.cc:515] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.863194 9047 leader_election.cc:290] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.864385 8053 tablet_bootstrap.cc:654] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.868284 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4628e33d204c452ab12acf76f754f2ad" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.868508 7795 raft_consensus.cc:2376] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1. Re-sending same reply.
I20260505 20:13:34.870996 7409 master_service.cc:954] ReplaceTablet: received request to replace tablet 624398f68961440f8369a7859b0724c4 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:34.873813 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4628e33d204c452ab12acf76f754f2ad" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:34.874060 7933 raft_consensus.cc:3060] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:34.874994 8054 ts_tablet_manager.cc:1434] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20260505 20:13:34.877429 8054 tablet_bootstrap.cc:492] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:34.877568 7933 raft_consensus.cc:2468] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:34.878278 7596 leader_election.cc:304] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.879022 8693 raft_consensus.cc:2804] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:34.879266 8693 raft_consensus.cc:697] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:34.879529 8693 consensus_queue.cc:237] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.886881 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet ae8bd19470294a1db91855afe49be6a5
W20260505 20:13:34.887187 7736 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:34.887410 7408 catalog_manager.cc:6741] ReplaceTablet: tablet ae8bd19470294a1db91855afe49be6a5 deleted and replaced by tablet d8c4620970434e49b4fd3d21f309a48c
W20260505 20:13:34.889039 7737 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:34.889143 7737 leader_election.cc:304] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:34.889385 9047 raft_consensus.cc:2749] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:34.890309 8776 consensus_queue.cc:1048] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:34.893203 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:34.894884 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:34.895821 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet ae8bd19470294a1db91855afe49be6a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae8bd19470294a1db91855afe49be6a5 already in progress: creating tablet
I20260505 20:13:34.896148 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:34.896838 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet ae8bd19470294a1db91855afe49be6a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae8bd19470294a1db91855afe49be6a5 already in progress: creating tablet
I20260505 20:13:34.898123 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3f1f3578e45142bd8308041182d62265" } modify_external_catalogs: true
I20260505 20:13:34.898322 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3f1f3578e45142bd8308041182d62265" } modify_external_catalogs: true
I20260505 20:13:34.899701 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:34.900233 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:34.901067 8987 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.901185 8987 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.901818 8987 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.902670 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:34.902896 7662 raft_consensus.cc:2468] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:34.903424 7736 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.903755 9047 raft_consensus.cc:2804] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:34.903841 9047 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:34.903920 9047 raft_consensus.cc:3060] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:34.906739 9047 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.907625 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:34.908037 7662 raft_consensus.cc:3060] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:34.913270 9047 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.913991 7662 raft_consensus.cc:2468] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 2.
I20260505 20:13:34.916186 7413 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_c1053ca6e76b45f4a7da074bbd43d129" } new_table_name: "default.Table_ab36587e41634b89bc812f829f573ddf" modify_external_catalogs: true
I20260505 20:13:34.916280 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_8595c29834684cbd83e7b51b31b8b82b" } modify_external_catalogs: true
I20260505 20:13:34.916550 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_8595c29834684cbd83e7b51b31b8b82b" } modify_external_catalogs: true
I20260505 20:13:34.918853 8058 tablet_bootstrap.cc:492] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.918988 8058 ts_tablet_manager.cc:1403] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.003s
I20260505 20:13:34.919757 8058 raft_consensus.cc:359] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.919917 8058 raft_consensus.cc:385] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.919967 8058 raft_consensus.cc:740] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.920130 8058 consensus_queue.cc:260] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.925674 8776 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.925963 8054 tablet_bootstrap.cc:654] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.925879 8776 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:34.926820 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet ae8bd19470294a1db91855afe49be6a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae8bd19470294a1db91855afe49be6a5 already in progress: creating tablet
I20260505 20:13:34.920953 7736 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:34.928217 8776 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.900609 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:34.928750 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]). Expected version 1 got 0
I20260505 20:13:34.929369 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f4a8adf31bc94a33a61468adf2673681 (table default.Table_5c7ee4db09f44c5099b163f37f1f6486 [id=49103ea0eb57491fa5482997379eda9b]). Expected version 1 got 0
I20260505 20:13:34.929575 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:34.929423 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet faf3775c154742c5804daf8ade2ad854
I20260505 20:13:34.929853 8058 ts_tablet_manager.cc:1434] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260505 20:13:34.930029 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0b1e6d72c57e42f09432a30295c47f1f (table default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623]). Expected version 2 got 0
I20260505 20:13:34.930141 8058 tablet_bootstrap.cc:492] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:34.930495 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_51fcf065d7704d8c9a54e578cce315d4" } modify_external_catalogs: true
I20260505 20:13:34.931020 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet faf3775c154742c5804daf8ade2ad854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:34.931591 9047 raft_consensus.cc:2804] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:34.931732 9047 raft_consensus.cc:697] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:34.931991 9047 consensus_queue.cc:237] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.932318 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet faf3775c154742c5804daf8ade2ad854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:34.934445 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet faf3775c154742c5804daf8ade2ad854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:34.933046 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet faf3775c154742c5804daf8ade2ad854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf3775c154742c5804daf8ade2ad854 already in progress: creating tablet
I20260505 20:13:34.930516 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
W20260505 20:13:34.933990 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet faf3775c154742c5804daf8ade2ad854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf3775c154742c5804daf8ade2ad854 already in progress: creating tablet
I20260505 20:13:34.934437 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_51fcf065d7704d8c9a54e578cce315d4" } modify_external_catalogs: true
W20260505 20:13:34.935053 7737 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:34.935365 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:34.935729 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:34.936390 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:34.936694 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:34.936889 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
W20260505 20:13:34.937129 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet faf3775c154742c5804daf8ade2ad854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf3775c154742c5804daf8ade2ad854 already in progress: creating tablet
I20260505 20:13:34.937657 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:34.938163 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c1f63c849c48438abdaa965ab051f9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:34.938870 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:34.939054 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:34.939293 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
W20260505 20:13:34.939528 7737 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:34.939491 7411 catalog_manager.cc:5671] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:34.939919 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:34.940181 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:34.940471 7411 catalog_manager.cc:5671] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:34.941294 8693 raft_consensus.cc:493] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.941435 8693 raft_consensus.cc:515] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.941562 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:34.942070 8693 leader_election.cc:290] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.942209 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:34.942414 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:34.942626 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
W20260505 20:13:34.942879 7598 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:34.942914 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:34.943100 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:34.943414 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:34.943648 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:34.943811 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]). Expected version 1 got 0
I20260505 20:13:34.944024 7598 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:34.944344 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:34.944607 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:34.944826 8053 tablet_bootstrap.cc:492] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:34.944980 8693 raft_consensus.cc:2749] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260505 20:13:34.945441 8693 raft_consensus.cc:493] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:34.945603 8693 raft_consensus.cc:515] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.946262 8693 leader_election.cc:290] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:34.946555 8053 ts_tablet_manager.cc:1403] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.001s
I20260505 20:13:34.947118 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:34.947464 7929 raft_consensus.cc:2468] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:34.949162 8058 tablet_bootstrap.cc:654] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.949860 8054 tablet_bootstrap.cc:492] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:34.950012 8054 ts_tablet_manager.cc:1403] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.003s
I20260505 20:13:34.953373 8054 raft_consensus.cc:359] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.953892 8058 tablet_bootstrap.cc:492] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.954107 8058 ts_tablet_manager.cc:1403] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.002s
I20260505 20:13:34.955185 8058 raft_consensus.cc:359] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.955570 8058 raft_consensus.cc:385] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.955683 8058 raft_consensus.cc:740] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.956001 8058 consensus_queue.cc:260] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.957819 8054 raft_consensus.cc:385] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.957969 8054 raft_consensus.cc:740] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.966624 8058 ts_tablet_manager.cc:1434] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260505 20:13:34.967060 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 624398f68961440f8369a7859b0724c4
I20260505 20:13:34.967628 7409 catalog_manager.cc:6741] ReplaceTablet: tablet 624398f68961440f8369a7859b0724c4 deleted and replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c
I20260505 20:13:34.968950 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet 624398f68961440f8369a7859b0724c4 with delete_type TABLET_DATA_DELETED (replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:34.969352 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:34.969929 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 624398f68961440f8369a7859b0724c4 with delete_type TABLET_DATA_DELETED (replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:34.970494 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 624398f68961440f8369a7859b0724c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 624398f68961440f8369a7859b0724c4 already in progress: creating tablet
W20260505 20:13:34.971115 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 624398f68961440f8369a7859b0724c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 624398f68961440f8369a7859b0724c4 already in progress: creating tablet
I20260505 20:13:34.973914 8058 tablet_bootstrap.cc:492] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:34.976502 8058 tablet_bootstrap.cc:654] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.958299 8054 consensus_queue.cc:260] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.987320 8054 ts_tablet_manager.cc:1434] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260505 20:13:34.990561 8058 tablet_bootstrap.cc:492] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:34.990746 8058 ts_tablet_manager.cc:1403] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.005s
I20260505 20:13:34.991338 8054 tablet_bootstrap.cc:492] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:34.991585 8058 raft_consensus.cc:359] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.991779 8058 raft_consensus.cc:385] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.991823 8058 raft_consensus.cc:740] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:34.992049 8058 consensus_queue.cc:260] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.994359 8054 tablet_bootstrap.cc:654] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.994879 8058 ts_tablet_manager.cc:1434] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260505 20:13:34.995189 8058 tablet_bootstrap.cc:492] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:34.997002 8058 tablet_bootstrap.cc:654] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:34.951990 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.008121 7596 leader_election.cc:343] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.008911 7598 leader_election.cc:304] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.009528 8053 raft_consensus.cc:359] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:34.952160 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a4d496d994b799d1688cc258a181d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.009757 8053 raft_consensus.cc:385] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:34.969956 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 624398f68961440f8369a7859b0724c4 with delete_type TABLET_DATA_DELETED (replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:35.009863 7799 raft_consensus.cc:2468] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.010056 8693 raft_consensus.cc:2804] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.010119 8693 raft_consensus.cc:493] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.010175 8693 raft_consensus.cc:3060] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.010540 7596 leader_election.cc:304] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.010888 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a4d496d994b799d1688cc258a181d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:35.010953 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 624398f68961440f8369a7859b0724c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 624398f68961440f8369a7859b0724c4 already in progress: creating tablet
I20260505 20:13:35.011075 7929 raft_consensus.cc:2468] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.011240 8776 raft_consensus.cc:2804] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.011303 8776 raft_consensus.cc:493] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.011368 8776 raft_consensus.cc:3060] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.013134 8693 raft_consensus.cc:515] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.013777 8693 leader_election.cc:290] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.014494 8058 tablet_bootstrap.cc:492] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.014635 8058 ts_tablet_manager.cc:1403] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260505 20:13:35.015403 8058 raft_consensus.cc:359] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.015560 8058 raft_consensus.cc:385] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.015617 8058 raft_consensus.cc:740] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.015666 8054 tablet_bootstrap.cc:492] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.015802 8054 ts_tablet_manager.cc:1403] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.006s
I20260505 20:13:35.015825 8776 raft_consensus.cc:515] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.016393 8776 leader_election.cc:290] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.017170 8054 raft_consensus.cc:359] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.017345 8054 raft_consensus.cc:385] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.017405 8054 raft_consensus.cc:740] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.017658 8054 consensus_queue.cc:260] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.018237 8058 consensus_queue.cc:260] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.018371 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a4d496d994b799d1688cc258a181d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.018549 7799 raft_consensus.cc:3060] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.018741 8058 ts_tablet_manager.cc:1434] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:35.019004 8058 tablet_bootstrap.cc:492] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.019007 8054 ts_tablet_manager.cc:1434] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:35.019258 8054 tablet_bootstrap.cc:492] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.020641 8058 tablet_bootstrap.cc:654] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.020761 8054 tablet_bootstrap.cc:654] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.021279 7799 raft_consensus.cc:2468] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.022280 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.022476 7596 leader_election.cc:304] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.023137 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "947a4d496d994b799d1688cc258a181d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.023293 7933 raft_consensus.cc:3060] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:35.024011 7596 leader_election.cc:343] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.026051 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.026033 7409 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_45bd1808371b4519abd37364b534e889" } modify_external_catalogs: true
I20260505 20:13:35.026221 7929 raft_consensus.cc:3060] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.026275 7409 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_45bd1808371b4519abd37364b534e889" } modify_external_catalogs: true
I20260505 20:13:35.026974 8776 raft_consensus.cc:493] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.027112 8776 raft_consensus.cc:515] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.027730 8776 leader_election.cc:290] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.027853 8776 raft_consensus.cc:2804] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.029093 7929 raft_consensus.cc:2468] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.029085 8776 raft_consensus.cc:697] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.029441 8776 consensus_queue.cc:237] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.030180 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.030825 7596 leader_election.cc:343] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.031095 7933 raft_consensus.cc:2468] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.034072 7598 leader_election.cc:304] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.034020 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.034423 7933 raft_consensus.cc:2468] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.034509 8693 raft_consensus.cc:2804] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.034708 8693 raft_consensus.cc:697] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.034940 8693 consensus_queue.cc:237] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.050112 7598 leader_election.cc:304] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.050536 9028 raft_consensus.cc:2804] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.050640 9028 raft_consensus.cc:493] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.050720 9028 raft_consensus.cc:3060] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.054343 9028 raft_consensus.cc:515] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.054960 9028 leader_election.cc:290] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.056497 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.057658 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 91496ff1e14e4cfdbaadb34d25ad8b68
W20260505 20:13:35.058013 7596 leader_election.cc:343] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.062012 9047 raft_consensus.cc:493] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.062175 9047 raft_consensus.cc:515] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.062559 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:35.062822 9047 leader_election.cc:290] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:35.063588 7398 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because the tablet was not found. No further retry: Not found: Tablet not found: 91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:35.064023 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.064199 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bd0f4254424c979f90da0400e0ec70" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.064437 7929 raft_consensus.cc:2393] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:35.064498 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:35.064698 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.065197 7397 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because the tablet was not found. No further retry: Not found: Tablet not found: 91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:35.065430 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.065582 7929 raft_consensus.cc:3060] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:35.065610 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because the tablet was not found. No further retry: Not found: Tablet not found: 91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:35.069123 7929 raft_consensus.cc:2468] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.009822 8053 raft_consensus.cc:740] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.070835 8053 consensus_queue.cc:260] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.076558 7736 leader_election.cc:304] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.077000 7598 leader_election.cc:304] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.077163 8989 raft_consensus.cc:3060] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.077689 8693 raft_consensus.cc:2804] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.078192 8693 raft_consensus.cc:697] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.078552 8693 consensus_queue.cc:237] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.078776 7570 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:35.079542 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:35.080093 8053 ts_tablet_manager.cc:1434] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.073s user 0.002s sys 0.000s
I20260505 20:13:35.080192 8989 raft_consensus.cc:2749] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.080514 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:35.081121 7398 catalog_manager.cc:4969] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because the tablet was not found. No further retry: Not found: Tablet not found: 91496ff1e14e4cfdbaadb34d25ad8b68
W20260505 20:13:35.081616 7397 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because the tablet was not found. No further retry: Not found: Tablet not found: 91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:35.082469 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.083081 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because the tablet was not found. No further retry: Not found: Tablet not found: 91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:35.084165 7768 tablet_service.cc:1511] Processing CreateTablet for tablet dbaade50115e4ea69db6e50443cfea0e (DEFAULT_TABLE table=default.Table_7f422e1acade4a9b8d1c6d3056843c5c [id=faae133a5b01473d98fbe6dbdb0e81d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.084583 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaade50115e4ea69db6e50443cfea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.085516 8053 tablet_bootstrap.cc:492] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.090440 8054 tablet_bootstrap.cc:492] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.090593 8054 ts_tablet_manager.cc:1403] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.071s user 0.009s sys 0.016s
I20260505 20:13:35.091382 8054 raft_consensus.cc:359] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.091573 8054 raft_consensus.cc:385] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.091650 8054 raft_consensus.cc:740] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.091858 8054 consensus_queue.cc:260] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.092118 7626 tablet_service.cc:1511] Processing CreateTablet for tablet dbaade50115e4ea69db6e50443cfea0e (DEFAULT_TABLE table=default.Table_7f422e1acade4a9b8d1c6d3056843c5c [id=faae133a5b01473d98fbe6dbdb0e81d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.092381 8054 ts_tablet_manager.cc:1434] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:35.092536 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaade50115e4ea69db6e50443cfea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.092650 8054 tablet_bootstrap.cc:492] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.094224 8054 tablet_bootstrap.cc:654] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.100287 7900 tablet_service.cc:1511] Processing CreateTablet for tablet dbaade50115e4ea69db6e50443cfea0e (DEFAULT_TABLE table=default.Table_7f422e1acade4a9b8d1c6d3056843c5c [id=faae133a5b01473d98fbe6dbdb0e81d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.100715 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbaade50115e4ea69db6e50443cfea0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.104092 8053 tablet_bootstrap.cc:654] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.106058 7768 tablet_service.cc:1511] Processing CreateTablet for tablet f54b7c83e66c473db8470e5c4c4decab (DEFAULT_TABLE table=default.Table_fdf9cb8321b64150bc72c38e08184712 [id=698b1130292f4bf985a8b746cbd5013f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.106521 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54b7c83e66c473db8470e5c4c4decab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.108398 8054 tablet_bootstrap.cc:492] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.108534 8054 ts_tablet_manager.cc:1403] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260505 20:13:35.109313 8054 raft_consensus.cc:359] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.109496 8054 raft_consensus.cc:385] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.109570 8054 raft_consensus.cc:740] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.109817 8054 consensus_queue.cc:260] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.111065 8054 ts_tablet_manager.cc:1434] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:35.111790 8054 tablet_bootstrap.cc:492] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.113596 8054 tablet_bootstrap.cc:654] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.117817 8776 raft_consensus.cc:493] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.118055 8776 raft_consensus.cc:515] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.119098 8776 leader_election.cc:290] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.119068 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883ec65f15604346813e5f87d55802fc" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.119269 7801 raft_consensus.cc:2468] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.119670 7596 leader_election.cc:304] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.119920 8776 raft_consensus.cc:2804] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.121490 8776 raft_consensus.cc:493] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.121584 8776 raft_consensus.cc:3060] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.122825 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883ec65f15604346813e5f87d55802fc" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.123026 7929 raft_consensus.cc:2468] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.124439 8058 tablet_bootstrap.cc:492] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.127686 8058 ts_tablet_manager.cc:1403] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.109s user 0.000s sys 0.009s
I20260505 20:13:35.128257 7626 tablet_service.cc:1511] Processing CreateTablet for tablet f54b7c83e66c473db8470e5c4c4decab (DEFAULT_TABLE table=default.Table_fdf9cb8321b64150bc72c38e08184712 [id=698b1130292f4bf985a8b746cbd5013f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.128671 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54b7c83e66c473db8470e5c4c4decab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.128644 8058 raft_consensus.cc:359] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.128787 8058 raft_consensus.cc:385] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.128829 8058 raft_consensus.cc:740] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.129879 8058 consensus_queue.cc:260] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.131651 8058 ts_tablet_manager.cc:1434] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:35.131922 8058 tablet_bootstrap.cc:492] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.133589 8058 tablet_bootstrap.cc:654] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.124503 8776 raft_consensus.cc:515] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.136054 7801 raft_consensus.cc:3060] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.136862 8776 leader_election.cc:290] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.137883 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883ec65f15604346813e5f87d55802fc" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.138072 7799 raft_consensus.cc:3060] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.140504 7799 raft_consensus.cc:2468] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.140923 7596 leader_election.cc:304] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.141054 7900 tablet_service.cc:1511] Processing CreateTablet for tablet f54b7c83e66c473db8470e5c4c4decab (DEFAULT_TABLE table=default.Table_fdf9cb8321b64150bc72c38e08184712 [id=698b1130292f4bf985a8b746cbd5013f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.141269 8776 raft_consensus.cc:2804] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.141376 8053 tablet_bootstrap.cc:492] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.141433 8776 raft_consensus.cc:697] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.141515 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54b7c83e66c473db8470e5c4c4decab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.141821 8776 consensus_queue.cc:237] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.142414 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883ec65f15604346813e5f87d55802fc" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.142648 7933 raft_consensus.cc:3060] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.145061 7626 tablet_service.cc:1511] Processing CreateTablet for tablet e116486fb4b34e88b564fbb46e8b0faf (DEFAULT_TABLE table=default.Table_b03dacb5543b47f18022d67498030fd5 [id=985bed6b03104555886b99985da11476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.145406 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e116486fb4b34e88b564fbb46e8b0faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.146698 7933 raft_consensus.cc:2468] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.143991 7768 tablet_service.cc:1511] Processing CreateTablet for tablet e116486fb4b34e88b564fbb46e8b0faf (DEFAULT_TABLE table=default.Table_b03dacb5543b47f18022d67498030fd5 [id=985bed6b03104555886b99985da11476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.147820 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e116486fb4b34e88b564fbb46e8b0faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.148080 7906 tablet_service.cc:1511] Processing CreateTablet for tablet e116486fb4b34e88b564fbb46e8b0faf (DEFAULT_TABLE table=default.Table_b03dacb5543b47f18022d67498030fd5 [id=985bed6b03104555886b99985da11476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.148445 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e116486fb4b34e88b564fbb46e8b0faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.153882 8053 ts_tablet_manager.cc:1403] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.001s
I20260505 20:13:35.154695 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:35.155256 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:35.156229 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:35.156847 8693 consensus_queue.cc:1048] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.157414 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:35.157648 8054 tablet_bootstrap.cc:492] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.157876 8054 ts_tablet_manager.cc:1403] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.010s
I20260505 20:13:35.157799 8053 raft_consensus.cc:359] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.157981 8053 raft_consensus.cc:385] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.158042 8053 raft_consensus.cc:740] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.158260 8053 consensus_queue.cc:260] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.158789 8053 ts_tablet_manager.cc:1434] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:35.159091 8054 raft_consensus.cc:359] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.159307 8054 raft_consensus.cc:385] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.159422 8054 raft_consensus.cc:740] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.159698 8054 consensus_queue.cc:260] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.160267 8054 ts_tablet_manager.cc:1434] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:35.160704 8054 tablet_bootstrap.cc:492] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.162463 8054 tablet_bootstrap.cc:654] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.164956 8053 tablet_bootstrap.cc:492] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.166122 9028 raft_consensus.cc:493] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.166285 9028 raft_consensus.cc:515] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.166890 9028 leader_election.cc:290] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.168056 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.168305 7929 raft_consensus.cc:2468] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.168612 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.169205 7596 leader_election.cc:343] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.169664 7598 leader_election.cc:304] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.170022 8557 raft_consensus.cc:2804] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.170090 8557 raft_consensus.cc:493] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.170146 8557 raft_consensus.cc:3060] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.172022 7781 tablet_service.cc:1511] Processing CreateTablet for tablet ddd2235cec9d41f299d04398c097ae42 (DEFAULT_TABLE table=default.Table_97f41d02dd424799b34e1d9486191811 [id=f5f3c67ec89b494693cfa05e4a3127d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.172412 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd2235cec9d41f299d04398c097ae42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.172791 8557 raft_consensus.cc:515] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.173111 7633 tablet_service.cc:1511] Processing CreateTablet for tablet ddd2235cec9d41f299d04398c097ae42 (DEFAULT_TABLE table=default.Table_97f41d02dd424799b34e1d9486191811 [id=f5f3c67ec89b494693cfa05e4a3127d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.173373 8557 leader_election.cc:290] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.173457 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd2235cec9d41f299d04398c097ae42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.174477 7906 tablet_service.cc:1511] Processing CreateTablet for tablet ddd2235cec9d41f299d04398c097ae42 (DEFAULT_TABLE table=default.Table_97f41d02dd424799b34e1d9486191811 [id=f5f3c67ec89b494693cfa05e4a3127d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.174830 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd2235cec9d41f299d04398c097ae42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.176028 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:35.176529 7596 leader_election.cc:343] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.180281 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 (DEFAULT_TABLE table=default.Table_45bd1808371b4519abd37364b534e889 [id=b2f3204107ca4304b285cb53cba704b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.180737 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91496ff1e14e4cfdbaadb34d25ad8b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.181943 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:35.183884 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f4a8adf31bc94a33a61468adf2673681 (table default.Table_5c7ee4db09f44c5099b163f37f1f6486 [id=49103ea0eb57491fa5482997379eda9b]). Expected version 1 got 0
I20260505 20:13:35.185227 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:35.187136 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:35.190142 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 (DEFAULT_TABLE table=default.Table_45bd1808371b4519abd37364b534e889 [id=b2f3204107ca4304b285cb53cba704b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.190562 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91496ff1e14e4cfdbaadb34d25ad8b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.190553 8054 tablet_bootstrap.cc:492] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.190682 8054 ts_tablet_manager.cc:1403] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.000s
I20260505 20:13:35.191170 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 (DEFAULT_TABLE table=default.Table_45bd1808371b4519abd37364b534e889 [id=b2f3204107ca4304b285cb53cba704b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.191541 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91496ff1e14e4cfdbaadb34d25ad8b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.191495 8054 raft_consensus.cc:359] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.191669 8054 raft_consensus.cc:385] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.191718 8054 raft_consensus.cc:740] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.191920 8054 consensus_queue.cc:260] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.192431 8054 ts_tablet_manager.cc:1434] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:35.192705 8054 tablet_bootstrap.cc:492] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.193435 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 753489e300e743c48485cb5d3d19b8b9 (DEFAULT_TABLE table=default.Table_4d6492029fd442a4a8f9f68ca4726e61 [id=b92a9c1f28754bf885aee3abadd5b973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.193861 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753489e300e743c48485cb5d3d19b8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.194897 8054 tablet_bootstrap.cc:654] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.196465 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 753489e300e743c48485cb5d3d19b8b9 (DEFAULT_TABLE table=default.Table_4d6492029fd442a4a8f9f68ca4726e61 [id=b92a9c1f28754bf885aee3abadd5b973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.197449 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:35.199118 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753489e300e743c48485cb5d3d19b8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.205327 9028 consensus_queue.cc:1048] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.208570 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc695d3e3f941bbbe0d208c9f3572ee (DEFAULT_TABLE table=default.Table_6ffbc06ec7fd4793b25a6183080486ae [id=ac576d83eb4d4deba7eeb2121318fdbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.208992 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc695d3e3f941bbbe0d208c9f3572ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.210047 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 753489e300e743c48485cb5d3d19b8b9 (DEFAULT_TABLE table=default.Table_4d6492029fd442a4a8f9f68ca4726e61 [id=b92a9c1f28754bf885aee3abadd5b973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.210415 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753489e300e743c48485cb5d3d19b8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.210942 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc695d3e3f941bbbe0d208c9f3572ee (DEFAULT_TABLE table=default.Table_6ffbc06ec7fd4793b25a6183080486ae [id=ac576d83eb4d4deba7eeb2121318fdbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.211179 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc695d3e3f941bbbe0d208c9f3572ee (DEFAULT_TABLE table=default.Table_6ffbc06ec7fd4793b25a6183080486ae [id=ac576d83eb4d4deba7eeb2121318fdbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.211292 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc695d3e3f941bbbe0d208c9f3572ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.211469 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc695d3e3f941bbbe0d208c9f3572ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.213953 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 432b497141ed46ba9112b2b74f895238 (DEFAULT_TABLE table=default.Table_8804fbdfa25b473486e2051929590ef4 [id=6a62b0ae2e554e8a8689de886213a7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.214341 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432b497141ed46ba9112b2b74f895238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.214586 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 432b497141ed46ba9112b2b74f895238 (DEFAULT_TABLE table=default.Table_8804fbdfa25b473486e2051929590ef4 [id=6a62b0ae2e554e8a8689de886213a7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.214908 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432b497141ed46ba9112b2b74f895238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.217828 8983 raft_consensus.cc:493] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.217945 8983 raft_consensus.cc:515] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.218024 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 432b497141ed46ba9112b2b74f895238 (DEFAULT_TABLE table=default.Table_8804fbdfa25b473486e2051929590ef4 [id=6a62b0ae2e554e8a8689de886213a7e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.218333 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432b497141ed46ba9112b2b74f895238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.218554 8983 leader_election.cc:290] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:35.218657 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 335acbbc84624d61b779a422f29919fa (DEFAULT_TABLE table=default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.218932 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335acbbc84624d61b779a422f29919fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.219709 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 335acbbc84624d61b779a422f29919fa (DEFAULT_TABLE table=default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.220036 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335acbbc84624d61b779a422f29919fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.222369 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506b421a774c4929813205dba0fac32b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.222568 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506b421a774c4929813205dba0fac32b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.222880 7870 leader_election.cc:343] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:35.223242 7869 leader_election.cc:343] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.223344 7869 leader_election.cc:304] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.223675 8983 raft_consensus.cc:2749] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.228152 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 6c20374c4df742799110a12f3fea5daa (DEFAULT_TABLE table=default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.228533 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c20374c4df742799110a12f3fea5daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.231519 8054 tablet_bootstrap.cc:492] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.231752 8054 ts_tablet_manager.cc:1403] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.000s
I20260505 20:13:35.232596 8054 raft_consensus.cc:359] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.232856 8054 raft_consensus.cc:385] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.233312 8054 raft_consensus.cc:740] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.232841 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.233618 7929 raft_consensus.cc:3060] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.236502 7929 raft_consensus.cc:2468] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.236996 7598 leader_election.cc:304] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.237347 9028 raft_consensus.cc:2804] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.237463 9028 raft_consensus.cc:697] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.237428 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 6c20374c4df742799110a12f3fea5daa (DEFAULT_TABLE table=default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.237725 9028 consensus_queue.cc:237] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.237888 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c20374c4df742799110a12f3fea5daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.240162 8058 tablet_bootstrap.cc:492] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.233826 8054 consensus_queue.cc:260] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.197924 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:35.240720 8058 ts_tablet_manager.cc:1403] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.008s
I20260505 20:13:35.240901 8054 ts_tablet_manager.cc:1434] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260505 20:13:35.241446 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:35.242177 8054 tablet_bootstrap.cc:492] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.243010 8058 raft_consensus.cc:359] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.243294 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 6c20374c4df742799110a12f3fea5daa (DEFAULT_TABLE table=default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.243642 8054 tablet_bootstrap.cc:654] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.243654 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c20374c4df742799110a12f3fea5daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.244181 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:35.244355 8058 raft_consensus.cc:385] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.244473 8058 raft_consensus.cc:740] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.244695 8058 consensus_queue.cc:260] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.245096 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:35.246359 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 81ee820d24ec4ba1b3ae17388f75341b (DEFAULT_TABLE table=default.Table_8eedf90fb41d454599dc92dc088b5dfb [id=d521215c531a444ea1bdd1c1d40e575c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.246820 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ee820d24ec4ba1b3ae17388f75341b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.247361 8053 tablet_bootstrap.cc:654] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.248617 8058 ts_tablet_manager.cc:1434] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260505 20:13:35.249063 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:35.249444 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:35.250269 8058 tablet_bootstrap.cc:492] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.250792 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:35.252439 8058 tablet_bootstrap.cc:654] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.252697 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:35.253188 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:35.253685 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:35.255443 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 81ee820d24ec4ba1b3ae17388f75341b (DEFAULT_TABLE table=default.Table_8eedf90fb41d454599dc92dc088b5dfb [id=d521215c531a444ea1bdd1c1d40e575c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.256039 7782 tablet_service.cc:1511] Processing CreateTablet for tablet a694c65f90f4499ab96e45fbbaa9e892 (DEFAULT_TABLE table=default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.256470 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a694c65f90f4499ab96e45fbbaa9e892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.256713 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 335acbbc84624d61b779a422f29919fa (DEFAULT_TABLE table=default.Table_59e5c20b026c4ceb9e6452635dffc57f [id=f81d5f61b838445e8d76768331ddb175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.257062 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335acbbc84624d61b779a422f29919fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.257361 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ee820d24ec4ba1b3ae17388f75341b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.261633 8983 raft_consensus.cc:493] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.261812 8983 raft_consensus.cc:515] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.262409 8983 leader_election.cc:290] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:35.263018 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bd562fea64fe69db2b4a6085b7bed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.264038 7869 leader_election.cc:343] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.264974 7900 tablet_service.cc:1511] Processing CreateTablet for tablet a694c65f90f4499ab96e45fbbaa9e892 (DEFAULT_TABLE table=default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.265396 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a694c65f90f4499ab96e45fbbaa9e892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.267499 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 95c591e3f33d4606be7181e380fadcf6 (DEFAULT_TABLE table=default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b [id=73e0bdfe9dc54036b928ccd1804f6ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.268350 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c591e3f33d4606be7181e380fadcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.252875 8693 raft_consensus.cc:493] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.269052 8693 raft_consensus.cc:515] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.269151 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 95c591e3f33d4606be7181e380fadcf6 (DEFAULT_TABLE table=default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b [id=73e0bdfe9dc54036b928ccd1804f6ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.269716 8693 leader_election.cc:290] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.269726 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c591e3f33d4606be7181e380fadcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.253104 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 81ee820d24ec4ba1b3ae17388f75341b (DEFAULT_TABLE table=default.Table_8eedf90fb41d454599dc92dc088b5dfb [id=d521215c531a444ea1bdd1c1d40e575c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.270437 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 369f4a55fdd64e4bb907666bede9f241 (DEFAULT_TABLE table=default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.270814 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369f4a55fdd64e4bb907666bede9f241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.270808 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ee820d24ec4ba1b3ae17388f75341b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.275363 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 369f4a55fdd64e4bb907666bede9f241 (DEFAULT_TABLE table=default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.275867 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369f4a55fdd64e4bb907666bede9f241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.270447 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ce3efe875a43d9b30d40623bf8a385" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.256560 7635 tablet_service.cc:1511] Processing CreateTablet for tablet a694c65f90f4499ab96e45fbbaa9e892 (DEFAULT_TABLE table=default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.263025 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bd562fea64fe69db2b4a6085b7bed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.278050 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a694c65f90f4499ab96e45fbbaa9e892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.280292 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 369f4a55fdd64e4bb907666bede9f241 (DEFAULT_TABLE table=default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.280683 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369f4a55fdd64e4bb907666bede9f241. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:35.282176 7596 leader_election.cc:343] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:35.282651 7870 leader_election.cc:343] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.282755 7870 leader_election.cc:304] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.283118 8983 raft_consensus.cc:2749] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.283808 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ce3efe875a43d9b30d40623bf8a385" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.284056 7929 raft_consensus.cc:2468] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.284480 7598 leader_election.cc:304] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.284732 8693 raft_consensus.cc:2804] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.284811 8693 raft_consensus.cc:493] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.284874 8693 raft_consensus.cc:3060] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.285822 8054 tablet_bootstrap.cc:492] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.285835 7773 tablet_service.cc:1511] Processing CreateTablet for tablet a114db19f63346d9a67e9e3a8225caa4 (DEFAULT_TABLE table=default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.286053 8054 ts_tablet_manager.cc:1403] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260505 20:13:35.286216 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a114db19f63346d9a67e9e3a8225caa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.286899 8054 raft_consensus.cc:359] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.287132 8054 raft_consensus.cc:385] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.287240 8054 raft_consensus.cc:740] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.287393 8693 raft_consensus.cc:515] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.287981 8693 leader_election.cc:290] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.288420 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ce3efe875a43d9b30d40623bf8a385" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.288471 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ce3efe875a43d9b30d40623bf8a385" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
W20260505 20:13:35.288833 7596 leader_election.cc:343] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.284627 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 95c591e3f33d4606be7181e380fadcf6 (DEFAULT_TABLE table=default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b [id=73e0bdfe9dc54036b928ccd1804f6ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.288616 7929 raft_consensus.cc:3060] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.289544 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c591e3f33d4606be7181e380fadcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.292014 7929 raft_consensus.cc:2468] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.293187 8053 tablet_bootstrap.cc:492] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.293373 8053 ts_tablet_manager.cc:1403] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.134s user 0.004s sys 0.000s
I20260505 20:13:35.294214 8053 raft_consensus.cc:359] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.294450 8053 raft_consensus.cc:385] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.294548 8053 raft_consensus.cc:740] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.294806 8053 consensus_queue.cc:260] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.257109 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:35.296147 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:35.296778 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:35.298305 8053 ts_tablet_manager.cc:1434] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260505 20:13:35.298666 8053 tablet_bootstrap.cc:492] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.300133 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:35.300643 7635 tablet_service.cc:1511] Processing CreateTablet for tablet a114db19f63346d9a67e9e3a8225caa4 (DEFAULT_TABLE table=default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.301033 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a114db19f63346d9a67e9e3a8225caa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.301045 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:35.301570 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:35.302042 8053 tablet_bootstrap.cc:654] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.292240 8054 consensus_queue.cc:260] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.303053 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:35.303256 7598 leader_election.cc:304] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.303670 8693 raft_consensus.cc:2804] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.303779 8693 raft_consensus.cc:697] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.304008 8693 consensus_queue.cc:237] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.303586 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:35.311059 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:35.311220 8054 ts_tablet_manager.cc:1434] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260505 20:13:35.316573 7912 tablet_service.cc:1511] Processing CreateTablet for tablet ae79f58b6c874103afffa963c45891a1 (DEFAULT_TABLE table=default.Table_ea3e50a7f8674f1bbf87cffd1ecda924 [id=786cf234bad142bbb02e075fade18dfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.316692 7781 tablet_service.cc:1511] Processing CreateTablet for tablet ae79f58b6c874103afffa963c45891a1 (DEFAULT_TABLE table=default.Table_ea3e50a7f8674f1bbf87cffd1ecda924 [id=786cf234bad142bbb02e075fade18dfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.316860 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 55a3257f86264120b145263525d260a4 (DEFAULT_TABLE table=default.Table_4d734c3b988341548c565edf9dd4373f [id=ca832427177f429e8879e5a24db548dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.317090 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae79f58b6c874103afffa963c45891a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.317548 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a3257f86264120b145263525d260a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.317868 8054 tablet_bootstrap.cc:492] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.320497 8054 tablet_bootstrap.cc:654] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.324579 7632 tablet_service.cc:1511] Processing CreateTablet for tablet ae79f58b6c874103afffa963c45891a1 (DEFAULT_TABLE table=default.Table_ea3e50a7f8674f1bbf87cffd1ecda924 [id=786cf234bad142bbb02e075fade18dfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.325076 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae79f58b6c874103afffa963c45891a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.327248 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae79f58b6c874103afffa963c45891a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.335958 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 55a3257f86264120b145263525d260a4 (DEFAULT_TABLE table=default.Table_4d734c3b988341548c565edf9dd4373f [id=ca832427177f429e8879e5a24db548dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.336417 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a3257f86264120b145263525d260a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.313504 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:35.337597 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]). Expected version 1 got 0
I20260505 20:13:35.337988 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:35.338439 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 160aa46d629247d0a46f433ef4088643 (DEFAULT_TABLE table=default.Table_035bd09058974bb3af45abcaa4ca635d [id=fea7f8cb909f409a84ba3319277b7572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.338794 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160aa46d629247d0a46f433ef4088643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.339046 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (DEFAULT_TABLE table=default.Table_0af890deafbf4b8a901edea12e3c1e22 [id=42e490450ed34cac8cab5430f0df45b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.339359 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616cd8f1a6124d2e89e170c5e1ff2385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.339625 7641 tablet_service.cc:1511] Processing CreateTablet for tablet e2b6d9b8da2d4550bd5bb37cd0da929b (DEFAULT_TABLE table=default.Table_76b32ec6ddb64571a8c264c3e9449741 [id=c7acd6b3b4074af390d36bbd2965621d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.339862 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 160aa46d629247d0a46f433ef4088643 (DEFAULT_TABLE table=default.Table_035bd09058974bb3af45abcaa4ca635d [id=fea7f8cb909f409a84ba3319277b7572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.339955 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b6d9b8da2d4550bd5bb37cd0da929b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.340193 7915 tablet_service.cc:1511] Processing CreateTablet for tablet e2b6d9b8da2d4550bd5bb37cd0da929b (DEFAULT_TABLE table=default.Table_76b32ec6ddb64571a8c264c3e9449741 [id=c7acd6b3b4074af390d36bbd2965621d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.340258 7907 tablet_service.cc:1511] Processing CreateTablet for tablet a114db19f63346d9a67e9e3a8225caa4 (DEFAULT_TABLE table=default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.340196 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160aa46d629247d0a46f433ef4088643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.340715 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b6d9b8da2d4550bd5bb37cd0da929b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.341197 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a114db19f63346d9a67e9e3a8225caa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.346719 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 160aa46d629247d0a46f433ef4088643 (DEFAULT_TABLE table=default.Table_035bd09058974bb3af45abcaa4ca635d [id=fea7f8cb909f409a84ba3319277b7572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.347105 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160aa46d629247d0a46f433ef4088643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.347048 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 5060bba634d440a09840e36e37a80d46 (DEFAULT_TABLE table=default.Table_f7765b40e19645f281ad2da563b7a009 [id=7b7cd6e40cad42b9b2002e608a49d644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.347429 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5060bba634d440a09840e36e37a80d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.354375 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 5060bba634d440a09840e36e37a80d46 (DEFAULT_TABLE table=default.Table_f7765b40e19645f281ad2da563b7a009 [id=7b7cd6e40cad42b9b2002e608a49d644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.354912 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5060bba634d440a09840e36e37a80d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.355002 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 5060bba634d440a09840e36e37a80d46 (DEFAULT_TABLE table=default.Table_f7765b40e19645f281ad2da563b7a009 [id=7b7cd6e40cad42b9b2002e608a49d644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.355424 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5060bba634d440a09840e36e37a80d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.359344 8053 tablet_bootstrap.cc:492] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.360570 8053 ts_tablet_manager.cc:1403] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
I20260505 20:13:35.360204 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 55a3257f86264120b145263525d260a4 (DEFAULT_TABLE table=default.Table_4d734c3b988341548c565edf9dd4373f [id=ca832427177f429e8879e5a24db548dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.362097 8058 tablet_bootstrap.cc:492] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.362160 8053 raft_consensus.cc:359] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.362290 8058 ts_tablet_manager.cc:1403] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.112s user 0.003s sys 0.003s
I20260505 20:13:35.362636 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (DEFAULT_TABLE table=default.Table_0af890deafbf4b8a901edea12e3c1e22 [id=42e490450ed34cac8cab5430f0df45b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.363188 8058 raft_consensus.cc:359] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.363451 8058 raft_consensus.cc:385] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.363552 8058 raft_consensus.cc:740] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.363855 8058 consensus_queue.cc:260] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.363950 9028 raft_consensus.cc:493] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.364101 9028 raft_consensus.cc:515] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.364485 8058 ts_tablet_manager.cc:1434] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:35.364691 9028 leader_election.cc:290] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.364725 8058 tablet_bootstrap.cc:492] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:35.366667 7596 leader_election.cc:343] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 4939dab5a4d54a08a75424bcaabbb8dd
W20260505 20:13:35.367537 7598 leader_election.cc:343] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:35.367655 7598 leader_election.cc:304] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.368031 9028 raft_consensus.cc:2749] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.368549 8053 raft_consensus.cc:385] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.368923 8053 raft_consensus.cc:740] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.361028 7782 tablet_service.cc:1511] Processing CreateTablet for tablet e2b6d9b8da2d4550bd5bb37cd0da929b (DEFAULT_TABLE table=default.Table_76b32ec6ddb64571a8c264c3e9449741 [id=c7acd6b3b4074af390d36bbd2965621d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.369601 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b6d9b8da2d4550bd5bb37cd0da929b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.372294 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (DEFAULT_TABLE table=default.Table_0af890deafbf4b8a901edea12e3c1e22 [id=42e490450ed34cac8cab5430f0df45b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.372741 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616cd8f1a6124d2e89e170c5e1ff2385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.362716 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a3257f86264120b145263525d260a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.377763 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616cd8f1a6124d2e89e170c5e1ff2385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.373823 8053 consensus_queue.cc:260] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.380802 8053 ts_tablet_manager.cc:1434] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.019s user 0.001s sys 0.000s
I20260505 20:13:35.381493 8053 tablet_bootstrap.cc:492] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.383569 8053 tablet_bootstrap.cc:654] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.386596 8054 tablet_bootstrap.cc:492] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.387199 8054 ts_tablet_manager.cc:1403] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.001s
I20260505 20:13:35.388022 8054 raft_consensus.cc:359] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.388309 8054 raft_consensus.cc:385] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.388430 8054 raft_consensus.cc:740] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.388834 8054 consensus_queue.cc:260] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.398691 8639 raft_consensus.cc:493] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.398851 8639 raft_consensus.cc:515] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.399507 8639 leader_election.cc:290] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:35.400421 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1505e592e543cca92d8949bdae007e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.401067 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1505e592e543cca92d8949bdae007e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:35.401245 7869 leader_election.cc:343] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.402405 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 7382e748682547b1a41781ff05c6733d (DEFAULT_TABLE table=default.Table_13e34bc0465a46e392ef089f7b07a2c8 [id=ed051a1485154757bc8111fa2ff4fe16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.402794 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7382e748682547b1a41781ff05c6733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.402374 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 82b78fbe740a4478a5638bea70268125 (DEFAULT_TABLE table=default.Table_db1068a01b8646a5b81f675ce7a1e865 [id=fd1bd9f8259b4aa2b5cefe2db98857ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.403193 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 7382e748682547b1a41781ff05c6733d (DEFAULT_TABLE table=default.Table_13e34bc0465a46e392ef089f7b07a2c8 [id=ed051a1485154757bc8111fa2ff4fe16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.403409 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b78fbe740a4478a5638bea70268125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.403548 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7382e748682547b1a41781ff05c6733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.403700 8058 tablet_bootstrap.cc:654] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.404700 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (DEFAULT_TABLE table=default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.404984 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb3d246d6b443b8933648fe4f4aa5c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.406008 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (DEFAULT_TABLE table=default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.406327 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb3d246d6b443b8933648fe4f4aa5c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.409091 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 82b78fbe740a4478a5638bea70268125 (DEFAULT_TABLE table=default.Table_db1068a01b8646a5b81f675ce7a1e865 [id=fd1bd9f8259b4aa2b5cefe2db98857ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.409382 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b78fbe740a4478a5638bea70268125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.409988 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff52f8570dd436c9de8c16b98aa660c (DEFAULT_TABLE table=default.Table_dde336fdd3fd43cc857271e351be6fdb [id=d9f1189f8fb94fecae57d3ee5c522c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.410341 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff52f8570dd436c9de8c16b98aa660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.412106 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 64f71198bf544c11b7566a5864e2d43d (DEFAULT_TABLE table=default.Table_9b8219e65d994d0a9766561a882b6eb0 [id=86d0373dccae4220844c84f9258c10ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.413147 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f71198bf544c11b7566a5864e2d43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.412549 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee71b5d9ebb4081b98bf5514edb7f28 (DEFAULT_TABLE table=default.Table_be46b106277f46f99625e18345a7b985 [id=dcc2a424efe541cf8303fe0f1547252c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.413970 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff52f8570dd436c9de8c16b98aa660c (DEFAULT_TABLE table=default.Table_dde336fdd3fd43cc857271e351be6fdb [id=d9f1189f8fb94fecae57d3ee5c522c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.414175 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee71b5d9ebb4081b98bf5514edb7f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.414108 7764 tablet_service.cc:1511] Processing CreateTablet for tablet f6eaa274f7ef4cd6b9752f14b143ab6c (DEFAULT_TABLE table=default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.414418 7907 tablet_service.cc:1511] Processing CreateTablet for tablet d8c4620970434e49b4fd3d21f309a48c (DEFAULT_TABLE table=default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.414709 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c4620970434e49b4fd3d21f309a48c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:35.416002 7870 leader_election.cc:343] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.416122 7870 leader_election.cc:304] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.416652 8986 raft_consensus.cc:2749] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.417665 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 82b78fbe740a4478a5638bea70268125 (DEFAULT_TABLE table=default.Table_db1068a01b8646a5b81f675ce7a1e865 [id=fd1bd9f8259b4aa2b5cefe2db98857ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.417897 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff52f8570dd436c9de8c16b98aa660c (DEFAULT_TABLE table=default.Table_dde336fdd3fd43cc857271e351be6fdb [id=d9f1189f8fb94fecae57d3ee5c522c54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.418089 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b78fbe740a4478a5638bea70268125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.418613 7626 tablet_service.cc:1511] Processing CreateTablet for tablet f6eaa274f7ef4cd6b9752f14b143ab6c (DEFAULT_TABLE table=default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.418951 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6eaa274f7ef4cd6b9752f14b143ab6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.420122 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee71b5d9ebb4081b98bf5514edb7f28 (DEFAULT_TABLE table=default.Table_be46b106277f46f99625e18345a7b985 [id=dcc2a424efe541cf8303fe0f1547252c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.422008 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (DEFAULT_TABLE table=default.Table_6d8507ea845641ba9e0d0f6228317e2e [id=c9231e82f5154f8ba2a1051de93491dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.422317 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb3d246d6b443b8933648fe4f4aa5c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.424644 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee71b5d9ebb4081b98bf5514edb7f28 (DEFAULT_TABLE table=default.Table_be46b106277f46f99625e18345a7b985 [id=dcc2a424efe541cf8303fe0f1547252c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.424875 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff52f8570dd436c9de8c16b98aa660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.424937 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee71b5d9ebb4081b98bf5514edb7f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.430464 7900 tablet_service.cc:1511] Processing CreateTablet for tablet f6eaa274f7ef4cd6b9752f14b143ab6c (DEFAULT_TABLE table=default.Table_c8ad976998f340cf8dcfe84814ef6234 [id=935bbbcb6e0c4810ababa156bd0cdfbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.430719 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff52f8570dd436c9de8c16b98aa660c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.430662 7768 tablet_service.cc:1511] Processing CreateTablet for tablet d8c4620970434e49b4fd3d21f309a48c (DEFAULT_TABLE table=default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.430833 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6eaa274f7ef4cd6b9752f14b143ab6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.433413 7628 tablet_service.cc:1511] Processing CreateTablet for tablet d8c4620970434e49b4fd3d21f309a48c (DEFAULT_TABLE table=default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.433825 7628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c4620970434e49b4fd3d21f309a48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.435237 8718 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.435370 8718 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.435979 8718 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.436589 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.439090 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.439666 7930 raft_consensus.cc:2393] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:35.440237 7737 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.440485 8718 raft_consensus.cc:3060] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.441083 7781 tablet_service.cc:1511] Processing CreateTablet for tablet 64f71198bf544c11b7566a5864e2d43d (DEFAULT_TABLE table=default.Table_9b8219e65d994d0a9766561a882b6eb0 [id=86d0373dccae4220844c84f9258c10ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.444702 8718 raft_consensus.cc:2749] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.457967 8058 tablet_bootstrap.cc:492] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.458184 8058 ts_tablet_manager.cc:1403] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.094s user 0.005s sys 0.005s
I20260505 20:13:35.457728 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 7382e748682547b1a41781ff05c6733d (DEFAULT_TABLE table=default.Table_13e34bc0465a46e392ef089f7b07a2c8 [id=ed051a1485154757bc8111fa2ff4fe16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.459213 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 64f71198bf544c11b7566a5864e2d43d (DEFAULT_TABLE table=default.Table_9b8219e65d994d0a9766561a882b6eb0 [id=86d0373dccae4220844c84f9258c10ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:35.459408 8058 raft_consensus.cc:359] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.460896 8058 raft_consensus.cc:385] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.461018 8058 raft_consensus.cc:740] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.461295 8058 consensus_queue.cc:260] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.462735 8058 ts_tablet_manager.cc:1434] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:35.462013 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7382e748682547b1a41781ff05c6733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.463521 8058 tablet_bootstrap.cc:492] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.463995 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f71198bf544c11b7566a5864e2d43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.466703 8054 ts_tablet_manager.cc:1434] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.079s user 0.001s sys 0.001s
I20260505 20:13:35.467947 9028 consensus_queue.cc:1048] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.470276 9028 consensus_queue.cc:1048] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.475711 8058 tablet_bootstrap.cc:654] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.480798 8054 tablet_bootstrap.cc:492] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.496888 8058 tablet_bootstrap.cc:492] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.497033 8058 ts_tablet_manager.cc:1403] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.002s
I20260505 20:13:35.497804 8058 raft_consensus.cc:359] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.498185 8058 raft_consensus.cc:385] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.498253 8058 raft_consensus.cc:740] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.498425 8058 consensus_queue.cc:260] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.498883 8058 ts_tablet_manager.cc:1434] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:35.499145 8058 tablet_bootstrap.cc:492] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.505873 8058 tablet_bootstrap.cc:654] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.519575 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
W20260505 20:13:35.529917 7398 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a5fcaee384c440bcb3307cba455e2ffa consensus state has no leader
I20260505 20:13:35.539000 8054 tablet_bootstrap.cc:654] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:35.543335 7399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 50324us
I20260505 20:13:35.543888 8776 consensus_queue.cc:1048] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:35.548125 7399 consensus_peers.cc:597] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d -> Peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Couldn't send request to peer 73028cd481e446daa9432a35522a7967. Status: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:35.562973 8986 raft_consensus.cc:493] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.563176 8986 raft_consensus.cc:515] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.563923 8986 leader_election.cc:290] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:35.564951 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d411638715f747469f9f3dc490c0257c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.565224 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d411638715f747469f9f3dc490c0257c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.565925 7869 leader_election.cc:343] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:35.566040 7870 leader_election.cc:343] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.566155 7870 leader_election.cc:304] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.566426 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:35.568492 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:35.569023 8054 tablet_bootstrap.cc:492] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.569326 8054 ts_tablet_manager.cc:1403] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.002s
I20260505 20:13:35.570132 8986 raft_consensus.cc:2749] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.571542 8054 raft_consensus.cc:359] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.571951 8054 raft_consensus.cc:385] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.572098 8054 raft_consensus.cc:740] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.572615 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:35.573849 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]). Expected version 1 got 0
I20260505 20:13:35.572916 8054 consensus_queue.cc:260] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.575134 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:35.578778 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:35.579663 8054 ts_tablet_manager.cc:1434] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260505 20:13:35.581931 8054 tablet_bootstrap.cc:492] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.584185 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:35.585356 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:35.587157 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:35.589812 8986 raft_consensus.cc:493] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.589615 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:35.589937 8986 raft_consensus.cc:515] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.590533 8986 leader_election.cc:290] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:35.591164 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608bffbbc10141e8bd19f475b95bdc65" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.591370 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608bffbbc10141e8bd19f475b95bdc65" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:35.591856 7869 leader_election.cc:343] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:35.592015 7870 leader_election.cc:343] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.592118 7870 leader_election.cc:304] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.592641 8986 raft_consensus.cc:2749] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.593343 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:35.595551 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:35.596467 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:35.598134 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:35.599756 8693 consensus_queue.cc:1048] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.604377 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:35.606336 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:35.606802 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:35.607898 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:35.609700 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f4a8adf31bc94a33a61468adf2673681 (table default.Table_5c7ee4db09f44c5099b163f37f1f6486 [id=49103ea0eb57491fa5482997379eda9b]). Expected version 1 got 0
I20260505 20:13:35.611238 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:35.611299 8054 tablet_bootstrap.cc:654] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.612190 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:35.613291 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:35.614269 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:35.615332 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:35.616863 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:35.617817 8986 raft_consensus.cc:493] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.617949 8986 raft_consensus.cc:515] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.617372 8053 tablet_bootstrap.cc:492] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.618539 8986 leader_election.cc:290] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:35.618973 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249cad23ecfe4b9dbbd34f2a1fa899e3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.619036 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249cad23ecfe4b9dbbd34f2a1fa899e3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.619546 7869 leader_election.cc:343] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.619326 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
W20260505 20:13:35.619693 7870 leader_election.cc:343] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.619807 7870 leader_election.cc:304] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.620256 8058 tablet_bootstrap.cc:492] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.620409 8058 ts_tablet_manager.cc:1403] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.121s user 0.013s sys 0.016s
I20260505 20:13:35.620316 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:35.620702 8986 raft_consensus.cc:2749] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.621570 8053 ts_tablet_manager.cc:1403] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.240s user 0.007s sys 0.018s
I20260505 20:13:35.622870 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:35.624858 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:35.625876 8058 raft_consensus.cc:359] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.626039 8058 raft_consensus.cc:385] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.626085 8058 raft_consensus.cc:740] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.625854 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:35.626267 8058 consensus_queue.cc:260] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.626714 8058 ts_tablet_manager.cc:1434] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260505 20:13:35.626967 8058 tablet_bootstrap.cc:492] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.627848 7412 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:35.628585 8058 tablet_bootstrap.cc:654] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.634718 8053 raft_consensus.cc:359] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.635720 8986 raft_consensus.cc:493] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.635850 8986 raft_consensus.cc:515] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.635679 8053 raft_consensus.cc:385] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.636446 8986 leader_election.cc:290] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:35.636384 8053 raft_consensus.cc:740] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.636981 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:35.637531 7870 leader_election.cc:343] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.638200 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.638768 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6eaa274f7ef4cd6b9752f14b143ab6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:35.642053 7869 leader_election.cc:343] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.642179 7869 leader_election.cc:304] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.642228 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c4620970434e49b4fd3d21f309a48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.642401 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee71b5d9ebb4081b98bf5514edb7f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.642781 8986 raft_consensus.cc:2749] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.647466 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f71198bf544c11b7566a5864e2d43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:35.648641 8058 tablet_bootstrap.cc:492] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.648762 8058 ts_tablet_manager.cc:1403] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260505 20:13:35.649477 8058 raft_consensus.cc:359] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.649652 8058 raft_consensus.cc:385] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.649698 8058 raft_consensus.cc:740] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.649916 8058 consensus_queue.cc:260] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.650591 8058 ts_tablet_manager.cc:1434] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:35.651744 8058 tablet_bootstrap.cc:492] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.653507 8058 tablet_bootstrap.cc:654] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.638080 8053 consensus_queue.cc:260] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.660769 8926 consensus_queue.cc:1048] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.661785 8053 ts_tablet_manager.cc:1434] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.039s user 0.003s sys 0.000s
I20260505 20:13:35.662098 8053 tablet_bootstrap.cc:492] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.670699 8054 tablet_bootstrap.cc:492] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.670847 8054 ts_tablet_manager.cc:1403] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.000s
I20260505 20:13:35.671198 8776 consensus_queue.cc:1048] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.671744 8054 raft_consensus.cc:359] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.671943 8054 raft_consensus.cc:385] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.672006 8054 raft_consensus.cc:740] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.672137 8058 tablet_bootstrap.cc:492] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.672254 8058 ts_tablet_manager.cc:1403] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
I20260505 20:13:35.672223 8054 consensus_queue.cc:260] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.672791 8054 ts_tablet_manager.cc:1434] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:35.672951 8058 raft_consensus.cc:359] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.673105 8054 tablet_bootstrap.cc:492] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.673163 8058 raft_consensus.cc:385] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.673337 8058 raft_consensus.cc:740] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.673601 8058 consensus_queue.cc:260] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.674268 8058 ts_tablet_manager.cc:1434] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:35.674577 8058 tablet_bootstrap.cc:492] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.677201 8053 tablet_bootstrap.cc:654] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.678386 8054 tablet_bootstrap.cc:654] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.679755 8058 tablet_bootstrap.cc:654] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.694629 8058 tablet_bootstrap.cc:492] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:35.694839 8058 ts_tablet_manager.cc:1403] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260505 20:13:35.695721 8058 raft_consensus.cc:359] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.696045 8058 raft_consensus.cc:385] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.696130 8053 tablet_bootstrap.cc:492] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.696151 8058 raft_consensus.cc:740] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.696264 8053 ts_tablet_manager.cc:1403] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260505 20:13:35.696981 8053 raft_consensus.cc:359] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.697139 8053 raft_consensus.cc:385] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.697183 8053 raft_consensus.cc:740] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.697399 8053 consensus_queue.cc:260] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.697860 8053 ts_tablet_manager.cc:1434] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:35.698123 8053 tablet_bootstrap.cc:492] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.698345 8058 consensus_queue.cc:260] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.699005 8058 ts_tablet_manager.cc:1434] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:35.699333 8058 tablet_bootstrap.cc:492] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:35.701059 8058 tablet_bootstrap.cc:654] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.702521 8054 tablet_bootstrap.cc:492] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.702658 8054 ts_tablet_manager.cc:1403] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260505 20:13:35.703414 8054 raft_consensus.cc:359] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.703578 8054 raft_consensus.cc:385] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.703630 8054 raft_consensus.cc:740] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.703814 8054 consensus_queue.cc:260] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.704280 8054 ts_tablet_manager.cc:1434] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:35.704538 8054 tablet_bootstrap.cc:492] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.702502 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:35.706089 8054 tablet_bootstrap.cc:654] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.706305 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:35.706638 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:35.707058 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_c1053ca6e76b45f4a7da074bbd43d129 [id=48be793440d142f287ca28d23b4f996a]). Expected version 1 got 0
I20260505 20:13:35.709396 8053 tablet_bootstrap.cc:654] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.710027 8776 raft_consensus.cc:493] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.710155 8776 raft_consensus.cc:515] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.710722 8776 leader_election.cc:290] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.711166 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2b417857347468529868b51ec07ab" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.711359 7930 raft_consensus.cc:2468] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.711509 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:35.711823 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:35.712078 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2b417857347468529868b51ec07ab" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.712244 7801 raft_consensus.cc:2468] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.712694 7596 leader_election.cc:304] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.712922 8718 raft_consensus.cc:493] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.713059 8718 raft_consensus.cc:515] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.713320 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:35.713639 8718 leader_election.cc:290] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.714092 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:35.714293 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:35.714404 8776 raft_consensus.cc:2804] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.714498 8776 raft_consensus.cc:493] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.714570 8776 raft_consensus.cc:3060] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.717206 8776 raft_consensus.cc:515] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.718636 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:35.718704 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.718942 8054 tablet_bootstrap.cc:492] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:35.718969 7930 raft_consensus.cc:2393] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:35.719099 8054 ts_tablet_manager.cc:1403] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260505 20:13:35.719848 8054 raft_consensus.cc:359] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.720005 8054 raft_consensus.cc:385] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.720361 8054 raft_consensus.cc:740] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.720564 8054 consensus_queue.cc:260] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.720633 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2b417857347468529868b51ec07ab" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.720804 7801 raft_consensus.cc:3060] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.721567 8054 ts_tablet_manager.cc:1434] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:35.721873 8054 tablet_bootstrap.cc:492] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:35.721594 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:35.722337 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:35.723205 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:35.723497 8054 tablet_bootstrap.cc:654] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.724356 7801 raft_consensus.cc:2468] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.724843 7596 leader_election.cc:304] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.725001 8053 tablet_bootstrap.cc:492] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.725127 8053 ts_tablet_manager.cc:1403] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260505 20:13:35.725106 8693 raft_consensus.cc:2804] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.725240 8693 raft_consensus.cc:697] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.725556 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:35.725482 8693 consensus_queue.cc:237] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.725771 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:35.725999 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:35.726095 8053 raft_consensus.cc:359] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.726245 8053 raft_consensus.cc:385] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.726310 8053 raft_consensus.cc:740] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.726483 8053 consensus_queue.cc:260] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.726780 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:35.726897 8053 ts_tablet_manager.cc:1434] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:35.726945 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:35.727162 8053 tablet_bootstrap.cc:492] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.728816 8053 tablet_bootstrap.cc:654] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.730086 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50680deff6fe4dcabbf5a3aeb47ac01e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.730351 7657 raft_consensus.cc:1275] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260505 20:13:35.732703 8776 leader_election.cc:290] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.727116 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:35.734208 7736 leader_election.cc:304] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.734684 8718 raft_consensus.cc:3060] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.735569 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:35.735778 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:35.735983 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:35.736160 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:35.736331 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:35.736517 7409 catalog_manager.cc:5671] T 0677740c3f77442895361e22d616a9ba P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:35.737053 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:35.737403 8718 raft_consensus.cc:2749] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.737660 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:35.738925 8718 consensus_queue.cc:1048] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.740628 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2b417857347468529868b51ec07ab" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.740800 7930 raft_consensus.cc:3060] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.742507 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:35.742705 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:35.743005 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:35.743222 7409 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:35.744295 7930 raft_consensus.cc:2468] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.746771 8053 tablet_bootstrap.cc:492] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.746927 8053 ts_tablet_manager.cc:1403] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260505 20:13:35.748224 8053 raft_consensus.cc:359] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.748461 8053 raft_consensus.cc:385] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.748543 8053 raft_consensus.cc:740] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.749734 8986 raft_consensus.cc:493] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.749965 8986 raft_consensus.cc:515] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.750167 8053 consensus_queue.cc:260] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.750741 8986 leader_election.cc:290] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:35.750819 8053 ts_tablet_manager.cc:1434] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:35.751163 8053 tablet_bootstrap.cc:492] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:35.751224 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 506b421a774c4929813205dba0fac32b
I20260505 20:13:35.751806 7407 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 62) took 1148 ms. Trace:
I20260505 20:13:35.751919 7407 rpcz_store.cc:276] 0505 20:13:34.603785 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.930326 (+326541us) service_pool.cc:224] Handling call
0505 20:13:34.935013 (+ 4687us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:34.935143 (+ 130us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:34.935278 (+ 135us) catalog_manager.cc:2824] Locking tablets
0505 20:13:34.952213 (+ 16935us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:34.971143 (+ 18930us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:34.971292 (+ 149us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:35.751147 (+779855us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:35.751764 (+ 617us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:34.954690 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.954802 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.954808 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:34.954810 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:34.954903 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.954914 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.954918 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:34.955020 (+ 102us) tablet.cc:701] Row locks acquired
0505 20:13:34.955024 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:34.955058 (+ 34us) write_op.cc:270] Start()
0505 20:13:34.955084 (+ 26us) write_op.cc:276] Timestamp: P: 1778012014955080 usec, L: 0
0505 20:13:34.955088 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.955215 (+ 127us) log.cc:844] Serialized 759 byte log entry
0505 20:13:34.964816 (+ 9601us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.965723 (+ 907us) write_op.cc:301] APPLY: starting
0505 20:13:34.965737 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.970482 (+ 4745us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.970516 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.970588 (+ 72us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.970635 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:34.970642 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:34.970721 (+ 79us) log.cc:844] Serialized 29 byte log entry
0505 20:13:34.970800 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.970822 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:34.970829 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:34.970909 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.970913 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":870,"apply.run_cpu_time_us":515,"apply.run_wall_time_us":5171,"num_ops":2,"prepare.queue_time_us":1682,"prepare.run_cpu_time_us":594,"prepare.run_wall_time_us":594,"raft.queue_time_us":1290,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":3,"replication_time_us":9709}]]}
I20260505 20:13:35.752434 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.752993 8053 tablet_bootstrap.cc:654] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:35.752959 7869 leader_election.cc:343] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.754282 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.754339 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 506b421a774c4929813205dba0fac32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:35.754917 7870 leader_election.cc:343] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.755026 7870 leader_election.cc:304] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.755182 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 506b421a774c4929813205dba0fac32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:35.755580 8986 raft_consensus.cc:2749] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.756481 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet 506b421a774c4929813205dba0fac32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.770617 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
W20260505 20:13:35.771857 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 506b421a774c4929813205dba0fac32b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 506b421a774c4929813205dba0fac32b already in progress: creating tablet
W20260505 20:13:35.777547 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 506b421a774c4929813205dba0fac32b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 506b421a774c4929813205dba0fac32b already in progress: creating tablet
W20260505 20:13:35.778234 7413 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d49e4bb0c885499cbe30f86e15f12989 consensus state has no leader
I20260505 20:13:35.778596 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 296494f478244052971e12a09f0b15b4
I20260505 20:13:35.779140 7408 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 59) took 1754 ms. Trace:
I20260505 20:13:35.779243 7408 rpcz_store.cc:276] 0505 20:13:34.024653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.887573 (+862920us) service_pool.cc:224] Handling call
0505 20:13:34.898068 (+ 10495us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9742b06 00007f70d01d7486 00007f70d01d71b5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:34.898418 (+ 350us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:34.898550 (+ 132us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:34.898613 (+ 63us) catalog_manager.cc:2824] Locking tablets
0505 20:13:34.951206 (+ 52593us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:34.965839 (+ 14633us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:34.965932 (+ 93us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:35.778555 (+812623us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:35.779084 (+ 529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:34.953895 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.954032 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.954039 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:34.954041 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:34.954168 (+ 127us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.954183 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.954188 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:34.954302 (+ 114us) tablet.cc:701] Row locks acquired
0505 20:13:34.954304 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:34.954342 (+ 38us) write_op.cc:270] Start()
0505 20:13:34.954375 (+ 33us) write_op.cc:276] Timestamp: P: 1778012014954364 usec, L: 0
0505 20:13:34.954379 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.954562 (+ 183us) log.cc:844] Serialized 728 byte log entry
0505 20:13:34.964736 (+ 10174us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.965099 (+ 363us) write_op.cc:301] APPLY: starting
0505 20:13:34.965117 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.965169 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.965207 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.965284 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.965325 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:34.965334 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:34.965448 (+ 114us) log.cc:844] Serialized 29 byte log entry
0505 20:13:34.965522 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.965542 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:34.965550 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:34.965644 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.965648 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":23511808,"child_traces":[["op",{"apply.queue_time_us":298,"apply.run_cpu_time_us":528,"apply.run_wall_time_us":527,"num_ops":2,"prepare.queue_time_us":1859,"prepare.run_cpu_time_us":755,"prepare.run_wall_time_us":754,"raft.queue_time_us":1889,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":10320}]]}
I20260505 20:13:35.780109 7408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_e668fd82eb274b2fb39e758534ec447c" } new_table_name: "default.Table_04c24f9d92b1443588b27cfe31399508" modify_external_catalogs: true
I20260505 20:13:35.780884 8053 tablet_bootstrap.cc:492] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:35.781013 8053 ts_tablet_manager.cc:1403] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260505 20:13:35.781387 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.781775 8053 raft_consensus.cc:359] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.781939 8053 raft_consensus.cc:385] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:35.781991 8053 raft_consensus.cc:740] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:35.782793 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:35.784159 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 296494f478244052971e12a09f0b15b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296494f478244052971e12a09f0b15b4 already in progress: creating tablet
I20260505 20:13:35.784736 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet cb5cfc700aff4082ae089476e2af044f
W20260505 20:13:35.785303 7737 consensus_peers.cc:597] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:35.785292 7410 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 52) took 1842 ms. Trace:
I20260505 20:13:35.785637 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:35.785382 7410 rpcz_store.cc:276] 0505 20:13:33.942708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.470117 (+527409us) service_pool.cc:224] Handling call
0505 20:13:34.574480 (+104363us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9742b06 00007f70d01d7486 00007f70d01d71b5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:34.574880 (+ 400us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:34.575001 (+ 121us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:34.575059 (+ 58us) catalog_manager.cc:2824] Locking tablets
0505 20:13:34.575232 (+ 173us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:34.835093 (+259861us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:34.835173 (+ 80us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:35.784683 (+949510us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:35.785232 (+ 549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:34.814666 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.814841 (+ 175us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.814850 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:34.814854 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:34.815022 (+ 168us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.815053 (+ 31us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.815061 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:34.815216 (+ 155us) tablet.cc:701] Row locks acquired
0505 20:13:34.815221 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:34.815260 (+ 39us) write_op.cc:270] Start()
0505 20:13:34.815320 (+ 60us) write_op.cc:276] Timestamp: P: 1778012014815433 usec, L: 0
0505 20:13:34.815334 (+ 14us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.815587 (+ 253us) log.cc:844] Serialized 728 byte log entry
0505 20:13:34.834322 (+ 18735us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.834534 (+ 212us) write_op.cc:301] APPLY: starting
0505 20:13:34.834552 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.834599 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.834626 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.834703 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.834752 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:34.834759 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:34.834847 (+ 88us) log.cc:844] Serialized 29 byte log entry
0505 20:13:34.834915 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.834945 (+ 30us) write_op.cc:454] Released schema lock
0505 20:13:34.834952 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:34.836804 (+ 1852us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.836810 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":239468800,"child_traces":[["op",{"apply.queue_time_us":160,"apply.run_cpu_time_us":493,"apply.run_wall_time_us":492,"num_ops":2,"prepare.queue_time_us":238645,"prepare.run_cpu_time_us":1145,"prepare.run_wall_time_us":22142,"raft.queue_time_us":80,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":5704,"replication_time_us":18935}]]}
I20260505 20:13:35.786253 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_0d23b97dd1c642df9051989388e5e654"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:35.786860 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d23b97dd1c642df9051989388e5e654 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:35.787143 8053 consensus_queue.cc:260] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.787694 8053 ts_tablet_manager.cc:1434] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:35.789769 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:35.789847 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.791250 8776 raft_consensus.cc:493] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.791455 8776 raft_consensus.cc:515] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.791538 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:35.792510 7405 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_7fa012f95dc24a889777e593eaa0fd26 [id=d524216fa30845d8b34c5cbb859603b4] alter complete (version 4)
I20260505 20:13:35.792759 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.793434 7596 leader_election.cc:343] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.793735 8986 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.793934 8986 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.794665 8986 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:35.795656 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.796154 7869 leader_election.cc:343] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.796617 8776 leader_election.cc:290] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.798550 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.798756 7929 raft_consensus.cc:2468] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:35.802553 7598 leader_election.cc:304] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.803339 8557 raft_consensus.cc:2804] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260505 20:13:35.803371 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7f34a3f1f30b4165a0c60fab482dce36 consensus state has no leader
I20260505 20:13:35.803449 8557 raft_consensus.cc:493] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.803529 8557 raft_consensus.cc:3060] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:35.803907 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet f2b0dd5d7870453bb1b771405daeb22f consensus state has no leader
W20260505 20:13:35.804716 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 359ab1033ccf4445862867f3f8b78ecd consensus state has no leader
W20260505 20:13:35.805531 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 579bd562fea64fe69db2b4a6085b7bed consensus state has no leader
I20260505 20:13:35.806216 8986 raft_consensus.cc:493] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.806358 8986 raft_consensus.cc:515] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:35.806907 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ab52fb4e7c73420fa58cb6da23372adc consensus state has no leader
I20260505 20:13:35.807013 8986 leader_election.cc:290] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:35.807251 8989 raft_consensus.cc:493] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.807391 8989 raft_consensus.cc:515] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:35.807523 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 76178d1c329b4bf59fe3955f2893cd39 consensus state has no leader
I20260505 20:13:35.807943 8989 leader_election.cc:290] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.808521 8557 raft_consensus.cc:515] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.809234 8557 leader_election.cc:290] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.809443 8557 consensus_queue.cc:1048] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:35.809669 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.809970 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810171 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810348 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810545 7911 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810639 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810576 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810791 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810894 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.810993 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811034 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811205 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811280 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811372 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811458 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811537 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811609 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811726 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.811899 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812050 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812232 7915 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812386 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812515 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812636 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812767 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.812706 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 86c9aaca827442cc8cc605f56c222860 consensus state has no leader
I20260505 20:13:35.812252 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812909 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.813097 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.812395 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.813361 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.814260 8983 raft_consensus.cc:493] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.814404 8983 raft_consensus.cc:515] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:35.815013 8983 leader_election.cc:290] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:35.815264 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.817482 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.817862 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.818042 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.825599 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b9d2b417857347468529868b51ec07ab consensus state has no leader
W20260505 20:13:35.826586 7869 leader_election.cc:343] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.827044 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.827291 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.827490 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.827648 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 with delete_type TABLET_DATA_DELETED (replaced by tablet 369f4a55fdd64e4bb907666bede9f241) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.827642 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 20bdc29641404cee850f27e9c392fbc0 consensus state has no leader
I20260505 20:13:35.829919 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.830610 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.831302 7869 leader_election.cc:343] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.831713 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:35.832341 7596 leader_election.cc:343] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.832585 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.833642 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.834722 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 with delete_type TABLET_DATA_DELETED (replaced by tablet c720fc66db36402a83a7690d70a40353) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.835107 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:35.835440 7930 raft_consensus.cc:2393] T fca1e2a2ea424ffd83bd5260694c1b3e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:35.835572 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 004a8e72cab44d31af3369b8df1e434e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.836385 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3aad2a9f37ac4cbfa127ecceb132c8bb consensus state has no leader
W20260505 20:13:35.839229 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 65003660c44547cc8674baeca370e395 consensus state has no leader
I20260505 20:13:35.839593 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.839813 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.840034 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c8754580368453aa0aae021d8c665da with delete_type TABLET_DATA_DELETED (replaced by tablet 59f5348c229744ab98f0de3da40de6c5) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.840246 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 880cbba188144dd795873186f8cda1e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c20374c4df742799110a12f3fea5daa) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.840552 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee with delete_type TABLET_DATA_DELETED (replaced by tablet a114db19f63346d9a67e9e3a8225caa4) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.841224 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 089517a7c2214dce9367b21beb555733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.841701 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.842489 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 19720f3a29f34515a952e50f4fec9f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.843362 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet d3cd1b7b0456462a80d653dd442589a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.843570 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 506b421a774c4929813205dba0fac32b consensus state has no leader
W20260505 20:13:35.845547 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 43a3e9d404f14b43ae99c4a905f50086 consensus state has no leader
I20260505 20:13:35.845819 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f1505e592e543cca92d8949bdae007e with delete_type TABLET_DATA_DELETED (replaced by tablet 5b3595eb9b1144d9b802f1f563d01461) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.846009 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bdfc75a494635837178cb16c08c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.846963 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.847998 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.849292 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.853309 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 50122.8us
I20260505 20:13:35.858224 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:35.858517 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c278b516135b47ee96ed61b1ae595f9a consensus state has no leader
I20260505 20:13:35.859225 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.859319 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.859664 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:35.860108 7930 raft_consensus.cc:3060] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.860503 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.861896 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.862162 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.862831 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.863692 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.863811 8557 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.864094 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.864383 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.863965 8557 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.864640 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.865044 8557 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.866071 7657 raft_consensus.cc:2468] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:35.866395 7870 leader_election.cc:343] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.866506 7870 leader_election.cc:304] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.866868 8983 raft_consensus.cc:2749] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:35.867190 7870 leader_election.cc:343] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.867314 7870 leader_election.cc:304] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:35.867669 8983 raft_consensus.cc:2749] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:35.868410 7870 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:35.868817 8983 raft_consensus.cc:2804] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.868899 8983 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.868981 8983 raft_consensus.cc:3060] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.872381 8983 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.873059 8983 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:35.865257 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 997f2f9cf76a4311ab233cb7d8bc8e3c consensus state has no leader
I20260505 20:13:35.873786 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:35.873956 7657 raft_consensus.cc:3060] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.874034 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:35.874559 7596 leader_election.cc:343] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:35.877107 7657 raft_consensus.cc:2468] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:35.877599 7870 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.877890 8986 raft_consensus.cc:2804] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.878022 8986 raft_consensus.cc:697] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:35.878269 8986 consensus_queue.cc:237] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:35.879040 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 010c399e14624550bf02ea248d653538 consensus state has no leader
W20260505 20:13:35.885800 7404 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ae8bd19470294a1db91855afe49be6a5 consensus state has no leader
W20260505 20:13:35.889358 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet cb5cfc700aff4082ae089476e2af044f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb5cfc700aff4082ae089476e2af044f already in progress: creating tablet
I20260505 20:13:35.889827 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.895375 7930 raft_consensus.cc:2468] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.915863 8776 raft_consensus.cc:493] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.916090 8776 raft_consensus.cc:515] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.916663 7412 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_f7d224c9388348eb8d42b645b0813213 [id=cc685c3c73114d9a8ec2533202346623] alter complete (version 2)
I20260505 20:13:35.916826 8776 leader_election.cc:290] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.917866 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bdc29641404cee850f27e9c392fbc0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:35.918092 7802 raft_consensus.cc:2468] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
W20260505 20:13:35.919127 7404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 280) took 2440 ms (client timeout 1000 ms). Trace:
W20260505 20:13:35.920205 7404 rpcz_store.cc:269] 0505 20:13:33.477410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:33.510567 (+ 33157us) service_pool.cc:224] Handling call
0505 20:13:33.580160 (+ 69593us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:35.917706 (+2337546us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3746,"reported_tablets":170,"spinlock_wait_cycles":152521600}
I20260505 20:13:35.923725 8718 raft_consensus.cc:493] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.923842 7596 leader_election.cc:304] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.923986 8718 raft_consensus.cc:515] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.924204 8776 raft_consensus.cc:2804] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:35.924286 8776 raft_consensus.cc:493] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:35.924360 8776 raft_consensus.cc:3060] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.925000 8718 leader_election.cc:290] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.928334 8776 raft_consensus.cc:515] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.930063 8776 leader_election.cc:290] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:35.932260 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1e2a2ea424ffd83bd5260694c1b3e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.935989 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bdc29641404cee850f27e9c392fbc0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:35.936298 7795 raft_consensus.cc:3060] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:35.939847 7795 raft_consensus.cc:2468] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:35.941125 7596 leader_election.cc:304] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:35.941363 8926 raft_consensus.cc:2804] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:35.941483 8926 raft_consensus.cc:697] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:35.941797 8926 consensus_queue.cc:237] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.959121 7413 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 60) took 1375 ms. Trace:
I20260505 20:13:35.959367 7413 rpcz_store.cc:276] 0505 20:13:34.583230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.915878 (+332648us) service_pool.cc:224] Handling call
0505 20:13:34.916483 (+ 605us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:34.916824 (+ 341us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:34.917132 (+ 308us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:34.917215 (+ 83us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:34.929582 (+ 12367us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:35.959038 (+1029456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:34.919662 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.919815 (+ 153us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.919820 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:34.919822 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:34.919906 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.919914 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.919918 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:34.919982 (+ 64us) tablet.cc:701] Row locks acquired
0505 20:13:34.919985 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:34.920018 (+ 33us) write_op.cc:270] Start()
0505 20:13:34.920047 (+ 29us) write_op.cc:276] Timestamp: P: 1778012014920025 usec, L: 0
0505 20:13:34.920050 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.920189 (+ 139us) log.cc:844] Serialized 405 byte log entry
0505 20:13:34.927843 (+ 7654us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.928313 (+ 470us) write_op.cc:301] APPLY: starting
0505 20:13:34.928331 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.928366 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.928399 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.928450 (+ 51us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.928478 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:34.928486 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:34.928554 (+ 68us) log.cc:844] Serialized 23 byte log entry
0505 20:13:34.928598 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.928615 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:34.928620 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:34.928705 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.928710 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":414,"apply.run_cpu_time_us":389,"apply.run_wall_time_us":389,"num_ops":1,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":593,"prepare.run_wall_time_us":592,"replication_time_us":7776}]]}
I20260505 20:13:35.961325 7413 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_833aef6a6ffc466c8f56b9bee24bf1a2" } new_table_name: "default.Table_af2341b021674fe494cd635374e98c3e" modify_external_catalogs: true
I20260505 20:13:35.963443 9028 raft_consensus.cc:493] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:35.963371 9142 tablet.cc:1724] T a46c981a27ac4527a40d49714356185e P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:35.963605 9028 raft_consensus.cc:515] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.964254 9028 leader_election.cc:290] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:35.965097 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 296494f478244052971e12a09f0b15b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296494f478244052971e12a09f0b15b4 already in progress: creating tablet
W20260505 20:13:35.969020 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet cb5cfc700aff4082ae089476e2af044f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb5cfc700aff4082ae089476e2af044f already in progress: creating tablet
I20260505 20:13:35.971628 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880cbba188144dd795873186f8cda1e9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:35.971812 7662 raft_consensus.cc:2468] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:35.905081 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.905865 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.906026 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.918697 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.998229 8053 tablet_bootstrap.cc:492] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.000174 8053 tablet_bootstrap.cc:654] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.013054 8989 raft_consensus.cc:493] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.013303 8989 raft_consensus.cc:515] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:36.013622 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 50300.5us
I20260505 20:13:36.014041 8989 leader_election.cc:290] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.014411 8053 tablet_bootstrap.cc:492] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.014549 8053 ts_tablet_manager.cc:1403] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.009s
I20260505 20:13:36.015345 8053 raft_consensus.cc:359] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.015545 8053 raft_consensus.cc:385] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.015599 8053 raft_consensus.cc:740] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.015823 8053 consensus_queue.cc:260] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.016445 8053 ts_tablet_manager.cc:1434] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:36.016744 8053 tablet_bootstrap.cc:492] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.018496 8053 tablet_bootstrap.cc:654] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:35.963707 9121 tablet_replica.cc:333] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:35.966733 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.967308 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 7766caea43904162a2c289b7b17405d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.967446 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e650b297603425184ad97ddf99ec36d with delete_type TABLET_DATA_DELETED (replaced by tablet f0ca8cc557674992b88f3379cc1db652) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:36.020301 9121 raft_consensus.cc:2243] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:36.020552 9121 raft_consensus.cc:2272] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:36.021335 9121 ts_tablet_manager.cc:1916] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:36.024506 8053 tablet_bootstrap.cc:492] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.024675 8053 ts_tablet_manager.cc:1403] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260505 20:13:36.025668 8053 raft_consensus.cc:359] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.025910 8053 raft_consensus.cc:385] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.025991 8053 raft_consensus.cc:740] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.026250 8053 consensus_queue.cc:260] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:35.967500 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.968614 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:35.970975 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.026827 8053 ts_tablet_manager.cc:1434] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:35.984163 8983 raft_consensus.cc:493] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.027158 8053 tablet_bootstrap.cc:492] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.027326 8983 raft_consensus.cc:515] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.028342 8983 leader_election.cc:290] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:36.029139 8053 tablet_bootstrap.cc:654] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.029201 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29fd054d41e4c48ab0da8dec2b952d5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.029867 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880cbba188144dd795873186f8cda1e9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.030098 7801 raft_consensus.cc:2468] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.030790 9142 tablet.cc:1724] T 944bc61fe79c4f94bb280dae8e3cee59 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:36.039083 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bdc29641404cee850f27e9c392fbc0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.039335 7933 raft_consensus.cc:2468] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.040467 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bdc29641404cee850f27e9c392fbc0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.040650 7933 raft_consensus.cc:3060] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.043962 7933 raft_consensus.cc:2468] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.044836 8053 tablet_bootstrap.cc:492] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.044986 8053 ts_tablet_manager.cc:1403] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.006s
W20260505 20:13:36.045881 7870 leader_election.cc:343] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.046394 7596 leader_election.cc:304] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.047292 8776 raft_consensus.cc:2804] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.047313 8053 raft_consensus.cc:359] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.047489 8053 raft_consensus.cc:385] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.047443 8776 raft_consensus.cc:493] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.047549 8053 raft_consensus.cc:740] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.047640 8776 raft_consensus.cc:3060] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.047763 8053 consensus_queue.cc:260] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.048267 8053 ts_tablet_manager.cc:1434] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:36.048560 8053 tablet_bootstrap.cc:492] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.050063 8693 consensus_queue.cc:1048] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.050239 8053 tablet_bootstrap.cc:654] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.050616 8693 consensus_queue.cc:1048] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.070663 8983 raft_consensus.cc:493] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.070935 8983 raft_consensus.cc:515] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.071367 9047 raft_consensus.cc:493] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.071563 9047 raft_consensus.cc:515] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.071827 8983 leader_election.cc:290] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:36.072386 9047 leader_election.cc:290] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.077834 8053 tablet_bootstrap.cc:492] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.077996 8053 ts_tablet_manager.cc:1403] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.003s
I20260505 20:13:36.078811 8053 raft_consensus.cc:359] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.079011 8053 raft_consensus.cc:385] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.079068 8053 raft_consensus.cc:740] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.079272 8053 consensus_queue.cc:260] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.079798 8053 ts_tablet_manager.cc:1434] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:36.079784 9144 tablet.cc:1724] T a46c981a27ac4527a40d49714356185e P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.080120 8053 tablet_bootstrap.cc:492] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.081858 8053 tablet_bootstrap.cc:654] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.084044 9140 tablet.cc:1724] T 944bc61fe79c4f94bb280dae8e3cee59 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:36.085943 7736 leader_election.cc:304] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.086623 8989 raft_consensus.cc:3060] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.087204 7598 leader_election.cc:304] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.088905 8557 raft_consensus.cc:493] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.089035 8557 raft_consensus.cc:515] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.089229 8989 raft_consensus.cc:2749] T fca1e2a2ea424ffd83bd5260694c1b3e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.089658 8557 leader_election.cc:290] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.090304 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:36.090535 8557 raft_consensus.cc:2804] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.090692 8557 raft_consensus.cc:697] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.090992 8557 consensus_queue.cc:237] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:36.094462 7869 leader_election.cc:343] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.095471 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.095757 7929 raft_consensus.cc:2393] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:36.098198 9151 raft_consensus.cc:493] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.098387 9151 raft_consensus.cc:515] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.098963 9151 leader_election.cc:290] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.099794 8058 tablet_bootstrap.cc:492] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.099967 8058 ts_tablet_manager.cc:1403] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.401s user 0.012s sys 0.007s
I20260505 20:13:36.100781 8058 raft_consensus.cc:359] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.101003 8058 raft_consensus.cc:385] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.101087 8058 raft_consensus.cc:740] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.101290 8058 consensus_queue.cc:260] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.101814 8058 ts_tablet_manager.cc:1434] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.102124 8058 tablet_bootstrap.cc:492] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:36.106663 7737 leader_election.cc:343] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9
I20260505 20:13:36.107319 8983 raft_consensus.cc:493] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.107622 8983 raft_consensus.cc:515] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.108203 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29fd054d41e4c48ab0da8dec2b952d5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.108708 8983 leader_election.cc:290] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:36.108701 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.108872 8983 raft_consensus.cc:493] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.108973 8983 raft_consensus.cc:515] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.110239 8983 leader_election.cc:290] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:36.110463 9142 tablet.cc:1724] T 01e800dfb0354beab9c835cbed9dceb4 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:36.113982 8776 raft_consensus.cc:515] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.114668 8776 leader_election.cc:290] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:36.123521 7869 leader_election.cc:343] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.123750 7869 leader_election.cc:304] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:36.124178 7869 leader_election.cc:343] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.125000 8639 raft_consensus.cc:2749] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:36.126174 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 79278.7us
I20260505 20:13:36.126791 8054 tablet_bootstrap.cc:492] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.126950 8054 ts_tablet_manager.cc:1403] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.405s user 0.092s sys 0.096s
I20260505 20:13:36.127837 8054 raft_consensus.cc:359] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.128010 8054 raft_consensus.cc:385] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.127969 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fc0e6ac0fa4f8bbaef2fcf1ecbbd70" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.128067 8054 raft_consensus.cc:740] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.128316 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.128305 8054 consensus_queue.cc:260] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.128798 8054 ts_tablet_manager.cc:1434] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260505 20:13:36.128942 7870 leader_election.cc:343] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.129145 8054 tablet_bootstrap.cc:492] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.129588 9150 raft_consensus.cc:493] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.129699 9150 raft_consensus.cc:515] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.130331 9150 leader_election.cc:290] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:36.130648 7870 leader_election.cc:343] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.131129 8054 tablet_bootstrap.cc:654] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.133426 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:36.139166 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 52007.3us
I20260505 20:13:36.139523 7598 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.140588 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e650b297603425184ad97ddf99ec36d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.140832 7799 raft_consensus.cc:2468] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.141084 8693 raft_consensus.cc:493] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.141268 8693 raft_consensus.cc:515] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.141913 8693 leader_election.cc:290] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.142115 8693 raft_consensus.cc:2749] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.142413 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.142586 7797 raft_consensus.cc:2468] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.143545 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880cbba188144dd795873186f8cda1e9" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.143692 7797 raft_consensus.cc:3060] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.146427 7797 raft_consensus.cc:2468] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.146857 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.147127 7935 raft_consensus.cc:2468] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.152057 8058 tablet_bootstrap.cc:654] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.153498 9144 tablet.cc:1724] T 47720452d3f44e18b16a06ae296b4c51 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.156793 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fc0e6ac0fa4f8bbaef2fcf1ecbbd70" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.157051 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:36.160828 7870 leader_election.cc:343] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.160964 7870 leader_election.cc:304] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:36.164067 7598 leader_election.cc:343] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9
I20260505 20:13:36.165580 7736 leader_election.cc:304] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:36.166431 9047 raft_consensus.cc:2764] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260505 20:13:36.170815 9165 tablet.cc:1724] T 6166653cbc58470c8ba4926048ba1384 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:36.171756 9142 tablet.cc:1724] T 034852d91c26434f8a3c7fd8100c49ac P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.186865 7410 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 65) took 1507 ms. Trace:
I20260505 20:13:36.187090 7410 rpcz_store.cc:276] 0505 20:13:34.679525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.786038 (+1106513us) service_pool.cc:224] Handling call
0505 20:13:36.175909 (+389871us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:36.176455 (+ 546us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:36.186462 (+ 10007us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.186469 (+ 7us) write_op.cc:454] Released schema lock
0505 20:13:36.186552 (+ 83us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:36.186685 (+ 133us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:36.186801 (+ 116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:36.177097 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:36.177221 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:36.177227 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:36.177229 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:36.177330 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:36.177344 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:36.177349 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:36.177436 (+ 87us) tablet.cc:701] Row locks acquired
0505 20:13:36.177438 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:36.177472 (+ 34us) write_op.cc:270] Start()
0505 20:13:36.177503 (+ 31us) write_op.cc:276] Timestamp: P: 1778012016177569 usec, L: 0
0505 20:13:36.177507 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:36.177668 (+ 161us) log.cc:844] Serialized 433 byte log entry
0505 20:13:36.181572 (+ 3904us) op_driver.cc:464] REPLICATION: finished
0505 20:13:36.181709 (+ 137us) write_op.cc:301] APPLY: starting
0505 20:13:36.181727 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:36.181803 (+ 76us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:36.181830 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:36.181950 (+ 120us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:36.181986 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:36.181994 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:36.182096 (+ 102us) log.cc:844] Serialized 29 byte log entry
0505 20:13:36.182158 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.182179 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:36.182186 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":534,"apply.run_wall_time_us":534,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":686,"prepare.run_wall_time_us":686,"raft.queue_time_us":514,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":300,"replication_time_us":4031}]]}
I20260505 20:13:36.194823 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54becbd4690c403e803a7a79f12cb6d5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.195602 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.195896 7657 raft_consensus.cc:2468] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.197324 8053 tablet_bootstrap.cc:492] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.197468 8053 ts_tablet_manager.cc:1403] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.117s user 0.006s sys 0.036s
I20260505 20:13:36.198233 8053 raft_consensus.cc:359] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.198966 8053 raft_consensus.cc:385] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.199064 8053 raft_consensus.cc:740] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.199033 7736 leader_election.cc:304] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.199273 8053 consensus_queue.cc:260] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.199425 9140 tablet.cc:1724] T 034852d91c26434f8a3c7fd8100c49ac P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.199862 9047 raft_consensus.cc:2804] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.199950 9047 raft_consensus.cc:493] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.200014 9047 raft_consensus.cc:3060] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.200052 8053 ts_tablet_manager.cc:1434] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:36.203488 8053 tablet_bootstrap.cc:492] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.205526 8053 tablet_bootstrap.cc:654] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.228564 8983 raft_consensus.cc:2749] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:36.227619 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 66829us
I20260505 20:13:36.231106 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.231340 7929 raft_consensus.cc:2468] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.237991 8054 tablet_bootstrap.cc:492] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.238152 8054 ts_tablet_manager.cc:1403] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.109s user 0.018s sys 0.022s
I20260505 20:13:36.238672 9142 tablet.cc:1724] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:36.240423 7737 leader_election.cc:304] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.241499 8989 raft_consensus.cc:3060] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.241958 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aad2a9f37ac4cbfa127ecceb132c8bb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.242156 7933 raft_consensus.cc:2468] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.242802 7596 leader_election.cc:304] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.243389 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.243376 7596 leader_election.cc:304] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.243635 7929 raft_consensus.cc:2468] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.243811 9151 raft_consensus.cc:2804] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.243944 9151 raft_consensus.cc:493] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.244072 9151 raft_consensus.cc:3060] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.246683 9028 raft_consensus.cc:2804] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.246868 9028 raft_consensus.cc:493] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.247014 9028 raft_consensus.cc:3060] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.248163 7596 leader_election.cc:304] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.248665 9156 raft_consensus.cc:2804] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.248889 9156 raft_consensus.cc:697] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.249285 9156 consensus_queue.cc:237] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:36.250120 7869 leader_election.cc:343] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.250471 7869 leader_election.cc:304] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.253432 8639 raft_consensus.cc:2749] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.253487 8058 tablet_bootstrap.cc:492] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.253603 8058 ts_tablet_manager.cc:1403] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.152s user 0.003s sys 0.000s
W20260505 20:13:36.254366 7869 leader_election.cc:343] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.254556 7869 leader_election.cc:304] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.254806 8639 raft_consensus.cc:2749] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.260192 8058 raft_consensus.cc:359] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.260421 8058 raft_consensus.cc:385] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.260473 8058 raft_consensus.cc:740] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.260672 8058 consensus_queue.cc:260] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.257108 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e650b297603425184ad97ddf99ec36d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.261242 8058 ts_tablet_manager.cc:1434] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260505 20:13:36.261546 8058 tablet_bootstrap.cc:492] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.263574 7936 raft_consensus.cc:2468] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.264432 9166 tablet.cc:1724] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:36.267745 9169 tablet.cc:1724] T 01e800dfb0354beab9c835cbed9dceb4 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:36.270315 8058 tablet_bootstrap.cc:654] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.277361 8058 tablet_bootstrap.cc:492] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.277526 8058 ts_tablet_manager.cc:1403] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260505 20:13:36.279057 9047 raft_consensus.cc:515] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.279914 9047 leader_election.cc:290] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.283389 8989 raft_consensus.cc:2749] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.284246 9151 raft_consensus.cc:515] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.286722 9140 tablet.cc:1724] T 01e800dfb0354beab9c835cbed9dceb4 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:36.288435 9121 ts_tablet_manager.cc:1929] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:36.288574 9121 log.cc:1199] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/506b421a774c4929813205dba0fac32b
I20260505 20:13:36.289022 9121 ts_tablet_manager.cc:1950] T 506b421a774c4929813205dba0fac32b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:36.289122 8054 raft_consensus.cc:359] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.289362 8054 raft_consensus.cc:385] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.289471 8054 raft_consensus.cc:740] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.289785 8054 consensus_queue.cc:260] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.290438 8054 ts_tablet_manager.cc:1434] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.052s user 0.001s sys 0.001s
I20260505 20:13:36.290930 9151 leader_election.cc:290] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.291064 8054 tablet_bootstrap.cc:492] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.292894 8054 tablet_bootstrap.cc:654] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.301702 8058 raft_consensus.cc:359] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.303943 8058 raft_consensus.cc:385] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.304960 9151 raft_consensus.cc:493] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.307770 8058 raft_consensus.cc:740] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.307837 9151 raft_consensus.cc:515] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.308138 8058 consensus_queue.cc:260] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.308486 9151 leader_election.cc:290] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.306149 8776 consensus_queue.cc:1048] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.309204 8058 ts_tablet_manager.cc:1434] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.032s user 0.000s sys 0.003s
I20260505 20:13:36.309486 8058 tablet_bootstrap.cc:492] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.309410 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e650b297603425184ad97ddf99ec36d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.309712 7931 raft_consensus.cc:3060] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.311239 8058 tablet_bootstrap.cc:654] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.313355 8054 tablet_bootstrap.cc:492] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.313547 8054 ts_tablet_manager.cc:1403] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.011s
I20260505 20:13:36.315011 8054 raft_consensus.cc:359] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.315227 8054 raft_consensus.cc:385] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.315328 8054 raft_consensus.cc:740] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.315580 8054 consensus_queue.cc:260] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.316221 8054 ts_tablet_manager.cc:1434] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:36.316586 8054 tablet_bootstrap.cc:492] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.318312 8054 tablet_bootstrap.cc:654] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.324007 8058 tablet_bootstrap.cc:492] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.324162 8058 ts_tablet_manager.cc:1403] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.002s
I20260505 20:13:36.324908 8058 raft_consensus.cc:359] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.325088 8058 raft_consensus.cc:385] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.325140 8058 raft_consensus.cc:740] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.326447 8054 tablet_bootstrap.cc:492] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.326668 8054 ts_tablet_manager.cc:1403] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260505 20:13:36.326862 8058 consensus_queue.cc:260] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.327521 8054 raft_consensus.cc:359] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.327761 8054 raft_consensus.cc:385] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.327850 8054 raft_consensus.cc:740] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.328030 8058 ts_tablet_manager.cc:1434] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:36.328150 8054 consensus_queue.cc:260] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.328685 8054 ts_tablet_manager.cc:1434] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:36.329034 8058 tablet_bootstrap.cc:492] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.329061 8054 tablet_bootstrap.cc:492] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.330742 8058 tablet_bootstrap.cc:654] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.330946 8054 tablet_bootstrap.cc:654] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:36.306381 7598 leader_election.cc:343] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9
I20260505 20:13:36.338804 8776 consensus_queue.cc:1048] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.339214 8054 tablet_bootstrap.cc:492] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.339365 8058 tablet_bootstrap.cc:492] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.339367 8054 ts_tablet_manager.cc:1403] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260505 20:13:36.339480 8058 ts_tablet_manager.cc:1403] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260505 20:13:36.340152 7598 leader_election.cc:304] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.340551 8776 raft_consensus.cc:2804] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.340624 8776 raft_consensus.cc:493] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.340679 8776 raft_consensus.cc:3060] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.340911 8058 raft_consensus.cc:359] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.341053 7598 leader_election.cc:304] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.341459 9161 raft_consensus.cc:2804] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.341539 9161 raft_consensus.cc:493] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.341615 9161 raft_consensus.cc:3060] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.342909 9151 consensus_queue.cc:1048] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.341081 8058 raft_consensus.cc:385] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.343770 8058 raft_consensus.cc:740] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.344213 8058 consensus_queue.cc:260] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.344696 8058 ts_tablet_manager.cc:1434] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260505 20:13:36.345026 8058 tablet_bootstrap.cc:492] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.346244 9151 consensus_queue.cc:1048] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.346794 8058 tablet_bootstrap.cc:654] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.354815 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.357064 8058 tablet_bootstrap.cc:492] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.357724 9142 tablet.cc:1724] T 47720452d3f44e18b16a06ae296b4c51 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.358126 8058 ts_tablet_manager.cc:1403] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260505 20:13:36.359799 8058 raft_consensus.cc:359] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.360018 8058 raft_consensus.cc:385] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.360080 8058 raft_consensus.cc:740] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.363520 9176 tablet.cc:1724] T 944bc61fe79c4f94bb280dae8e3cee59 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:36.363219 8058 consensus_queue.cc:260] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.366242 8058 ts_tablet_manager.cc:1434] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:36.366619 8058 tablet_bootstrap.cc:492] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.367036 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aad2a9f37ac4cbfa127ecceb132c8bb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.367260 7800 raft_consensus.cc:2468] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.369005 8058 tablet_bootstrap.cc:654] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.373872 8989 raft_consensus.cc:493] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.374012 8989 raft_consensus.cc:515] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.374607 8989 leader_election.cc:290] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.379223 9028 raft_consensus.cc:515] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.379957 9028 leader_election.cc:290] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.382051 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e650b297603425184ad97ddf99ec36d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.382234 7801 raft_consensus.cc:3060] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.384472 8776 raft_consensus.cc:515] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.384850 7801 raft_consensus.cc:2468] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.386018 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ddf95d810c4c80a5f78c1b7600cee4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.386251 7801 raft_consensus.cc:2468] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.387591 9161 raft_consensus.cc:515] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.388301 9161 leader_election.cc:290] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.388922 8776 leader_election.cc:290] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.391088 8058 tablet_bootstrap.cc:492] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.391283 8058 ts_tablet_manager.cc:1403] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.005s
I20260505 20:13:36.392087 8058 raft_consensus.cc:359] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.392314 8058 raft_consensus.cc:385] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.392436 8058 raft_consensus.cc:740] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.392729 8058 consensus_queue.cc:260] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.393451 8058 ts_tablet_manager.cc:1434] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:36.393796 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.393918 8058 tablet_bootstrap.cc:492] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.394102 7801 raft_consensus.cc:2393] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:36.395247 9169 tablet.cc:1724] T a46c981a27ac4527a40d49714356185e P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.395733 8058 tablet_bootstrap.cc:654] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.405134 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.405241 8776 raft_consensus.cc:493] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.405421 8776 raft_consensus.cc:515] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.405682 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aad2a9f37ac4cbfa127ecceb132c8bb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.405894 7799 raft_consensus.cc:3060] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.406123 8776 leader_election.cc:290] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.409803 7931 raft_consensus.cc:2468] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.411212 8058 tablet_bootstrap.cc:492] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.411396 8058 ts_tablet_manager.cc:1403] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
I20260505 20:13:36.412170 8058 raft_consensus.cc:359] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.412391 8058 raft_consensus.cc:385] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.412473 8058 raft_consensus.cc:740] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.412719 8058 consensus_queue.cc:260] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.413318 8058 ts_tablet_manager.cc:1434] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.413630 8058 tablet_bootstrap.cc:492] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.416071 8058 tablet_bootstrap.cc:654] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:36.422889 7596 leader_election.cc:343] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.424329 9028 consensus_queue.cc:1048] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.425385 7596 leader_election.cc:304] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.425801 7596 leader_election.cc:304] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.426232 9161 consensus_queue.cc:1048] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.426669 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:36.426779 8776 consensus_queue.cc:1048] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.426956 7658 raft_consensus.cc:2393] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:36.427460 8776 raft_consensus.cc:2804] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.427618 8776 raft_consensus.cc:697] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.427893 8776 consensus_queue.cc:237] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.428871 7932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aad2a9f37ac4cbfa127ecceb132c8bb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.429047 9156 raft_consensus.cc:2804] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.429065 7932 raft_consensus.cc:3060] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.429168 9156 raft_consensus.cc:493] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.429267 9156 raft_consensus.cc:3060] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.430119 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.430136 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096ca710e3564d4b8db50f29dd56a5d4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.430271 7929 raft_consensus.cc:3060] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.430326 7662 raft_consensus.cc:2468] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.426690 9161 consensus_queue.cc:1048] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260505 20:13:36.432651 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.432812 7933 raft_consensus.cc:3060] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.433136 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d411638715f747469f9f3dc490c0257c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.433272 7926 raft_consensus.cc:2468] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.435997 8053 tablet_bootstrap.cc:492] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.436164 8053 ts_tablet_manager.cc:1403] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.233s user 0.066s sys 0.082s
I20260505 20:13:36.436932 8053 raft_consensus.cc:359] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.437105 8053 raft_consensus.cc:385] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.437160 8053 raft_consensus.cc:740] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.437345 8053 consensus_queue.cc:260] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.437848 8053 ts_tablet_manager.cc:1434] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:36.438145 8053 tablet_bootstrap.cc:492] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.439761 8053 tablet_bootstrap.cc:654] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.450116 8058 tablet_bootstrap.cc:492] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.450070 9175 tablet.cc:1724] T 47720452d3f44e18b16a06ae296b4c51 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.450315 8058 ts_tablet_manager.cc:1403] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.003s
I20260505 20:13:36.450714 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d411638715f747469f9f3dc490c0257c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.450812 7736 leader_election.cc:304] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.451294 9138 raft_consensus.cc:2804] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.451373 9138 raft_consensus.cc:493] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.451433 9138 raft_consensus.cc:3060] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.451675 8058 raft_consensus.cc:359] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.451836 7598 leader_election.cc:304] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:36.452135 7598 leader_election.cc:343] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:36.452220 9150 raft_consensus.cc:2804] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.452389 9150 raft_consensus.cc:493] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.452548 9150 raft_consensus.cc:3060] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.452895 8058 raft_consensus.cc:385] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.453038 9028 consensus_queue.cc:1048] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.453145 8058 raft_consensus.cc:740] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.453498 8058 consensus_queue.cc:260] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.454227 8058 ts_tablet_manager.cc:1434] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260505 20:13:36.454567 8058 tablet_bootstrap.cc:492] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.456734 8058 tablet_bootstrap.cc:654] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:36.464594 7596 leader_election.cc:343] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.467185 8058 tablet_bootstrap.cc:492] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.467461 8058 ts_tablet_manager.cc:1403] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260505 20:13:36.468549 8058 raft_consensus.cc:359] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.470139 8053 tablet_bootstrap.cc:492] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.470283 8053 ts_tablet_manager.cc:1403] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260505 20:13:36.472865 8053 raft_consensus.cc:359] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.473106 8053 raft_consensus.cc:385] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.473177 8053 raft_consensus.cc:740] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.473446 8053 consensus_queue.cc:260] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.474021 8053 ts_tablet_manager.cc:1434] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260505 20:13:36.474319 8053 tablet_bootstrap.cc:492] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.476529 8053 tablet_bootstrap.cc:654] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.480345 8058 raft_consensus.cc:385] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.480504 8058 raft_consensus.cc:740] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.480664 8776 raft_consensus.cc:493] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.480867 8058 consensus_queue.cc:260] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.480964 8776 raft_consensus.cc:515] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:36.481508 7596 leader_election.cc:343] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.482854 7932 raft_consensus.cc:2468] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.483556 7929 raft_consensus.cc:2468] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.486084 7933 raft_consensus.cc:2468] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.487300 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.497232 7799 raft_consensus.cc:2468] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.500214 8053 tablet_bootstrap.cc:492] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.500367 8053 ts_tablet_manager.cc:1403] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.001s
I20260505 20:13:36.501569 8054 raft_consensus.cc:359] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.501809 8054 raft_consensus.cc:385] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.501873 8054 raft_consensus.cc:740] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.502079 8054 consensus_queue.cc:260] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.502614 8054 ts_tablet_manager.cc:1434] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.163s user 0.003s sys 0.000s
I20260505 20:13:36.502892 8054 tablet_bootstrap.cc:492] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.504417 8054 tablet_bootstrap.cc:654] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.506559 9121 tablet_replica.cc:333] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:36.506753 9121 raft_consensus.cc:2243] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:36.507009 9121 raft_consensus.cc:2272] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:36.507259 8639 raft_consensus.cc:493] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.507369 8639 raft_consensus.cc:515] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.507514 9121 ts_tablet_manager.cc:1916] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:36.507840 8639 leader_election.cc:290] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:36.513113 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:36.513847 8776 leader_election.cc:290] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.515242 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.515479 7933 raft_consensus.cc:2468] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.501170 8053 raft_consensus.cc:359] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.516398 8053 raft_consensus.cc:385] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.516472 8053 raft_consensus.cc:740] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.518431 8053 consensus_queue.cc:260] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.519057 8053 ts_tablet_manager.cc:1434] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260505 20:13:36.519356 8053 tablet_bootstrap.cc:492] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.526912 8053 tablet_bootstrap.cc:654] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:36.529846 7596 leader_election.cc:343] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:36.529927 7399 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f2b0dd5d7870453bb1b771405daeb22f consensus state has no leader
I20260505 20:13:36.536710 9156 raft_consensus.cc:515] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.537572 7598 leader_election.cc:304] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.540225 8058 ts_tablet_manager.cc:1434] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.024s user 0.001s sys 0.002s
I20260505 20:13:36.542613 8053 tablet_bootstrap.cc:492] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.542771 8053 ts_tablet_manager.cc:1403] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.003s
I20260505 20:13:36.543321 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ddf95d810c4c80a5f78c1b7600cee4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.543489 7799 raft_consensus.cc:3060] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.543551 7801 raft_consensus.cc:3060] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.546058 8053 raft_consensus.cc:359] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.546252 8053 raft_consensus.cc:385] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.546304 8053 raft_consensus.cc:740] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.547772 8557 raft_consensus.cc:2804] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.547802 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:36.548672 7870 leader_election.cc:343] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.548959 8053 consensus_queue.cc:260] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.549160 8557 raft_consensus.cc:697] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.549202 9156 leader_election.cc:290] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.550338 8053 ts_tablet_manager.cc:1434] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:36.550653 8053 tablet_bootstrap.cc:492] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.553534 8983 raft_consensus.cc:493] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.553709 8983 raft_consensus.cc:515] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.554479 8983 leader_election.cc:290] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:36.556164 8053 tablet_bootstrap.cc:654] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:36.564554 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 61424.1us
I20260505 20:13:36.566560 9166 tablet.cc:1724] T 034852d91c26434f8a3c7fd8100c49ac P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:36.567412 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e190c973c984ec080178efa39b2def0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.567615 7929 raft_consensus.cc:2393] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:36.570437 8557 consensus_queue.cc:237] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.571167 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bdfc75a494635837178cb16c08c1c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.571580 8058 tablet_bootstrap.cc:492] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.573980 8058 tablet_bootstrap.cc:654] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.574810 9150 raft_consensus.cc:515] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.575537 9150 leader_election.cc:290] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.581681 9138 raft_consensus.cc:515] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.581847 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:36.582343 9138 leader_election.cc:290] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:36.582749 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 296494f478244052971e12a09f0b15b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296494f478244052971e12a09f0b15b4 already in progress: creating tablet
W20260505 20:13:36.583134 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet cb5cfc700aff4082ae089476e2af044f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb5cfc700aff4082ae089476e2af044f already in progress: creating tablet
I20260505 20:13:36.583719 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.586863 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bdfc75a494635837178cb16c08c1c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.587321 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:36.587692 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:36.588054 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:36.588205 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
W20260505 20:13:36.588172 7870 leader_election.cc:343] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.589546 8054 tablet_bootstrap.cc:492] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.589704 8054 ts_tablet_manager.cc:1403] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.087s user 0.001s sys 0.017s
I20260505 20:13:36.590487 8054 raft_consensus.cc:359] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.590662 8054 raft_consensus.cc:385] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.590719 8054 raft_consensus.cc:740] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.591004 7598 leader_election.cc:304] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.591150 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
W20260505 20:13:36.591385 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 53423.5us
I20260505 20:13:36.591460 8053 tablet_bootstrap.cc:492] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.591537 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:36.591589 8053 ts_tablet_manager.cc:1403] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.002s
I20260505 20:13:36.591954 7598 leader_election.cc:304] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.592126 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:36.592373 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:36.592339 8053 raft_consensus.cc:359] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.592489 8053 raft_consensus.cc:385] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.592548 8053 raft_consensus.cc:740] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.592538 9190 raft_consensus.cc:2804] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.592701 9190 raft_consensus.cc:697] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.592760 8053 consensus_queue.cc:260] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.593226 8053 ts_tablet_manager.cc:1434] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.593497 8053 tablet_bootstrap.cc:492] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:36.593679 7869 leader_election.cc:343] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.593806 7869 leader_election.cc:304] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.594027 9201 raft_consensus.cc:2749] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.594043 7737 leader_election.cc:304] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:36.594336 7869 leader_election.cc:343] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.594429 9138 raft_consensus.cc:2749] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.594434 7869 leader_election.cc:304] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.593921 8054 consensus_queue.cc:260] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.594623 9201 raft_consensus.cc:2749] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:36.594923 7737 leader_election.cc:343] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:36.595330 8054 ts_tablet_manager.cc:1434] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260505 20:13:36.595603 8054 tablet_bootstrap.cc:492] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.595781 8926 raft_consensus.cc:2804] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.595935 8926 raft_consensus.cc:697] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.596582 8926 consensus_queue.cc:237] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.596488 7598 leader_election.cc:304] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.595396 9190 consensus_queue.cc:237] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.600716 9150 raft_consensus.cc:2804] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.600834 9150 raft_consensus.cc:493] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.600940 9150 raft_consensus.cc:3060] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.602439 8693 raft_consensus.cc:493] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.602624 8693 raft_consensus.cc:515] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.602883 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "096ca710e3564d4b8db50f29dd56a5d4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:36.603096 7658 raft_consensus.cc:3060] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.603194 8693 leader_election.cc:290] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.603533 8693 raft_consensus.cc:493] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.603664 8693 raft_consensus.cc:515] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.605370 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1505e592e543cca92d8949bdae007e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.605577 7929 raft_consensus.cc:2468] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.607492 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d411638715f747469f9f3dc490c0257c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.607743 7935 raft_consensus.cc:3060] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.595371 8053 tablet_bootstrap.cc:654] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:36.617995 7737 leader_election.cc:343] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:36.618669 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d411638715f747469f9f3dc490c0257c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.618923 7800 raft_consensus.cc:3060] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.619432 8053 tablet_bootstrap.cc:492] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.619603 8053 ts_tablet_manager.cc:1403] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.001s
I20260505 20:13:36.620676 8053 raft_consensus.cc:359] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.620863 8053 raft_consensus.cc:385] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.621285 8053 raft_consensus.cc:740] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.621454 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1505e592e543cca92d8949bdae007e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.621505 8053 consensus_queue.cc:260] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.621631 7797 raft_consensus.cc:2468] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.622164 8053 ts_tablet_manager.cc:1434] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:36.622443 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249cad23ecfe4b9dbbd34f2a1fa899e3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.622619 7795 raft_consensus.cc:2468] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.624867 7596 leader_election.cc:304] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.625226 9028 raft_consensus.cc:2804] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.622457 8053 tablet_bootstrap.cc:492] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:36.633677 7598 leader_election.cc:343] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:36.638754 9028 raft_consensus.cc:493] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.638942 9028 raft_consensus.cc:3060] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.644300 7596 leader_election.cc:304] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.644773 8693 leader_election.cc:290] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.644934 8776 consensus_queue.cc:1048] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260505 20:13:36.645483 8053 tablet_bootstrap.cc:654] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.645718 8693 raft_consensus.cc:2804] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.646436 8693 raft_consensus.cc:493] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.646544 8693 raft_consensus.cc:3060] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.654018 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:36.654287 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:36.654714 8058 tablet_bootstrap.cc:492] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.654871 8058 ts_tablet_manager.cc:1403] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.091s user 0.010s sys 0.009s
I20260505 20:13:36.655100 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:36.655572 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:36.655942 8058 raft_consensus.cc:359] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.656181 8058 raft_consensus.cc:385] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.656224 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:36.656297 8058 raft_consensus.cc:740] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.656543 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:36.656558 8058 consensus_queue.cc:260] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.656842 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:36.657238 8058 ts_tablet_manager.cc:1434] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.657248 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:36.657573 8058 tablet_bootstrap.cc:492] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.659652 8058 tablet_bootstrap.cc:654] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.662204 8054 tablet_bootstrap.cc:654] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.663054 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:36.663357 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:36.666976 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:36.667311 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:36.667862 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:36.668834 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:36.666712 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249cad23ecfe4b9dbbd34f2a1fa899e3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.669379 7928 raft_consensus.cc:2468] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.674266 8053 tablet_bootstrap.cc:492] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.674394 8053 ts_tablet_manager.cc:1403] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.004s
I20260505 20:13:36.674980 7935 raft_consensus.cc:2468] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.675110 8053 raft_consensus.cc:359] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.675271 8053 raft_consensus.cc:385] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.675313 8053 raft_consensus.cc:740] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.675480 8053 consensus_queue.cc:260] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.675907 8053 ts_tablet_manager.cc:1434] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:36.681864 8053 tablet_bootstrap.cc:492] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.682057 7799 raft_consensus.cc:2468] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.682464 9150 raft_consensus.cc:515] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.682814 7596 leader_election.cc:304] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:36.683184 9150 leader_election.cc:290] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.683362 9150 raft_consensus.cc:2804] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.683518 9150 raft_consensus.cc:697] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.683791 8053 tablet_bootstrap.cc:654] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.688210 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:36.688664 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:36.689375 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 5 got 0
I20260505 20:13:36.690212 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.690371 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:36.690699 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:36.691254 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:36.692051 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:36.692323 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:36.692709 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:36.692701 9150 consensus_queue.cc:237] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.693105 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:36.693279 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:36.693485 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:36.694908 8054 tablet_bootstrap.cc:492] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.695034 8054 ts_tablet_manager.cc:1403] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.002s
I20260505 20:13:36.695729 8054 raft_consensus.cc:359] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.695896 8054 raft_consensus.cc:385] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.695950 8054 raft_consensus.cc:740] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.696175 8054 consensus_queue.cc:260] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.697835 8054 ts_tablet_manager.cc:1434] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:36.698866 8054 tablet_bootstrap.cc:492] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.700487 8054 tablet_bootstrap.cc:654] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.702713 7407 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:36.707754 8054 tablet_bootstrap.cc:492] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.707923 8054 ts_tablet_manager.cc:1403] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260505 20:13:36.708669 8054 raft_consensus.cc:359] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.708840 8054 raft_consensus.cc:385] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.708889 8054 raft_consensus.cc:740] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.714974 8989 raft_consensus.cc:493] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.715133 8989 raft_consensus.cc:515] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.715792 8989 leader_election.cc:290] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.716320 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608bffbbc10141e8bd19f475b95bdc65" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.716557 7930 raft_consensus.cc:2468] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.717140 7737 leader_election.cc:304] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:36.717438 8989 raft_consensus.cc:2804] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.717552 8989 raft_consensus.cc:493] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.717618 8989 raft_consensus.cc:3060] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.718355 8054 consensus_queue.cc:260] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:36.719570 7596 leader_election.cc:343] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.724197 7598 leader_election.cc:304] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.724676 9190 raft_consensus.cc:2804] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.725790 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608bffbbc10141e8bd19f475b95bdc65" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.725939 9190 raft_consensus.cc:697] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.730646 7662 raft_consensus.cc:2468] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.730674 9190 consensus_queue.cc:237] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.725288 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.738273 7935 raft_consensus.cc:3060] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.722836 8054 ts_tablet_manager.cc:1434] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260505 20:13:36.742560 8054 tablet_bootstrap.cc:492] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.749130 8054 tablet_bootstrap.cc:654] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.754889 8053 tablet_bootstrap.cc:492] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.755059 8053 ts_tablet_manager.cc:1403] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.002s
I20260505 20:13:36.756110 8053 raft_consensus.cc:359] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.756295 8053 raft_consensus.cc:385] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.756351 8053 raft_consensus.cc:740] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.756649 8926 consensus_queue.cc:1048] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260505 20:13:36.757485 8053 consensus_queue.cc:260] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.758121 8053 ts_tablet_manager.cc:1434] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:36.758436 8053 tablet_bootstrap.cc:492] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:36.760501 8053 tablet_bootstrap.cc:654] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.768941 8058 tablet_bootstrap.cc:492] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:36.769526 8058 ts_tablet_manager.cc:1403] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.112s user 0.003s sys 0.007s
I20260505 20:13:36.778017 8058 raft_consensus.cc:359] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.778347 8058 raft_consensus.cc:385] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.778443 8058 raft_consensus.cc:740] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.778812 8058 consensus_queue.cc:260] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.779472 8058 ts_tablet_manager.cc:1434] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260505 20:13:36.781884 7658 raft_consensus.cc:2468] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:36.786458 7935 raft_consensus.cc:2468] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.787722 8718 raft_consensus.cc:493] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.787909 8718 raft_consensus.cc:515] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.788882 8718 leader_election.cc:290] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.790365 8926 consensus_queue.cc:1048] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260505 20:13:36.793035 8058 tablet_bootstrap.cc:492] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:36.798336 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.798591 7935 raft_consensus.cc:2393] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:36.799516 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 3a6b85007c4f468ca18028a66395dc45 (DEFAULT_TABLE table=default.Table_0d23b97dd1c642df9051989388e5e654 [id=80d39fe1c936492b923f7106ee90c021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:36.800472 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 3a6b85007c4f468ca18028a66395dc45 (DEFAULT_TABLE table=default.Table_0d23b97dd1c642df9051989388e5e654 [id=80d39fe1c936492b923f7106ee90c021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:36.800916 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6b85007c4f468ca18028a66395dc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:36.802680 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 3a6b85007c4f468ca18028a66395dc45 (DEFAULT_TABLE table=default.Table_0d23b97dd1c642df9051989388e5e654 [id=80d39fe1c936492b923f7106ee90c021]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:36.803084 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6b85007c4f468ca18028a66395dc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:36.807503 7598 leader_election.cc:304] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.808840 9219 raft_consensus.cc:2804] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.808959 9219 raft_consensus.cc:697] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:36.809218 9219 consensus_queue.cc:237] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.809669 8718 raft_consensus.cc:493] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.809815 8718 raft_consensus.cc:515] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.810516 8718 leader_election.cc:290] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.810772 7736 leader_election.cc:304] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:36.811496 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876496f026c84eff8fef175387d20062" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.812047 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29fd054d41e4c48ab0da8dec2b952d5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.812258 7935 raft_consensus.cc:2468] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.812597 8718 raft_consensus.cc:2804] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.812629 7737 leader_election.cc:304] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:36.812724 8718 raft_consensus.cc:697] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:36.812891 9047 raft_consensus.cc:2804] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.812978 9047 raft_consensus.cc:493] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.813117 9047 raft_consensus.cc:3060] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.812978 8718 consensus_queue.cc:237] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.813572 8926 consensus_queue.cc:1048] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260505 20:13:36.816916 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29fd054d41e4c48ab0da8dec2b952d5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.817070 7662 raft_consensus.cc:2468] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:36.817212 7736 leader_election.cc:304] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.817669 9138 raft_consensus.cc:3060] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.818994 9207 consensus_queue.cc:1048] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:36.830825 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:36.838132 8054 tablet_bootstrap.cc:492] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.838311 8054 ts_tablet_manager.cc:1403] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.014s
I20260505 20:13:36.839357 8054 raft_consensus.cc:359] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.839591 8054 raft_consensus.cc:385] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.839660 8054 raft_consensus.cc:740] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.839918 8054 consensus_queue.cc:260] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.840425 8054 ts_tablet_manager.cc:1434] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.840708 8054 tablet_bootstrap.cc:492] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.842536 8054 tablet_bootstrap.cc:654] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.867750 8054 tablet_bootstrap.cc:492] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.867937 8054 ts_tablet_manager.cc:1403] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.003s
I20260505 20:13:36.868854 8054 raft_consensus.cc:359] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.869026 8054 raft_consensus.cc:385] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.869078 8054 raft_consensus.cc:740] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.869315 8054 consensus_queue.cc:260] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.869831 8054 ts_tablet_manager.cc:1434] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260505 20:13:36.870114 8054 tablet_bootstrap.cc:492] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.871817 8054 tablet_bootstrap.cc:654] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.876659 8693 raft_consensus.cc:515] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.877244 8693 leader_election.cc:290] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:36.877964 7869 consensus_peers.cc:597] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:36.878950 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249cad23ecfe4b9dbbd34f2a1fa899e3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.879159 7797 raft_consensus.cc:3060] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.880329 9028 raft_consensus.cc:515] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.881098 9028 leader_election.cc:290] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.883050 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:36.883502 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:36.883908 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:36.884222 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:36.884193 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1505e592e543cca92d8949bdae007e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:36.884402 7795 raft_consensus.cc:3060] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.884479 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:36.885076 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:36.885313 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:36.885492 8989 raft_consensus.cc:515] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.885924 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:36.886137 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:36.886219 8989 leader_election.cc:290] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.886579 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:36.886869 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:36.887732 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:36.887924 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:36.889326 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:36.889901 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:36.890220 9207 raft_consensus.cc:493] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.890180 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:36.890365 9207 raft_consensus.cc:515] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.890717 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:36.890861 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:36.891014 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608bffbbc10141e8bd19f475b95bdc65" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.891120 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:36.891211 7935 raft_consensus.cc:3060] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.891340 9207 leader_election.cc:290] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:36.891461 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 944bc61fe79c4f94bb280dae8e3cee59 (table default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647]). Expected version 3 got 0
I20260505 20:13:36.891631 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:36.891945 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "249cad23ecfe4b9dbbd34f2a1fa899e3" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.892009 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:36.892089 7930 raft_consensus.cc:3060] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.892179 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:36.892329 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:36.893091 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:36.894104 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:36.894193 9207 raft_consensus.cc:493] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.894259 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608bffbbc10141e8bd19f475b95bdc65" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:36.894312 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f1505e592e543cca92d8949bdae007e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:36.894294 9207 raft_consensus.cc:515] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.894415 7658 raft_consensus.cc:3060] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.894440 7929 raft_consensus.cc:3060] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.894812 9207 leader_election.cc:290] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:36.893949 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:36.895171 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:36.895399 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7214ab77d7904f0e9d37cb8d7a5a53a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:36.895419 7870 leader_election.cc:343] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.895799 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
W20260505 20:13:36.895951 7870 leader_election.cc:343] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.896037 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:36.896199 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 5 got 0
I20260505 20:13:36.896360 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a46c981a27ac4527a40d49714356185e (table default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c]). Expected version 2 got 0
I20260505 20:13:36.896708 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:36.897078 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:36.897949 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.897964 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7214ab77d7904f0e9d37cb8d7a5a53a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:36.898339 7869 leader_election.cc:343] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.898463 7869 leader_election.cc:304] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.898648 9207 raft_consensus.cc:2749] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:36.899294 7869 leader_election.cc:343] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.899390 7869 leader_election.cc:304] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.899473 9207 raft_consensus.cc:493] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.899561 9207 raft_consensus.cc:515] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.900084 9207 leader_election.cc:290] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:36.900228 9207 raft_consensus.cc:2749] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.900817 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:36.901234 7870 leader_election.cc:343] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.897670 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:36.901778 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:36.902169 7404 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
W20260505 20:13:36.902199 7869 leader_election.cc:343] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.902277 7869 leader_election.cc:304] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:36.902611 9135 raft_consensus.cc:2749] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:36.918021 8054 tablet_bootstrap.cc:492] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.918187 8054 ts_tablet_manager.cc:1403] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.004s
I20260505 20:13:36.919024 8054 raft_consensus.cc:359] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.919193 8054 raft_consensus.cc:385] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.919410 8054 raft_consensus.cc:740] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.919591 8054 consensus_queue.cc:260] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.920073 8054 ts_tablet_manager.cc:1434] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.920344 8054 tablet_bootstrap.cc:492] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.923098 8054 tablet_bootstrap.cc:654] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.925710 9190 raft_consensus.cc:493] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.925932 9190 raft_consensus.cc:515] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.927253 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:36.927985 7596 leader_election.cc:343] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.939904 8054 tablet_bootstrap.cc:492] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:36.940115 8054 ts_tablet_manager.cc:1403] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.011s
I20260505 20:13:36.940830 8054 raft_consensus.cc:359] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.941058 8054 raft_consensus.cc:385] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.941143 8054 raft_consensus.cc:740] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.941387 8054 consensus_queue.cc:260] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:36.942227 8054 ts_tablet_manager.cc:1434] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:36.942898 8054 tablet_bootstrap.cc:492] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:36.944845 8054 tablet_bootstrap.cc:654] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.956249 9190 leader_election.cc:290] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.956307 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:36.956511 7928 raft_consensus.cc:2468] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:36.957881 7598 leader_election.cc:304] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:36.958359 9028 raft_consensus.cc:2804] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:36.958441 9028 raft_consensus.cc:493] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:36.958510 9028 raft_consensus.cc:3060] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:36.971060 8053 tablet_bootstrap.cc:492] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:36.973172 8053 ts_tablet_manager.cc:1403] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.215s user 0.001s sys 0.012s
I20260505 20:13:36.974251 8053 raft_consensus.cc:359] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.974618 8053 raft_consensus.cc:385] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:36.974718 8053 raft_consensus.cc:740] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:36.974988 8053 consensus_queue.cc:260] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.982117 8058 tablet_bootstrap.cc:654] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:36.985126 7800 raft_consensus.cc:2468] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.985592 9121 ts_tablet_manager.cc:1929] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:36.985697 9121 log.cc:1199] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:36.986074 9121 ts_tablet_manager.cc:1950] T 0112c04befa14c48bb5b2e7dfb60dac7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:36.986325 7658 raft_consensus.cc:2468] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:36.986687 7929 raft_consensus.cc:2468] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:36.991669 9150 raft_consensus.cc:493] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:36.991815 9150 raft_consensus.cc:515] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:36.992461 9150 leader_election.cc:290] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:36.995332 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:36.998045 7596 leader_election.cc:343] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:36.998800 7736 leader_election.cc:304] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:36.999182 8989 raft_consensus.cc:2804] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:36.999311 8989 raft_consensus.cc:697] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:36.999665 8989 consensus_queue.cc:237] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.001502 8054 tablet_bootstrap.cc:492] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.001648 8054 ts_tablet_manager.cc:1403] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.011s
I20260505 20:13:37.002478 8054 raft_consensus.cc:359] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.002650 8054 raft_consensus.cc:385] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.002707 8054 raft_consensus.cc:740] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.002902 8054 consensus_queue.cc:260] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.003364 8054 ts_tablet_manager.cc:1434] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:37.003551 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.003652 8054 tablet_bootstrap.cc:492] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.003695 7928 raft_consensus.cc:2468] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:37.001235 7598 leader_election.cc:304] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:37.005287 8054 tablet_bootstrap.cc:654] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.009188 8058 tablet_bootstrap.cc:492] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.009327 8058 ts_tablet_manager.cc:1403] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.230s user 0.020s sys 0.000s
I20260505 20:13:37.010588 9219 raft_consensus.cc:2804] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.010747 9219 raft_consensus.cc:697] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:37.011062 9219 consensus_queue.cc:237] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.013921 9150 consensus_queue.cc:1048] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.015206 7598 leader_election.cc:304] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:37.017509 8693 raft_consensus.cc:2804] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.017606 8693 raft_consensus.cc:493] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.017683 8693 raft_consensus.cc:3060] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.029429 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:37.030519 8054 tablet_bootstrap.cc:492] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.030675 8054 ts_tablet_manager.cc:1403] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.003s
I20260505 20:13:37.031385 8054 raft_consensus.cc:359] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.031553 8054 raft_consensus.cc:385] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.031597 8054 raft_consensus.cc:740] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.031808 8054 consensus_queue.cc:260] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.032699 8054 ts_tablet_manager.cc:1434] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:37.032979 8054 tablet_bootstrap.cc:492] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.034953 8054 tablet_bootstrap.cc:654] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.035377 8989 raft_consensus.cc:493] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.035398 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:37.035532 8989 raft_consensus.cc:515] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.035719 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:37.036047 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:37.036273 8989 leader_election.cc:290] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.036559 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:37.037972 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.038434 7928 raft_consensus.cc:2393] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:37.039827 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65003660c44547cc8674baeca370e395" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.040421 7736 leader_election.cc:304] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.042320 8989 raft_consensus.cc:3060] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.044248 8054 tablet_bootstrap.cc:492] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.044299 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:37.044373 8054 ts_tablet_manager.cc:1403] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260505 20:13:37.044567 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:37.045084 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:37.045118 8054 raft_consensus.cc:359] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.045279 8054 raft_consensus.cc:385] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.045331 8054 raft_consensus.cc:740] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.045519 8054 consensus_queue.cc:260] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.046196 8054 ts_tablet_manager.cc:1434] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:37.046965 8054 tablet_bootstrap.cc:492] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.048640 8054 tablet_bootstrap.cc:654] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.049218 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:37.049795 7410 catalog_manager.cc:5671] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:37.051409 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:37.051967 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:37.054519 9190 consensus_queue.cc:1048] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.064007 8058 raft_consensus.cc:359] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.064226 8058 raft_consensus.cc:385] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.064303 8058 raft_consensus.cc:740] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.064313 8054 tablet_bootstrap.cc:492] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.064472 8054 ts_tablet_manager.cc:1403] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260505 20:13:37.064509 8058 consensus_queue.cc:260] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.065205 8054 raft_consensus.cc:359] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.065378 8054 raft_consensus.cc:385] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.065444 8054 raft_consensus.cc:740] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.065661 8054 consensus_queue.cc:260] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.066174 8054 ts_tablet_manager.cc:1434] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:37.066452 8054 tablet_bootstrap.cc:492] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.066509 8053 ts_tablet_manager.cc:1434] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.093s user 0.002s sys 0.000s
I20260505 20:13:37.070274 8058 ts_tablet_manager.cc:1434] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.061s user 0.002s sys 0.000s
I20260505 20:13:37.070493 9190 raft_consensus.cc:493] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.070631 9190 raft_consensus.cc:515] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.070887 8054 tablet_bootstrap.cc:654] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.071713 9190 leader_election.cc:290] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.072019 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.072655 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.072860 7928 raft_consensus.cc:2468] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
W20260505 20:13:37.073863 7596 leader_election.cc:343] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.074280 7598 leader_election.cc:304] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:37.074751 9190 raft_consensus.cc:2804] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.074869 9190 raft_consensus.cc:493] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.074986 9190 raft_consensus.cc:3060] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.075754 8053 tablet_bootstrap.cc:492] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.076525 9207 raft_consensus.cc:493] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.076673 9207 raft_consensus.cc:515] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.077276 9207 leader_election.cc:290] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.080497 7410 catalog_manager.cc:5671] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:37.085393 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:37.086171 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a6b85007c4f468ca18028a66395dc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:37.090044 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:37.090224 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 034852d91c26434f8a3c7fd8100c49ac (table default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70]). Expected version 2 got 0
I20260505 20:13:37.090899 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:37.091040 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:37.091389 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:37.091871 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:37.092321 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:37.092679 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:37.097203 7930 raft_consensus.cc:2468] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.084764 9028 raft_consensus.cc:515] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.098646 9207 raft_consensus.cc:493] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.098794 9207 raft_consensus.cc:515] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.099131 9028 leader_election.cc:290] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.099393 9207 leader_election.cc:290] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.102496 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c720fc66db36402a83a7690d70a40353" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.102491 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.103569 8054 tablet_bootstrap.cc:492] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.103721 8054 ts_tablet_manager.cc:1403] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.004s
W20260505 20:13:37.104206 7870 leader_election.cc:343] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:37.104502 7870 leader_election.cc:343] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.104574 8054 raft_consensus.cc:359] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.104756 8054 raft_consensus.cc:385] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.104836 8054 raft_consensus.cc:740] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.105060 8054 consensus_queue.cc:260] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.105500 8054 ts_tablet_manager.cc:1434] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:37.105814 8054 tablet_bootstrap.cc:492] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.107494 8054 tablet_bootstrap.cc:654] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.108994 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:37.109206 7930 raft_consensus.cc:3060] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.117097 7598 leader_election.cc:304] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:37.117628 8557 raft_consensus.cc:2804] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.117785 8557 raft_consensus.cc:697] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:37.118021 8557 consensus_queue.cc:237] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.122093 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:37.123366 8557 consensus_queue.cc:1048] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.076525 9242 raft_consensus.cc:493] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.135908 9242 raft_consensus.cc:515] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.136590 9242 leader_election.cc:290] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.077483 9047 raft_consensus.cc:515] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.137080 9047 leader_election.cc:290] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.107316 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c720fc66db36402a83a7690d70a40353" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.138494 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bd562fea64fe69db2b4a6085b7bed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.138712 7929 raft_consensus.cc:2468] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:37.139683 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29fd054d41e4c48ab0da8dec2b952d5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:37.139879 7929 raft_consensus.cc:3060] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.139837 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
W20260505 20:13:37.140518 7869 leader_election.cc:343] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.140691 7869 leader_election.cc:304] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.141112 9135 raft_consensus.cc:2749] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.141825 9047 raft_consensus.cc:493] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.141986 9047 raft_consensus.cc:515] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.142596 9047 leader_election.cc:290] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.143563 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.143788 7928 raft_consensus.cc:2393] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:37.143932 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:37.144332 7737 leader_election.cc:304] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:37.144620 9047 raft_consensus.cc:2804] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.144707 9047 raft_consensus.cc:493] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.144788 9047 raft_consensus.cc:3060] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.146260 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:37.147727 9135 raft_consensus.cc:493] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.108165 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:37.147897 9135 raft_consensus.cc:515] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:37.148253 7596 leader_election.cc:343] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.148590 9135 leader_election.cc:290] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.109138 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.149339 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.150048 7870 leader_election.cc:343] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.151106 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:37.151808 8053 tablet_bootstrap.cc:654] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:37.152901 7869 leader_election.cc:343] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.152912 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:37.153053 7869 leader_election.cc:304] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.153352 9135 raft_consensus.cc:2749] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.153878 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:37.154759 7869 leader_election.cc:343] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.154898 7869 leader_election.cc:304] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.155176 9135 raft_consensus.cc:2749] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.157204 8058 tablet_bootstrap.cc:492] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.159281 8058 tablet_bootstrap.cc:654] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.160589 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:37.162694 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bd562fea64fe69db2b4a6085b7bed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.162932 7662 raft_consensus.cc:2468] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:37.163385 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29fd054d41e4c48ab0da8dec2b952d5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:37.163571 7662 raft_consensus.cc:3060] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.164186 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda4fd8b0f214da7a1e8b944e1820c0c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.165588 7736 leader_election.cc:304] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.166167 9242 raft_consensus.cc:3060] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.180409 8058 tablet_bootstrap.cc:492] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.180567 8058 ts_tablet_manager.cc:1403] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260505 20:13:37.181033 7935 raft_consensus.cc:2468] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:37.181257 8058 raft_consensus.cc:359] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.181463 8058 raft_consensus.cc:385] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.181520 8058 raft_consensus.cc:740] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.181907 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:37.182337 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:37.182542 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_e668fd82eb274b2fb39e758534ec447c [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 5 got 0
I20260505 20:13:37.182519 7795 raft_consensus.cc:2468] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.182928 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01e800dfb0354beab9c835cbed9dceb4 (table default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49]). Expected version 3 got 0
I20260505 20:13:37.183490 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 47720452d3f44e18b16a06ae296b4c51 (table default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b]). Expected version 2 got 0
I20260505 20:13:37.183485 8693 raft_consensus.cc:515] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.184177 8693 leader_election.cc:290] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.186079 8058 consensus_queue.cc:260] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.186584 8058 ts_tablet_manager.cc:1434] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:37.186864 8058 tablet_bootstrap.cc:492] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.188529 8058 tablet_bootstrap.cc:654] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.185086 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 79) took 1375 ms. Trace:
I20260505 20:13:37.193943 9121 rpcz_store.cc:276] 0505 20:13:35.809573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.809617 (+ 44us) service_pool.cc:224] Handling call
0505 20:13:36.505589 (+695972us) ts_tablet_manager.cc:1151] Deleting tablet 0112c04befa14c48bb5b2e7dfb60dac7
0505 20:13:36.506479 (+ 890us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:36.782386 (+275907us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:36.985514 (+203128us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:37.185028 (+199514us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":695779}
I20260505 20:13:37.194444 9121 tablet_replica.cc:333] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:37.194698 9121 raft_consensus.cc:2243] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:37.195127 9121 raft_consensus.cc:2272] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:37.195752 9121 ts_tablet_manager.cc:1916] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:37.183799 7410 catalog_manager.cc:5671] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:37.199834 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 0112c04befa14c48bb5b2e7dfb60dac7 (table default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]) successfully deleted
I20260505 20:13:37.200341 7410 catalog_manager.cc:5671] T fca1e2a2ea424ffd83bd5260694c1b3e P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:37.200954 7410 catalog_manager.cc:5671] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:37.201303 7410 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
W20260505 20:13:37.201802 7413 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 947a4d496d994b799d1688cc258a181d consensus state has no leader
I20260505 20:13:37.202057 7413 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 66) took 2522 ms. Trace:
I20260505 20:13:37.202162 7413 rpcz_store.cc:276] 0505 20:13:34.679638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.961040 (+1281402us) service_pool.cc:224] Handling call
0505 20:13:35.961736 (+ 696us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:35.962126 (+ 390us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:36.159696 (+197570us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:36.159854 (+ 158us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:36.198287 (+ 38433us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.198296 (+ 9us) write_op.cc:454] Released schema lock
0505 20:13:36.198386 (+ 90us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:37.201991 (+1003605us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:36.160553 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:36.160701 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:36.160710 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:36.160714 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:36.160855 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:36.160874 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:36.160879 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:36.160951 (+ 72us) tablet.cc:701] Row locks acquired
0505 20:13:36.160953 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:36.161019 (+ 66us) write_op.cc:270] Start()
0505 20:13:36.161062 (+ 43us) write_op.cc:276] Timestamp: P: 1778012016161083 usec, L: 0
0505 20:13:36.161066 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:36.161298 (+ 232us) log.cc:844] Serialized 405 byte log entry
0505 20:13:36.168297 (+ 6999us) op_driver.cc:464] REPLICATION: finished
0505 20:13:36.168443 (+ 146us) write_op.cc:301] APPLY: starting
0505 20:13:36.168466 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:36.168515 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:36.168553 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:36.168625 (+ 72us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:36.168673 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:36.168684 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:36.168775 (+ 91us) log.cc:844] Serialized 23 byte log entry
0505 20:13:36.168934 (+ 159us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.168963 (+ 29us) write_op.cc:454] Released schema lock
0505 20:13:36.168974 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":602,"apply.run_wall_time_us":601,"num_ops":1,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":867,"prepare.run_wall_time_us":867,"raft.queue_time_us":2118,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":256,"replication_time_us":7187}]]}
I20260505 20:13:37.202859 7409 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_5c7ee4db09f44c5099b163f37f1f6486 [id=49103ea0eb57491fa5482997379eda9b] alter complete (version 1)
W20260505 20:13:37.206023 7408 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 369f4a55fdd64e4bb907666bede9f241 consensus state has no leader
I20260505 20:13:37.206286 7408 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 64) took 2526 ms. Trace:
I20260505 20:13:37.206396 7408 rpcz_store.cc:276] 0505 20:13:34.679418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.779938 (+1100520us) service_pool.cc:224] Handling call
0505 20:13:36.188749 (+408811us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:36.188983 (+ 234us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:36.189192 (+ 209us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:36.189274 (+ 82us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:36.205821 (+ 16547us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.205828 (+ 7us) write_op.cc:454] Released schema lock
0505 20:13:36.205916 (+ 88us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:37.206210 (+1000294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:36.189870 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:36.190006 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:36.190015 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:36.190020 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:36.190163 (+ 143us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:36.190181 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:36.190188 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:36.190257 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:36.190259 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:36.190296 (+ 37us) write_op.cc:270] Start()
0505 20:13:36.190327 (+ 31us) write_op.cc:276] Timestamp: P: 1778012016190395 usec, L: 0
0505 20:13:36.190330 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:36.190506 (+ 176us) log.cc:844] Serialized 405 byte log entry
0505 20:13:36.195266 (+ 4760us) op_driver.cc:464] REPLICATION: finished
0505 20:13:36.195400 (+ 134us) write_op.cc:301] APPLY: starting
0505 20:13:36.195416 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:36.195459 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:36.195491 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:36.195550 (+ 59us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:36.195584 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:36.195592 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:36.195688 (+ 96us) log.cc:844] Serialized 23 byte log entry
0505 20:13:36.195753 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.195773 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:36.195790 (+ 17us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":446,"apply.run_wall_time_us":445,"num_ops":1,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":749,"prepare.run_wall_time_us":750,"raft.queue_time_us":779,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":285,"replication_time_us":4907}]]}
I20260505 20:13:37.207468 7408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9ee9fc9d6bc948fd90db78cd1670d21f" } new_table_name: "default.Table_5fb8878551e44d388cc76ea4d43d13e9" modify_external_catalogs: true
I20260505 20:13:37.216971 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:37.219624 8693 raft_consensus.cc:493] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.219820 8693 raft_consensus.cc:515] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.220621 8693 leader_election.cc:290] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:37.226200 7408 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a25cb36420534396a0850aef61706ae1 consensus state has no leader
I20260505 20:13:37.226450 7408 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 67) took 2546 ms. Trace:
I20260505 20:13:37.226562 7408 rpcz_store.cc:276] 0505 20:13:34.679721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.207197 (+2527476us) service_pool.cc:224] Handling call
0505 20:13:37.207696 (+ 499us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.207960 (+ 264us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:37.208218 (+ 258us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:37.208365 (+ 147us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:37.225914 (+ 17549us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:37.226377 (+ 463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.215928 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.216070 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.216077 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:37.216079 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.216193 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.216208 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.216213 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:37.216282 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:37.216285 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:37.216335 (+ 50us) write_op.cc:270] Start()
0505 20:13:37.216373 (+ 38us) write_op.cc:276] Timestamp: P: 1778012017216430 usec, L: 0
0505 20:13:37.216377 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.216592 (+ 215us) log.cc:844] Serialized 405 byte log entry
0505 20:13:37.223200 (+ 6608us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.223405 (+ 205us) write_op.cc:301] APPLY: starting
0505 20:13:37.223429 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.223494 (+ 65us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.223537 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.223617 (+ 80us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.223666 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:37.223677 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:37.223785 (+ 108us) log.cc:844] Serialized 23 byte log entry
0505 20:13:37.223866 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.223895 (+ 29us) write_op.cc:454] Released schema lock
0505 20:13:37.223906 (+ 11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":146,"apply.run_cpu_time_us":579,"apply.run_wall_time_us":579,"num_ops":1,"prepare.queue_time_us":6888,"raft.queue_time_us":6466,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":207,"replication_time_us":6794,"threads_started":1}]]}
I20260505 20:13:37.238094 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.239054 8693 raft_consensus.cc:493] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.239193 8693 raft_consensus.cc:515] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.239715 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.239764 8693 leader_election.cc:290] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.240242 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.240667 8940 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260505 20:13:37.241909 8940 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260505 20:13:37.242992 8940 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260505 20:13:37.246217 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.246302 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.246402 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.246609 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 7766caea43904162a2c289b7b17405d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.248414 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:37.249212 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:37.249583 7412 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e2c99f02ea514a2581f0697dc3ef6461 consensus state has no leader
I20260505 20:13:37.249828 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.250036 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.250203 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.250358 7773 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.250514 7782 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.250715 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.250859 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.251022 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.251195 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.251405 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.251627 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.251806 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.251845 9207 raft_consensus.cc:493] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.251967 7769 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.252045 9207 raft_consensus.cc:515] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.252991 9207 leader_election.cc:290] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.253806 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bfd96314244e6cbbb4d5b48841e06f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.255553 7870 leader_election.cc:343] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.255983 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.256176 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:37.258137 7412 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 68718abc133e452495567232e51fb55b consensus state has no leader
I20260505 20:13:37.258894 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.259100 7769 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.259295 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:37.259575 7596 leader_election.cc:343] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.259802 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.259819 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.259909 7596 leader_election.cc:343] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.259990 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.260041 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.260426 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.260454 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.260617 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.260788 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.260854 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.261000 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.261019 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.261198 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.261222 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bfd96314244e6cbbb4d5b48841e06f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.261372 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.261664 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.262387 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.262591 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.262919 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.263005 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.263103 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.263068 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:37.263172 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.263271 7935 raft_consensus.cc:3060] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.263486 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.263778 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.264613 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.264788 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf77f6323af4263852853e10003faee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.265072 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.265286 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.265540 7626 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.265592 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:37.265690 7869 leader_election.cc:343] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.265849 7869 leader_election.cc:304] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.266008 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.266173 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.266247 9207 raft_consensus.cc:2749] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.266835 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.267338 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.251636 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506b421a774c4929813205dba0fac32b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.268271 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.268334 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.268517 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.268671 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.268905 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.269410 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.269933 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.270404 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.270923 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.271437 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.271862 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.272323 7596 leader_election.cc:343] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.272509 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.273111 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.273298 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.273579 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.273717 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.273962 7928 raft_consensus.cc:2468] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:37.274173 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.274223 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.274451 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.274744 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.274765 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.275207 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bdfc75a494635837178cb16c08c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.275269 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.275555 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.275753 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.275885 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.276162 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.276451 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.276515 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.276834 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.276885 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 19720f3a29f34515a952e50f4fec9f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.277187 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.277230 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.277580 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.277606 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.277797 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.278064 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.278080 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.278365 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.278568 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.278659 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.278950 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.279006 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.279291 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.279475 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.279605 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet d2676078f47c4bc19391227d9643c15f with delete_type TABLET_DATA_DELETED (replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.279875 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.280393 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.280944 9138 raft_consensus.cc:2749] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.281023 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet d2676078f47c4bc19391227d9643c15f with delete_type TABLET_DATA_DELETED (replaced by tablet 0112c04befa14c48bb5b2e7dfb60dac7) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.281416 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.281801 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.282155 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.282554 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.282903 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 7766caea43904162a2c289b7b17405d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.283288 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.283802 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.284165 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.284633 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.291769 7662 raft_consensus.cc:2468] T f29fd054d41e4c48ab0da8dec2b952d5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:37.292280 9207 raft_consensus.cc:493] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.292450 9207 raft_consensus.cc:515] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.293159 9207 leader_election.cc:290] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.294019 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d4e198c91c4a0e99d8b798a1dd3433" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.294596 7870 leader_election.cc:343] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.295017 7929 raft_consensus.cc:2468] T f29fd054d41e4c48ab0da8dec2b952d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:37.300390 9219 consensus_queue.cc:1048] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.301287 7737 leader_election.cc:304] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:37.301647 9138 raft_consensus.cc:2804] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.301769 9138 raft_consensus.cc:697] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:37.301998 9138 consensus_queue.cc:237] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.303897 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d4e198c91c4a0e99d8b798a1dd3433" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.306826 9207 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.307029 9207 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.308488 9207 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.311257 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.321444 7870 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.330293 8053 tablet_bootstrap.cc:492] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.330471 8053 ts_tablet_manager.cc:1403] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.255s user 0.002s sys 0.001s
I20260505 20:13:37.331221 8053 raft_consensus.cc:359] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.331413 8053 raft_consensus.cc:385] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.331488 8053 raft_consensus.cc:740] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.337044 8053 consensus_queue.cc:260] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.337613 8053 ts_tablet_manager.cc:1434] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260505 20:13:37.337931 8053 tablet_bootstrap.cc:492] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:37.339637 7869 leader_election.cc:343] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.339870 7869 leader_election.cc:304] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.340672 9207 raft_consensus.cc:2749] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.343204 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:37.344579 7869 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.344834 7869 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.345424 9207 raft_consensus.cc:2749] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:37.345889 7598 consensus_peers.cc:597] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:37.346707 7598 leader_election.cc:304] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:37.347093 9219 raft_consensus.cc:2804] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.347185 9219 raft_consensus.cc:493] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.347297 9219 raft_consensus.cc:3060] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.349085 9270 tablet_replica.cc:333] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:37.349351 9270 raft_consensus.cc:2243] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:37.349561 9270 raft_consensus.cc:2272] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:37.350297 9270 ts_tablet_manager.cc:1916] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:37.353307 9150 consensus_queue.cc:1048] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:37.354087 7598 leader_election.cc:343] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 506b421a774c4929813205dba0fac32b
I20260505 20:13:37.354295 7598 leader_election.cc:304] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:37.354609 9150 raft_consensus.cc:2749] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.359283 9150 consensus_queue.cc:1048] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.362495 8053 tablet_bootstrap.cc:654] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.365226 9271 tablet_replica.cc:333] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:37.365554 9271 raft_consensus.cc:2243] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:37.365914 9271 raft_consensus.cc:2272] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:37.366628 9271 ts_tablet_manager.cc:1916] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:37.370589 7408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9875a3e2f0d444018fb87797fd4bcde6" } new_table_name: "default.Table_d788352d297e44d1874caf109ffc646c" modify_external_catalogs: true
I20260505 20:13:37.371745 8053 tablet_bootstrap.cc:492] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.371881 8053 ts_tablet_manager.cc:1403] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.002s
W20260505 20:13:37.371991 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet e32ff17c39f04bc2b1c9c37a1165399b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32ff17c39f04bc2b1c9c37a1165399b already in progress: creating tablet
I20260505 20:13:37.372773 8053 raft_consensus.cc:359] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.372982 8053 raft_consensus.cc:385] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.373042 8053 raft_consensus.cc:740] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:37.373378 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 944eaa335fcf49be975baee21c715642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944eaa335fcf49be975baee21c715642 already in progress: creating tablet
W20260505 20:13:37.373582 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet feef367085954816b312d4f1cdd80b1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet feef367085954816b312d4f1cdd80b1d already in progress: creating tablet
I20260505 20:13:37.373720 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a42f0b6dc74cbd8d72ae36410f9d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.373957 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.373991 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f0ca8cc557674992b88f3379cc1db652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0ca8cc557674992b88f3379cc1db652 already in progress: creating tablet
I20260505 20:13:37.374589 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.375012 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c12a95b0ed445c7b598db136f6ac05c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.373661 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.378535 7797 raft_consensus.cc:2468] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.378962 7930 raft_consensus.cc:2468] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:37.381366 8940 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260505 20:13:37.381459 8940 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260505 20:13:37.381541 8940 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260505 20:13:37.381594 8940 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260505 20:13:37.385203 8053 consensus_queue.cc:260] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:37.385571 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet ae8bd19470294a1db91855afe49be6a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae8bd19470294a1db91855afe49be6a5 already in progress: creating tablet
W20260505 20:13:37.385876 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet cb5cfc700aff4082ae089476e2af044f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb5cfc700aff4082ae089476e2af044f already in progress: creating tablet
I20260505 20:13:37.387055 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.387030 9190 raft_consensus.cc:515] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.387271 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.387512 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 624398f68961440f8369a7859b0724c4 with delete_type TABLET_DATA_DELETED (replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.387687 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 with delete_type TABLET_DATA_DELETED (replaced by tablet 369f4a55fdd64e4bb907666bede9f241) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.387727 9190 leader_election.cc:290] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.387835 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c1f63c849c48438abdaa965ab051f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.388034 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c8754580368453aa0aae021d8c665da with delete_type TABLET_DATA_DELETED (replaced by tablet 59f5348c229744ab98f0de3da40de6c5) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.388331 8053 ts_tablet_manager.cc:1434] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260505 20:13:37.388584 8053 tablet_bootstrap.cc:492] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.389846 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.390535 7781 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.390678 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.390787 7770 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.390890 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.391004 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 880cbba188144dd795873186f8cda1e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c20374c4df742799110a12f3fea5daa) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:37.391676 7407 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a114db19f63346d9a67e9e3a8225caa4 consensus state has no leader
I20260505 20:13:37.392979 9121 ts_tablet_manager.cc:1929] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:37.393097 9121 log.cc:1199] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f62626fb4f8445e3a6e2822277181762
I20260505 20:13:37.394225 8053 tablet_bootstrap.cc:654] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:37.394174 7407 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet a694c65f90f4499ab96e45fbbaa9e892 consensus state has no leader
I20260505 20:13:37.395196 9121 ts_tablet_manager.cc:1950] T f62626fb4f8445e3a6e2822277181762 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:37.396683 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet faf3775c154742c5804daf8ade2ad854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.397704 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 506b421a774c4929813205dba0fac32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:37.397976 7407 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d8c4620970434e49b4fd3d21f309a48c consensus state has no leader
W20260505 20:13:37.398301 7407 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 6c20374c4df742799110a12f3fea5daa consensus state has no leader
I20260505 20:13:37.398494 8054 tablet_bootstrap.cc:492] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.398658 8054 ts_tablet_manager.cc:1403] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.293s user 0.077s sys 0.081s
I20260505 20:13:37.400051 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 0112c04befa14c48bb5b2e7dfb60dac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.400849 8054 raft_consensus.cc:359] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.401113 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 624398f68961440f8369a7859b0724c4 with delete_type TABLET_DATA_DELETED (replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.401239 8054 raft_consensus.cc:385] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.401369 8054 raft_consensus.cc:740] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.401705 8054 consensus_queue.cc:260] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.403585 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.404223 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet cb5cfc700aff4082ae089476e2af044f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.413123 8557 raft_consensus.cc:493] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.413318 8557 raft_consensus.cc:515] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.414083 8557 leader_election.cc:290] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:37.415000 7870 consensus_peers.cc:597] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:37.418218 8054 ts_tablet_manager.cc:1434] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260505 20:13:37.419188 8054 tablet_bootstrap.cc:492] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.419950 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.420691 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.421293 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ddf95d810c4c80a5f78c1b7600cee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.421680 8054 tablet_bootstrap.cc:654] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.422034 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 172cd9f38dd8491ea3ecf42b680d398f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.422709 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.423381 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet e69bdfc75a494635837178cb16c08c1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.424113 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.424896 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet faf3775c154742c5804daf8ade2ad854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.426549 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.426630 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.426815 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.426940 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.427665 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.428057 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.428376 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.428537 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.429762 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet ae8bd19470294a1db91855afe49be6a5 with delete_type TABLET_DATA_DELETED (replaced by tablet d8c4620970434e49b4fd3d21f309a48c) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.430164 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f27847d940e46778ad10a2f4cf40d27 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cb3d246d6b443b8933648fe4f4aa5c2) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.430732 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.430902 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.431738 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.433784 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.434181 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.434504 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e650b297603425184ad97ddf99ec36d with delete_type TABLET_DATA_DELETED (replaced by tablet f0ca8cc557674992b88f3379cc1db652) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.434945 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 with delete_type TABLET_DATA_DELETED (replaced by tablet c720fc66db36402a83a7690d70a40353) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.435315 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 004a8e72cab44d31af3369b8df1e434e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.435750 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f1505e592e543cca92d8949bdae007e with delete_type TABLET_DATA_DELETED (replaced by tablet 5b3595eb9b1144d9b802f1f563d01461) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.436178 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet d3cd1b7b0456462a80d653dd442589a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.436688 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 089517a7c2214dce9367b21beb555733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.437119 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet b17da5cf513647d9b8e582a9b3b460a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.437547 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 19720f3a29f34515a952e50f4fec9f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.437867 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.438263 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.438701 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee with delete_type TABLET_DATA_DELETED (replaced by tablet a114db19f63346d9a67e9e3a8225caa4) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.439577 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:37.441215 7407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 282) took 1755 ms (client timeout 1000 ms). Trace:
W20260505 20:13:37.441346 7407 rpcz_store.cc:269] 0505 20:13:35.685735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.752656 (+ 66921us) service_pool.cc:224] Handling call
0505 20:13:37.441158 (+1688502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138923,"reported_tablets":221}
I20260505 20:13:37.442533 8054 tablet_bootstrap.cc:492] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.442698 8054 ts_tablet_manager.cc:1403] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.001s
I20260505 20:13:37.443187 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_8dcfa4ea18414fa5a138d1a90302652c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:37.443586 8054 raft_consensus.cc:359] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.443753 8054 raft_consensus.cc:385] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.443810 8054 raft_consensus.cc:740] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.444038 8054 consensus_queue.cc:260] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:37.444451 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dcfa4ea18414fa5a138d1a90302652c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.445420 8054 ts_tablet_manager.cc:1434] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:37.445622 7598 leader_election.cc:304] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:37.446071 8054 tablet_bootstrap.cc:492] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.446272 9150 raft_consensus.cc:2804] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.446411 9150 raft_consensus.cc:697] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:37.446640 9150 consensus_queue.cc:237] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.447955 8054 tablet_bootstrap.cc:654] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.456350 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 506b421a774c4929813205dba0fac32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:37.457114 7412 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 257) took 2690 ms (client timeout 1000 ms). Trace:
I20260505 20:13:37.459821 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.460539 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.462600 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c8754580368453aa0aae021d8c665da with delete_type TABLET_DATA_DELETED (replaced by tablet 59f5348c229744ab98f0de3da40de6c5) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.462780 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet 28ce3efe875a43d9b30d40623bf8a385 with delete_type TABLET_DATA_DELETED (replaced by tablet c720fc66db36402a83a7690d70a40353) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.462949 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet 004a8e72cab44d31af3369b8df1e434e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463079 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e650b297603425184ad97ddf99ec36d with delete_type TABLET_DATA_DELETED (replaced by tablet f0ca8cc557674992b88f3379cc1db652) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463258 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463375 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463492 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 096ca710e3564d4b8db50f29dd56a5d4 with delete_type TABLET_DATA_DELETED (replaced by tablet 369f4a55fdd64e4bb907666bede9f241) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463604 7634 tablet_service.cc:1558] Processing DeleteTablet for tablet 168d9a40a69d4beab8e79a97e7723e69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463629 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463706 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 1aaff49cb0ff4298be24603b2015c8a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463829 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet 880cbba188144dd795873186f8cda1e9 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c20374c4df742799110a12f3fea5daa) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.463948 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet 50c1f63c849c48438abdaa965ab051f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.464027 7405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 256) took 4086 ms (client timeout 1000 ms). Trace:
I20260505 20:13:37.464425 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.464609 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.464141 7405 rpcz_store.cc:269] 0505 20:13:33.377705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:33.402683 (+ 24978us) service_pool.cc:224] Handling call
0505 20:13:33.455598 (+ 52915us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:34.301491 (+845893us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.301499 (+ 8us) write_op.cc:454] Released schema lock
0505 20:13:37.463957 (+3162458us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:34.290583 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.290685 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.290691 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:34.290693 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:34.290940 (+ 247us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.290956 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.290961 (+ 5us) tablet.cc:685] Acquiring locks for 7 operations
0505 20:13:34.291119 (+ 158us) tablet.cc:701] Row locks acquired
0505 20:13:34.291122 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:34.291162 (+ 40us) write_op.cc:270] Start()
0505 20:13:34.291199 (+ 37us) write_op.cc:276] Timestamp: P: 1778012014291322 usec, L: 0
0505 20:13:34.291203 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.291465 (+ 262us) log.cc:844] Serialized 2793 byte log entry
0505 20:13:34.296952 (+ 5487us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.297125 (+ 173us) write_op.cc:301] APPLY: starting
0505 20:13:34.297143 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.297209 (+ 66us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.297238 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.297358 (+ 120us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.297396 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0505 20:13:34.297403 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:34.297508 (+ 105us) log.cc:844] Serialized 59 byte log entry
0505 20:13:34.297571 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.297599 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:34.297607 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0505 20:13:34.794588 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.794726 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.794731 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:34.794733 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:34.794865 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.794889 (+ 24us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.794896 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:34.794971 (+ 75us) tablet.cc:701] Row locks acquired
0505 20:13:34.794974 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:34.795018 (+ 44us) write_op.cc:270] Start()
0505 20:13:34.795054 (+ 36us) write_op.cc:276] Timestamp: P: 1778012014795179 usec, L: 0
0505 20:13:34.795058 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.795318 (+ 260us) log.cc:844] Serialized 356 byte log entry
0505 20:13:34.808519 (+ 13201us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.808780 (+ 261us) write_op.cc:301] APPLY: starting
0505 20:13:34.808799 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.808847 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.808890 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.808983 (+ 93us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.809024 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:34.809031 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:34.809151 (+ 120us) log.cc:844] Serialized 23 byte log entry
0505 20:13:34.809227 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.809250 (+ 23us) write_op.cc:454] Released schema lock
0505 20:13:34.809257 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:34.812832 (+ 3575us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.812838 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":281240,"reported_tablets":180,"spinlock_wait_cycles":114042624,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":538,"apply.run_wall_time_us":537,"num_ops":7,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":1005,"prepare.run_wall_time_us":1005,"raft.queue_time_us":663,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":318,"replication_time_us":5720}],["op",{"apply.queue_time_us":178,"apply.run_cpu_time_us":569,"apply.run_wall_time_us":569,"num_ops":1,"prepare.queue_time_us":313829,"prepare.run_cpu_time_us":948,"prepare.run_wall_time_us":18234,"raft.queue_time_us":1757,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":1958,"replication_time_us":13420}]]}
I20260505 20:13:37.465503 8557 raft_consensus.cc:493] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.465629 8557 raft_consensus.cc:515] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.466353 8557 leader_election.cc:290] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.469007 8940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.33.212:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.33.254:38755,127.7.33.253:39345,127.7.33.252:42521
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.33.254:38755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.33.254
--webserver_port=35921
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 54bc0b0cb7454006e6380e476f063224cfe77156
build type FASTDEBUG
built by None at 05 May 2026 19:49:25 UTC on bdcb31816ec0
build id 11762
ASAN enabled
W20260505 20:13:37.472108 7406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 281) took 2963 ms (client timeout 1000 ms). Trace:
W20260505 20:13:37.472319 7406 rpcz_store.cc:269] 0505 20:13:34.508404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.607564 (+ 99160us) service_pool.cc:224] Handling call
0505 20:13:34.645182 (+ 37618us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:37.471916 (+2826734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30582,"reported_tablets":192,"spinlock_wait_cycles":71043328}
I20260505 20:13:37.476459 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 69) took 2796 ms. Trace:
I20260505 20:13:37.476569 7407 rpcz_store.cc:276] 0505 20:13:34.680273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.442749 (+2762476us) service_pool.cc:224] Handling call
0505 20:13:37.462318 (+ 19569us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.463160 (+ 842us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.476081 (+ 12921us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.476087 (+ 6us) write_op.cc:454] Released schema lock
0505 20:13:37.476166 (+ 79us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.476299 (+ 133us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.476391 (+ 92us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.463826 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.463954 (+ 128us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.463961 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:37.463963 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.464066 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.464084 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.464092 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.464184 (+ 92us) tablet.cc:701] Row locks acquired
0505 20:13:37.464186 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:37.464226 (+ 40us) write_op.cc:270] Start()
0505 20:13:37.464265 (+ 39us) write_op.cc:276] Timestamp: P: 1778012017464226 usec, L: 0
0505 20:13:37.464271 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.464506 (+ 235us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.470012 (+ 5506us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.470444 (+ 432us) write_op.cc:301] APPLY: starting
0505 20:13:37.470468 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.470532 (+ 64us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.470592 (+ 60us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.470747 (+ 155us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.470799 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.470810 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:37.470915 (+ 105us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.470993 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.471023 (+ 30us) write_op.cc:454] Released schema lock
0505 20:13:37.471032 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":341,"apply.run_cpu_time_us":666,"apply.run_wall_time_us":665,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":804,"prepare.run_wall_time_us":804,"raft.queue_time_us":1392,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":350,"replication_time_us":5708}]]}
I20260505 20:13:37.477313 9047 raft_consensus.cc:515] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.478163 9047 leader_election.cc:290] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.478565 7935 raft_consensus.cc:2468] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.479023 9219 raft_consensus.cc:515] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.479827 9219 leader_election.cc:290] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.486222 8940 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260505 20:13:37.486341 9271 ts_tablet_manager.cc:1929] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:37.486455 9271 log.cc:1199] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/7766caea43904162a2c289b7b17405d4
I20260505 20:13:37.486790 9271 ts_tablet_manager.cc:1950] T 7766caea43904162a2c289b7b17405d4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:37.457264 7412 rpcz_store.cc:269] 0505 20:13:34.767059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.774811 (+ 7752us) service_pool.cc:224] Handling call
0505 20:13:34.794281 (+ 19470us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:35.916480 (+1122199us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:35.916486 (+ 6us) write_op.cc:454] Released schema lock
0505 20:13:36.066462 (+149976us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x61b0002e73e8. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d95a2568 00007f70d959d921 00007f70d9598271 00007f70d973e4e7 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:37.457045 (+1390583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:35.907915 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:35.908070 (+ 155us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:35.908079 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:35.908083 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:35.908211 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:35.908230 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:35.908237 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:35.908318 (+ 81us) tablet.cc:701] Row locks acquired
0505 20:13:35.908322 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:35.908361 (+ 39us) write_op.cc:270] Start()
0505 20:13:35.908402 (+ 41us) write_op.cc:276] Timestamp: P: 1778012015908348 usec, L: 0
0505 20:13:35.908408 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:35.908606 (+ 198us) log.cc:844] Serialized 356 byte log entry
0505 20:13:35.913241 (+ 4635us) op_driver.cc:464] REPLICATION: finished
0505 20:13:35.913370 (+ 129us) write_op.cc:301] APPLY: starting
0505 20:13:35.913389 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:35.913447 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:35.913503 (+ 56us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:35.913589 (+ 86us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:35.913643 (+ 54us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:35.913653 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:35.913768 (+ 115us) log.cc:844] Serialized 23 byte log entry
0505 20:13:35.913846 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:35.913882 (+ 36us) write_op.cc:454] Released schema lock
0505 20:13:35.913892 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":216841,"reported_tablets":199,"spinlock_wait_cycles":376531584,"child_traces":[["op",{"apply.queue_time_us":78,"apply.run_cpu_time_us":582,"apply.run_wall_time_us":581,"num_ops":1,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":826,"prepare.run_wall_time_us":826,"raft.queue_time_us":1328,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":274,"replication_time_us":4794}]]}
I20260505 20:13:37.487766 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_362dc1330af04a4aaecae1384b4a78be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:37.488430 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_362dc1330af04a4aaecae1384b4a78be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.488979 8940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260505 20:13:37.488979 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 82) took 1673 ms. Trace:
I20260505 20:13:37.489082 9121 rpcz_store.cc:276] 0505 20:13:35.809852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.809928 (+ 76us) service_pool.cc:224] Handling call
0505 20:13:37.194336 (+1384408us) ts_tablet_manager.cc:1151] Deleting tablet f62626fb4f8445e3a6e2822277181762
0505 20:13:37.194369 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:37.295789 (+101420us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:37.392889 (+ 97100us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:37.483657 (+ 90768us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384243}
I20260505 20:13:37.489522 9121 tablet_replica.cc:333] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:37.489728 9121 raft_consensus.cc:2243] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:37.490149 9121 raft_consensus.cc:2272] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:37.490872 9121 ts_tablet_manager.cc:1916] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:37.494329 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f62626fb4f8445e3a6e2822277181762 (table default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]) successfully deleted
I20260505 20:13:37.496163 7405 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_0eba07c811e94f2087287b9d563b1182"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:37.497309 7405 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0eba07c811e94f2087287b9d563b1182 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.500011 7625 tablet_service.cc:1558] Processing DeleteTablet for tablet 089517a7c2214dce9367b21beb555733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.500121 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet d3cd1b7b0456462a80d653dd442589a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.500011 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f1505e592e543cca92d8949bdae007e with delete_type TABLET_DATA_DELETED (replaced by tablet 5b3595eb9b1144d9b802f1f563d01461) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.500344 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 48cce2fd271641ad83c9b3e4beeb12ee with delete_type TABLET_DATA_DELETED (replaced by tablet a114db19f63346d9a67e9e3a8225caa4) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.501255 7411 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 245) took 3527 ms (client timeout 1000 ms). Trace:
W20260505 20:13:37.501402 7411 rpcz_store.cc:269] 0505 20:13:33.974140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:34.379254 (+405114us) service_pool.cc:224] Handling call
0505 20:13:37.501193 (+3121939us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:34.946150 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:34.946289 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:34.946296 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:34.946298 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:34.946426 (+ 128us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:34.946441 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:34.946446 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:34.946562 (+ 116us) tablet.cc:701] Row locks acquired
0505 20:13:34.946564 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:34.946606 (+ 42us) write_op.cc:270] Start()
0505 20:13:34.946643 (+ 37us) write_op.cc:276] Timestamp: P: 1778012014946622 usec, L: 0
0505 20:13:34.946647 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:34.946862 (+ 215us) log.cc:844] Serialized 907 byte log entry
0505 20:13:34.950006 (+ 3144us) op_driver.cc:464] REPLICATION: finished
0505 20:13:34.950168 (+ 162us) write_op.cc:301] APPLY: starting
0505 20:13:34.950187 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:34.950243 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:34.950267 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:34.950341 (+ 74us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:34.950377 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:34.950384 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:34.950462 (+ 78us) log.cc:844] Serialized 29 byte log entry
0505 20:13:34.950532 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.950555 (+ 23us) write_op.cc:454] Released schema lock
0505 20:13:34.950562 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:34.950657 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:34.950663 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127571,"reported_tablets":184,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":471,"apply.run_wall_time_us":470,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":843,"prepare.run_wall_time_us":843,"raft.queue_time_us":882,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"replication_time_us":3321}]]}
I20260505 20:13:37.505668 7406 master_service.cc:954] ReplaceTablet: received request to replace tablet aa0b05546a4f47aea5fae1cf767b762d from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:37.507139 7412 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 73) took 2693 ms. Trace:
I20260505 20:13:37.507266 7412 rpcz_store.cc:276] 0505 20:13:34.813125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.487462 (+2674337us) service_pool.cc:224] Handling call
0505 20:13:37.488538 (+ 1076us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.495191 (+ 6653us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.506855 (+ 11664us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.506978 (+ 123us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.507078 (+ 100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.495958 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.496138 (+ 180us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.496152 (+ 14us) write_op.cc:435] Acquired schema lock
0505 20:13:37.496157 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:37.496295 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.496315 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.496322 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.496448 (+ 126us) tablet.cc:701] Row locks acquired
0505 20:13:37.496453 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:37.496509 (+ 56us) write_op.cc:270] Start()
0505 20:13:37.496551 (+ 42us) write_op.cc:276] Timestamp: P: 1778012017496517 usec, L: 0
0505 20:13:37.496554 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.496803 (+ 249us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.504003 (+ 7200us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.504198 (+ 195us) write_op.cc:301] APPLY: starting
0505 20:13:37.504222 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.504287 (+ 65us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.504336 (+ 49us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.504498 (+ 162us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.504550 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.504562 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:37.504665 (+ 103us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.504745 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.504768 (+ 23us) write_op.cc:454] Released schema lock
0505 20:13:37.504778 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.504876 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.504882 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":666,"apply.run_wall_time_us":664,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":1000,"prepare.run_wall_time_us":1001,"raft.queue_time_us":539,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":326,"replication_time_us":7408}]]}
I20260505 20:13:37.509706 7411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_310113e02213479799b9a6ad43d88687"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:37.510543 7411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_310113e02213479799b9a6ad43d88687 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.519140 9207 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.519312 9207 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.519503 7405 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 70) took 2839 ms. Trace:
I20260505 20:13:37.519997 9207 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.519605 7405 rpcz_store.cc:276] 0505 20:13:34.680376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.465286 (+2784910us) service_pool.cc:224] Handling call
0505 20:13:37.497451 (+ 32165us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.498004 (+ 553us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.519185 (+ 21181us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.519298 (+ 113us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.519429 (+ 131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.499103 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.499223 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.499231 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:37.499233 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.499332 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.499344 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.499348 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.499441 (+ 93us) tablet.cc:701] Row locks acquired
0505 20:13:37.499443 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:37.499481 (+ 38us) write_op.cc:270] Start()
0505 20:13:37.499517 (+ 36us) write_op.cc:276] Timestamp: P: 1778012017499495 usec, L: 0
0505 20:13:37.499520 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.499698 (+ 178us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.518245 (+ 18547us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.518470 (+ 225us) write_op.cc:301] APPLY: starting
0505 20:13:37.518494 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.518561 (+ 67us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.518609 (+ 48us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.518798 (+ 189us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.518850 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.518861 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:37.518965 (+ 104us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.519051 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.519079 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:37.519090 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.519191 (+ 101us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.519198 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":160,"apply.run_cpu_time_us":709,"apply.run_wall_time_us":708,"num_ops":2,"prepare.queue_time_us":384,"prepare.run_cpu_time_us":696,"prepare.run_wall_time_us":697,"raft.queue_time_us":64,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":18680}]]}
I20260505 20:13:37.520485 7405 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_bdbb2d2d9d3a41e78b2984438918dce3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:37.521219 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.521935 7870 leader_election.cc:343] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:37.522269 7405 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdbb2d2d9d3a41e78b2984438918dce3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.527576 7406 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet aa0b05546a4f47aea5fae1cf767b762d
I20260505 20:13:37.528116 9047 raft_consensus.cc:493] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.528263 9047 raft_consensus.cc:515] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.528952 9047 leader_election.cc:290] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.529731 7406 catalog_manager.cc:6741] ReplaceTablet: tablet aa0b05546a4f47aea5fae1cf767b762d deleted and replaced by tablet cb672b1dfe7e4ed6ab9e73d328349238
I20260505 20:13:37.529974 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0b05546a4f47aea5fae1cf767b762d with delete_type TABLET_DATA_DELETED (replaced by tablet cb672b1dfe7e4ed6ab9e73d328349238) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.530128 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0b05546a4f47aea5fae1cf767b762d with delete_type TABLET_DATA_DELETED (replaced by tablet cb672b1dfe7e4ed6ab9e73d328349238) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.530418 7406 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 71) took 2776 ms. Trace:
I20260505 20:13:37.530544 7406 rpcz_store.cc:276] 0505 20:13:34.753627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.472796 (+2719169us) service_pool.cc:224] Handling call
0505 20:13:37.530376 (+ 57580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.512334 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.512461 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.512466 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:37.512468 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.512615 (+ 147us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.512625 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.512630 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.512732 (+ 102us) tablet.cc:701] Row locks acquired
0505 20:13:37.512737 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:37.512790 (+ 53us) write_op.cc:270] Start()
0505 20:13:37.512833 (+ 43us) write_op.cc:276] Timestamp: P: 1778012017512806 usec, L: 0
0505 20:13:37.512838 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.513069 (+ 231us) log.cc:844] Serialized 625 byte log entry
0505 20:13:37.526438 (+ 13369us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.526750 (+ 312us) write_op.cc:301] APPLY: starting
0505 20:13:37.526771 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.526814 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.526845 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.526948 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.527007 (+ 59us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:37.527014 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.527088 (+ 74us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.527147 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.527166 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:37.527174 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.527263 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.527267 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":499,"apply.run_wall_time_us":499,"num_ops":2,"prepare.queue_time_us":5507,"prepare.run_cpu_time_us":860,"prepare.run_wall_time_us":859,"raft.queue_time_us":891,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":13570}]]}
I20260505 20:13:37.531484 7406 master_service.cc:954] ReplaceTablet: received request to replace tablet 1f317f62391b422db2bf2a97ef928f99 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:37.531503 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0b05546a4f47aea5fae1cf767b762d with delete_type TABLET_DATA_DELETED (replaced by tablet cb672b1dfe7e4ed6ab9e73d328349238) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.532598 7411 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 74) took 2575 ms. Trace:
W20260505 20:13:37.532874 7397 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e2c99f02ea514a2581f0697dc3ef6461 consensus state has no leader
I20260505 20:13:37.532713 7411 rpcz_store.cc:276] 0505 20:13:34.957033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.509453 (+2552420us) service_pool.cc:224] Handling call
0505 20:13:37.510674 (+ 1221us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.511182 (+ 508us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.531765 (+ 20583us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.531906 (+ 141us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.532522 (+ 616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.513235 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.513389 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.513398 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:37.513402 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:37.513509 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.513521 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.513528 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.513641 (+ 113us) tablet.cc:701] Row locks acquired
0505 20:13:37.513645 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.513679 (+ 34us) write_op.cc:270] Start()
0505 20:13:37.513710 (+ 31us) write_op.cc:276] Timestamp: P: 1778012017513699 usec, L: 0
0505 20:13:37.513716 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.513931 (+ 215us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.526510 (+ 12579us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.527334 (+ 824us) write_op.cc:301] APPLY: starting
0505 20:13:37.527344 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.527376 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.527409 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.527508 (+ 99us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.527536 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.527543 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.527606 (+ 63us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.527648 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.527661 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:37.527666 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":790,"apply.run_cpu_time_us":384,"apply.run_wall_time_us":384,"num_ops":2,"prepare.queue_time_us":1590,"prepare.run_cpu_time_us":792,"prepare.run_wall_time_us":921,"raft.queue_time_us":105,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":12777,"threads_started":1}]]}
I20260505 20:13:37.545468 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet faf3775c154742c5804daf8ade2ad854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.547487 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:37.547669 7928 raft_consensus.cc:3060] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.548445 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bebda2a5c5a4c43a244504837cf0923" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.548595 7933 raft_consensus.cc:2468] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:37.551738 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.477437 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_74794425f97a418ab4f09ff2f3600476"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:37.553800 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74794425f97a418ab4f09ff2f3600476 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.555356 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bd562fea64fe69db2b4a6085b7bed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:37.555608 7660 raft_consensus.cc:3060] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.566802 8058 tablet_bootstrap.cc:492] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.566962 8058 ts_tablet_manager.cc:1403] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.380s user 0.019s sys 0.047s
I20260505 20:13:37.567811 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:37.568188 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bebda2a5c5a4c43a244504837cf0923" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.568368 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089517a7c2214dce9367b21beb555733" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.568540 7795 raft_consensus.cc:2468] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:37.569077 7411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_3efc97c4caca4799aeb91b8bc937a6e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:37.569849 7411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3efc97c4caca4799aeb91b8bc937a6e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.570389 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:37.571905 7660 raft_consensus.cc:2468] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:37.573237 7596 leader_election.cc:343] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.567706 8058 raft_consensus.cc:359] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.573788 9150 consensus_queue.cc:1048] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:37.574167 7596 leader_election.cc:343] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.575309 7596 leader_election.cc:304] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:37.575587 7596 leader_election.cc:343] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.575989 9028 raft_consensus.cc:2804] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.576069 9028 raft_consensus.cc:493] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.576135 9028 raft_consensus.cc:3060] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.576081 9190 consensus_queue.cc:1048] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.576326 9242 raft_consensus.cc:2749] T bda4fd8b0f214da7a1e8b944e1820c0c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.579809 7928 raft_consensus.cc:2468] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.580744 7405 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 75) took 2600 ms. Trace:
I20260505 20:13:37.581264 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089517a7c2214dce9367b21beb555733" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.580852 7405 rpcz_store.cc:276] 0505 20:13:34.980137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.520276 (+2540139us) service_pool.cc:224] Handling call
0505 20:13:37.522401 (+ 2125us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.522988 (+ 587us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.580427 (+ 57439us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.580551 (+ 124us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.580681 (+ 130us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.523566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.523714 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.523722 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:37.523726 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:37.523841 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.523855 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.523863 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.523958 (+ 95us) tablet.cc:701] Row locks acquired
0505 20:13:37.523962 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.524004 (+ 42us) write_op.cc:270] Start()
0505 20:13:37.524043 (+ 39us) write_op.cc:276] Timestamp: P: 1778012017524026 usec, L: 0
0505 20:13:37.524050 (+ 7us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.524261 (+ 211us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.574494 (+ 50233us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.575371 (+ 877us) write_op.cc:301] APPLY: starting
0505 20:13:37.575392 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.575451 (+ 59us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.575518 (+ 67us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.575693 (+ 175us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.575734 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.575741 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.575837 (+ 96us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.575917 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.575942 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:37.575950 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.576033 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.576037 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":793,"apply.run_cpu_time_us":660,"apply.run_wall_time_us":660,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":831,"prepare.run_wall_time_us":923,"raft.queue_time_us":48,"raft.run_cpu_time_us":19,"raft.run_wall_time_us":20,"replication_time_us":50408}]]}
I20260505 20:13:37.581621 7405 master_service.cc:954] ReplaceTablet: received request to replace tablet d27febef8234419caa855dd7a180fe8f from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:37.582623 7736 leader_election.cc:304] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:37.582876 9047 raft_consensus.cc:2804] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.582981 9047 raft_consensus.cc:697] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:37.583200 9047 consensus_queue.cc:237] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.584283 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:37.584467 7935 raft_consensus.cc:3060] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:37.587232 7869 leader_election.cc:343] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.587379 7869 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.588227 9135 raft_consensus.cc:2749] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.588376 9135 raft_consensus.cc:493] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.588470 9135 raft_consensus.cc:515] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.589015 9135 leader_election.cc:290] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.589242 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579bd562fea64fe69db2b4a6085b7bed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:37.589396 7929 raft_consensus.cc:3060] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.582475 7598 leader_election.cc:304] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:37.594719 9286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:37.594038 8058 raft_consensus.cc:385] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.595026 8058 raft_consensus.cc:740] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:37.595310 9283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:37.595224 8058 consensus_queue.cc:260] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.595925 8058 ts_tablet_manager.cc:1434] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260505 20:13:37.596195 8058 tablet_bootstrap.cc:492] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.598471 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 624398f68961440f8369a7859b0724c4 with delete_type TABLET_DATA_DELETED (replaced by tablet f6eaa274f7ef4cd6b9752f14b143ab6c) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.598924 9150 raft_consensus.cc:2804] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.599061 9150 raft_consensus.cc:697] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:37.599303 9150 consensus_queue.cc:237] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.600610 7598 leader_election.cc:304] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:37.606208 7409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 246) took 2616 ms (client timeout 1000 ms). Trace:
I20260505 20:13:37.601684 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1323c894d742909e2add9b8f7e2577" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.606745 9190 raft_consensus.cc:2804] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.606827 9190 raft_consensus.cc:493] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.606892 9190 raft_consensus.cc:3060] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.601681 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 506b421a774c4929813205dba0fac32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:37.607450 7870 leader_election.cc:343] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.616305 8053 tablet_bootstrap.cc:492] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.616529 8053 ts_tablet_manager.cc:1403] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.228s user 0.019s sys 0.023s
I20260505 20:13:37.617249 8053 raft_consensus.cc:359] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.618532 8054 tablet_bootstrap.cc:492] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.619801 8053 raft_consensus.cc:385] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.620409 8053 raft_consensus.cc:740] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.621495 8053 consensus_queue.cc:260] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.623311 8053 ts_tablet_manager.cc:1434] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:37.625165 9293 tablet.cc:1724] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:37.626348 8053 tablet_bootstrap.cc:492] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.618973 8054 ts_tablet_manager.cc:1403] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.173s user 0.020s sys 0.027s
I20260505 20:13:37.628334 9219 consensus_queue.cc:1048] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.630692 8053 tablet_bootstrap.cc:654] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:37.639312 7737 leader_election.cc:343] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 089517a7c2214dce9367b21beb555733
I20260505 20:13:37.639602 7598 leader_election.cc:304] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:37.640759 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1323c894d742909e2add9b8f7e2577" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.640858 9150 raft_consensus.cc:2804] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.641114 9150 raft_consensus.cc:697] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:37.641413 9150 consensus_queue.cc:237] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:37.644239 7869 leader_election.cc:343] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.644372 7869 leader_election.cc:304] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.644758 9207 raft_consensus.cc:2749] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:37.644364 7598 leader_election.cc:343] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 089517a7c2214dce9367b21beb555733
I20260505 20:13:37.646482 8054 raft_consensus.cc:359] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.648924 8054 raft_consensus.cc:385] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.651252 8054 raft_consensus.cc:740] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.653873 8054 consensus_queue.cc:260] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.654480 8054 ts_tablet_manager.cc:1434] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260505 20:13:37.658473 8058 tablet_bootstrap.cc:654] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:37.658891 9289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260505 20:13:37.667898 8054 tablet_bootstrap.cc:492] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.650449 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 72) took 2837 ms. Trace:
I20260505 20:13:37.650503 7405 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet d27febef8234419caa855dd7a180fe8f
I20260505 20:13:37.669687 8940 server_base.cc:1061] running on GCE node
I20260505 20:13:37.670444 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet d27febef8234419caa855dd7a180fe8f with delete_type TABLET_DATA_DELETED (replaced by tablet 0413d400b0f543509d2e68cb8d0ffdbd) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.670522 9121 ts_tablet_manager.cc:1929] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:37.670531 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet d27febef8234419caa855dd7a180fe8f with delete_type TABLET_DATA_DELETED (replaced by tablet 0413d400b0f543509d2e68cb8d0ffdbd) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.670642 9121 log.cc:1199] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/949fecb197084426b5a6adb959f5c886
I20260505 20:13:37.670984 9121 ts_tablet_manager.cc:1950] T 949fecb197084426b5a6adb959f5c886 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:37.670960 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet d27febef8234419caa855dd7a180fe8f with delete_type TABLET_DATA_DELETED (replaced by tablet 0413d400b0f543509d2e68cb8d0ffdbd) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.671161 7405 catalog_manager.cc:6741] ReplaceTablet: tablet d27febef8234419caa855dd7a180fe8f deleted and replaced by tablet 0413d400b0f543509d2e68cb8d0ffdbd
W20260505 20:13:37.671213 8989 consensus_meta.cc:287] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.629s user 0.003s sys 0.000s
I20260505 20:13:37.671331 8989 raft_consensus.cc:2749] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.671329 7405 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 78) took 2581 ms. Trace:
I20260505 20:13:37.671640 7929 raft_consensus.cc:2468] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:37.671473 7405 rpcz_store.cc:276] 0505 20:13:35.090180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.581528 (+2491348us) service_pool.cc:224] Handling call
0505 20:13:37.671261 (+ 89733us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.610886 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.611011 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.611018 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:37.611022 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:37.611158 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.611170 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.611176 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.611259 (+ 83us) tablet.cc:701] Row locks acquired
0505 20:13:37.611262 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:37.611297 (+ 35us) write_op.cc:270] Start()
0505 20:13:37.611326 (+ 29us) write_op.cc:276] Timestamp: P: 1778012017611353 usec, L: 0
0505 20:13:37.611332 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.611480 (+ 148us) log.cc:844] Serialized 625 byte log entry
0505 20:13:37.618019 (+ 6539us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.618663 (+ 644us) write_op.cc:301] APPLY: starting
0505 20:13:37.618672 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.618702 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.618727 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.618800 (+ 73us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.618840 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:37.618846 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:37.618927 (+ 81us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.618961 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.618975 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:37.618980 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.619029 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.619033 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":614,"apply.run_cpu_time_us":361,"apply.run_wall_time_us":361,"mutex_wait_us":7634,"num_ops":2,"prepare.queue_time_us":11197,"prepare.run_cpu_time_us":684,"prepare.run_wall_time_us":948,"raft.queue_time_us":32,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":6671}]]}
I20260505 20:13:37.671924 8940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260505 20:13:37.672300 7405 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_7addbcf649804fb18c9e05e383a4e3c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:37.673234 9271 tablet_replica.cc:333] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:37.673458 9271 raft_consensus.cc:2243] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:37.673607 9271 raft_consensus.cc:2272] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:37.673799 7405 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7addbcf649804fb18c9e05e383a4e3c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.675541 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]) successfully deleted
W20260505 20:13:37.675822 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f0ca8cc557674992b88f3379cc1db652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0ca8cc557674992b88f3379cc1db652 already in progress: creating tablet
W20260505 20:13:37.676036 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 944eaa335fcf49be975baee21c715642 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 944eaa335fcf49be975baee21c715642 already in progress: creating tablet
I20260505 20:13:37.676383 8054 tablet_bootstrap.cc:654] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.676739 7407 rpcz_store.cc:276] 0505 20:13:34.812998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.477158 (+2664160us) service_pool.cc:224] Handling call
0505 20:13:37.553940 (+ 76782us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.554546 (+ 606us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.614945 (+ 60399us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.614951 (+ 6us) write_op.cc:454] Released schema lock
0505 20:13:37.615025 (+ 74us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.650229 (+ 35204us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.650371 (+ 142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.607290 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.607502 (+ 212us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.607512 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:37.607520 (+ 8us) tablet.cc:662] Decoding operations
0505 20:13:37.607657 (+ 137us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.607681 (+ 24us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.607688 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.607805 (+ 117us) tablet.cc:701] Row locks acquired
0505 20:13:37.607809 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.607857 (+ 48us) write_op.cc:270] Start()
0505 20:13:37.607904 (+ 47us) write_op.cc:276] Timestamp: P: 1778012017607911 usec, L: 0
0505 20:13:37.607910 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.608166 (+ 256us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.614207 (+ 6041us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.614295 (+ 88us) write_op.cc:301] APPLY: starting
0505 20:13:37.614311 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.614359 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.614384 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.614497 (+ 113us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.614541 (+ 44us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.614549 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:37.614622 (+ 73us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.614685 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.614703 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:37.614712 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":30,"apply.run_cpu_time_us":479,"apply.run_wall_time_us":479,"num_ops":2,"prepare.queue_time_us":52089,"prepare.run_cpu_time_us":1051,"prepare.run_wall_time_us":2353,"raft.queue_time_us":424,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":269,"replication_time_us":6270}]]}
I20260505 20:13:37.678104 9028 raft_consensus.cc:515] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.678579 8053 tablet_bootstrap.cc:492] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.678640 7658 raft_consensus.cc:2393] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:37.678704 8053 ts_tablet_manager.cc:1403] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.000s
I20260505 20:13:37.677510 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_9f99b5810baf4d94b7f7adab9e3f67f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:37.678941 9028 leader_election.cc:290] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:37.679214 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f99b5810baf4d94b7f7adab9e3f67f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:37.679445 8053 raft_consensus.cc:359] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.679585 8053 raft_consensus.cc:385] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.679626 8053 raft_consensus.cc:740] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.679796 8053 consensus_queue.cc:260] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.680503 8053 ts_tablet_manager.cc:1434] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:37.680755 8053 tablet_bootstrap.cc:492] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.682226 9271 ts_tablet_manager.cc:1916] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:37.682379 8053 tablet_bootstrap.cc:654] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:37.682574 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet feef367085954816b312d4f1cdd80b1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet feef367085954816b312d4f1cdd80b1d already in progress: creating tablet
I20260505 20:13:37.683022 7405 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 79) took 2561 ms. Trace:
I20260505 20:13:37.683133 7405 rpcz_store.cc:276] 0505 20:13:35.121266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.672088 (+2550822us) service_pool.cc:224] Handling call
0505 20:13:37.673901 (+ 1813us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.674366 (+ 465us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.682792 (+ 8426us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.682894 (+ 102us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.682984 (+ 90us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.675429 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.675552 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.675561 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:37.675566 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:37.675685 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.675699 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.675703 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.675801 (+ 98us) tablet.cc:701] Row locks acquired
0505 20:13:37.675805 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.675849 (+ 44us) write_op.cc:270] Start()
0505 20:13:37.675885 (+ 36us) write_op.cc:276] Timestamp: P: 1778012017675932 usec, L: 0
0505 20:13:37.675888 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.676111 (+ 223us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.680505 (+ 4394us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.680624 (+ 119us) write_op.cc:301] APPLY: starting
0505 20:13:37.680640 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.680684 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.680719 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.680827 (+ 108us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.680864 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.680872 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:37.680952 (+ 80us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.681020 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.681042 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:37.681048 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.681118 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.681121 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":74,"apply.run_cpu_time_us":483,"apply.run_wall_time_us":483,"num_ops":2,"prepare.queue_time_us":563,"prepare.run_cpu_time_us":811,"prepare.run_wall_time_us":830,"raft.queue_time_us":598,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":316,"replication_time_us":4590,"spinlock_wait_cycles":136960}]]}
I20260505 20:13:37.684494 7405 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_230d8eb90a074722ae79ec83c16b757b" } modify_external_catalogs: true
I20260505 20:13:37.684669 7405 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_230d8eb90a074722ae79ec83c16b757b" } modify_external_catalogs: true
I20260505 20:13:37.650885 7411 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 77) took 2577 ms. Trace:
I20260505 20:13:37.685446 7411 rpcz_store.cc:276] 0505 20:13:35.073911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.533510 (+2459599us) service_pool.cc:224] Handling call
0505 20:13:37.568982 (+ 35472us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9741b13 00007f70d01d57c6 00007f70d01d54f5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:37.569987 (+ 1005us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.570582 (+ 595us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.618628 (+ 48046us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.650716 (+ 32088us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.650821 (+ 105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.609681 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.609844 (+ 163us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.609852 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:37.609860 (+ 8us) tablet.cc:662] Decoding operations
0505 20:13:37.609964 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.609976 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.609984 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.610072 (+ 88us) tablet.cc:701] Row locks acquired
0505 20:13:37.610076 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.610111 (+ 35us) write_op.cc:270] Start()
0505 20:13:37.610146 (+ 35us) write_op.cc:276] Timestamp: P: 1778012017610170 usec, L: 0
0505 20:13:37.610151 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.610348 (+ 197us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.617951 (+ 7603us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.618133 (+ 182us) write_op.cc:301] APPLY: starting
0505 20:13:37.618146 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.618183 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.618227 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.618340 (+ 113us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.618378 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.618386 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:37.618447 (+ 61us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.618500 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.618515 (+ 15us) write_op.cc:454] Released schema lock
0505 20:13:37.618522 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.618601 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.618606 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":80837376,"child_traces":[["op",{"apply.queue_time_us":141,"apply.run_cpu_time_us":460,"apply.run_wall_time_us":460,"mutex_wait_us":36101,"num_ops":2,"prepare.queue_time_us":38516,"prepare.run_cpu_time_us":779,"prepare.run_wall_time_us":1173,"raft.queue_time_us":36,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":7774}]]}
I20260505 20:13:37.686666 7411 master_service.cc:954] ReplaceTablet: received request to replace tablet 56bd0f4254424c979f90da0400e0ec70 from {username='slave'} at 127.0.0.1:39198
W20260505 20:13:37.687054 7404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 258) took 1861 ms (client timeout 1000 ms). Trace:
W20260505 20:13:37.687211 7404 rpcz_store.cc:269] 0505 20:13:35.825454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.925995 (+100541us) service_pool.cc:224] Handling call
0505 20:13:37.687010 (+1761015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68724,"reported_tablets":233}
I20260505 20:13:37.687573 7404 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_5bb1f646bb2b47d8a6a36d6964937b3d" } modify_external_catalogs: true
I20260505 20:13:37.687772 7404 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_5bb1f646bb2b47d8a6a36d6964937b3d" } modify_external_catalogs: true
I20260505 20:13:37.689149 9207 raft_consensus.cc:493] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.689318 9207 raft_consensus.cc:515] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.690023 9207 leader_election.cc:290] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.690742 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d138d27f444f45d28acdc7d72a9649f5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.694859 7737 consensus_peers.cc:597] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 096ca710e3564d4b8db50f29dd56a5d4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:37.695192 8693 consensus_queue.cc:1048] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:37.695322 9156 consensus_queue.cc:1048] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:37.698820 7870 leader_election.cc:343] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.699435 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 80) took 2578 ms. Trace:
I20260505 20:13:37.699536 7407 rpcz_store.cc:276] 0505 20:13:35.121364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.677319 (+2555955us) service_pool.cc:224] Handling call
0505 20:13:37.679307 (+ 1988us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:37.679765 (+ 458us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:37.699062 (+ 19297us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:37.699190 (+ 128us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:37.699375 (+ 185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.689642 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.689784 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.689790 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:37.689792 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.689885 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.689896 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.689901 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.689979 (+ 78us) tablet.cc:701] Row locks acquired
0505 20:13:37.689982 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:37.690014 (+ 32us) write_op.cc:270] Start()
0505 20:13:37.690041 (+ 27us) write_op.cc:276] Timestamp: P: 1778012017690105 usec, L: 0
0505 20:13:37.690044 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.690205 (+ 161us) log.cc:844] Serialized 433 byte log entry
0505 20:13:37.695976 (+ 5771us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.696162 (+ 186us) write_op.cc:301] APPLY: starting
0505 20:13:37.696182 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.696237 (+ 55us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.696284 (+ 47us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.696393 (+ 109us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.696423 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:37.696434 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:37.696500 (+ 66us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.696552 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.696588 (+ 36us) write_op.cc:454] Released schema lock
0505 20:13:37.696594 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.696656 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.696660 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":127,"apply.run_cpu_time_us":491,"apply.run_wall_time_us":489,"num_ops":2,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":653,"prepare.run_wall_time_us":653,"raft.queue_time_us":457,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":5898}]]}
I20260505 20:13:37.700210 7407 master_service.cc:954] ReplaceTablet: received request to replace tablet 7f34a3f1f30b4165a0c60fab482dce36 from {username='slave'} at 127.0.0.1:39198
W20260505 20:13:37.668581 7409 rpcz_store.cc:269] 0505 20:13:34.989307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.058259 (+ 68952us) service_pool.cc:224] Handling call
0505 20:13:35.937563 (+879304us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:35.937575 (+ 12us) write_op.cc:454] Released schema lock
0505 20:13:37.606137 (+1668562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:35.852125 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:35.852289 (+ 164us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:35.852317 (+ 28us) write_op.cc:435] Acquired schema lock
0505 20:13:35.852322 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:35.852462 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:35.852482 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:35.852489 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:35.852593 (+ 104us) tablet.cc:701] Row locks acquired
0505 20:13:35.852598 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:35.852658 (+ 60us) write_op.cc:270] Start()
0505 20:13:35.852696 (+ 38us) write_op.cc:276] Timestamp: P: 1778012015852828 usec, L: 0
0505 20:13:35.852700 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:35.852912 (+ 212us) log.cc:844] Serialized 530 byte log entry
0505 20:13:35.857564 (+ 4652us) op_driver.cc:464] REPLICATION: finished
0505 20:13:35.857735 (+ 171us) write_op.cc:301] APPLY: starting
0505 20:13:35.857774 (+ 39us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:35.857832 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:35.857868 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:35.857953 (+ 85us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:35.858003 (+ 50us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:35.858012 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:35.858120 (+ 108us) log.cc:844] Serialized 23 byte log entry
0505 20:13:35.858208 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:35.858238 (+ 30us) write_op.cc:454] Released schema lock
0505 20:13:35.858247 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0505 20:13:36.217189 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:36.217337 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:36.217344 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:36.217348 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:36.217461 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:36.217477 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:36.217482 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:36.217551 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:36.217554 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:36.217596 (+ 42us) write_op.cc:270] Start()
0505 20:13:36.217632 (+ 36us) write_op.cc:276] Timestamp: P: 1778012016217705 usec, L: 0
0505 20:13:36.217636 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:36.217888 (+ 252us) log.cc:844] Serialized 356 byte log entry
0505 20:13:36.221660 (+ 3772us) op_driver.cc:464] REPLICATION: finished
0505 20:13:36.221861 (+ 201us) write_op.cc:301] APPLY: starting
0505 20:13:36.221884 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:36.221941 (+ 57us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:36.221984 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:36.222052 (+ 68us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:36.222098 (+ 46us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:36.222109 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:36.222211 (+ 102us) log.cc:844] Serialized 23 byte log entry
0505 20:13:36.222270 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.222289 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:36.222295 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:36.222374 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:36.222379 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18289,"reported_tablets":210,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":585,"apply.run_wall_time_us":584,"num_ops":1,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":1044,"prepare.run_wall_time_us":1044,"raft.queue_time_us":1337,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":267,"replication_time_us":4824}],["op",{"apply.queue_time_us":140,"apply.run_cpu_time_us":507,"apply.run_wall_time_us":507,"num_ops":1,"prepare.queue_time_us":81,"prepare.run_cpu_time_us":822,"prepare.run_wall_time_us":822,"raft.queue_time_us":419,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":246,"replication_time_us":3986}]]}
I20260505 20:13:37.703718 7409 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_aa427cba6f1643a9a1e198aa07362d05" } modify_external_catalogs: true
I20260505 20:13:37.703891 7409 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_aa427cba6f1643a9a1e198aa07362d05" } modify_external_catalogs: true
I20260505 20:13:37.705986 8053 tablet_bootstrap.cc:492] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.706153 8053 ts_tablet_manager.cc:1403] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260505 20:13:37.706830 8053 raft_consensus.cc:359] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.706984 8053 raft_consensus.cc:385] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.707046 8053 raft_consensus.cc:740] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.707235 8053 consensus_queue.cc:260] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.715067 8053 ts_tablet_manager.cc:1434] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260505 20:13:37.715088 9207 raft_consensus.cc:493] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.715217 9207 raft_consensus.cc:515] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.716192 9207 leader_election.cc:290] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.718204 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d138d27f444f45d28acdc7d72a9649f5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.719126 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089517a7c2214dce9367b21beb555733" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:37.719278 7797 raft_consensus.cc:3060] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.719476 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.720238 7870 leader_election.cc:343] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.726038 9303 tablet.cc:1724] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:37.727548 8058 tablet_bootstrap.cc:492] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.727667 8058 ts_tablet_manager.cc:1403] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.132s user 0.000s sys 0.003s
I20260505 20:13:37.728750 8058 raft_consensus.cc:359] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.728942 8058 raft_consensus.cc:385] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.728996 8058 raft_consensus.cc:740] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.729177 8058 consensus_queue.cc:260] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.729836 8058 ts_tablet_manager.cc:1434] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:37.730118 8058 tablet_bootstrap.cc:492] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.731768 8058 tablet_bootstrap.cc:654] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.732060 8053 tablet_bootstrap.cc:492] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.732513 8989 raft_consensus.cc:493] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.732632 8989 raft_consensus.cc:515] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.733222 8989 leader_election.cc:290] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.733381 8054 tablet_bootstrap.cc:492] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.733502 8054 ts_tablet_manager.cc:1403] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.001s
I20260505 20:13:37.738400 8054 raft_consensus.cc:359] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.738576 8054 raft_consensus.cc:385] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.738631 8054 raft_consensus.cc:740] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.738818 8054 consensus_queue.cc:260] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.739288 8054 ts_tablet_manager.cc:1434] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20260505 20:13:37.739588 8054 tablet_bootstrap.cc:492] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.741787 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:37.742293 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:37.742563 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:37.742787 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:37.743160 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:37.743295 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:37.743353 8053 tablet_bootstrap.cc:654] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.744611 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]). Expected version 1 got 0
I20260505 20:13:37.744901 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:37.745813 8054 tablet_bootstrap.cc:654] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.745965 8940 hybrid_clock.cc:648] HybridClock initialized: now 1778012017745780 us; error 91 us; skew 500 ppm
I20260505 20:13:37.752027 8054 tablet_bootstrap.cc:492] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.752187 8054 ts_tablet_manager.cc:1403] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:37.746501 8940 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260505 20:13:37.745210 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]). Expected version 1 got 0
I20260505 20:13:37.753628 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:37.754319 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:37.754668 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
W20260505 20:13:37.754891 7869 leader_election.cc:343] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.755040 7869 leader_election.cc:304] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.755093 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:37.755321 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:37.755420 9207 raft_consensus.cc:2749] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.755502 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:37.755707 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:37.755930 7736 leader_election.cc:304] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.756086 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:37.756294 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:37.756714 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:37.757889 8058 tablet_bootstrap.cc:492] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.758015 8058 ts_tablet_manager.cc:1403] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.001s
I20260505 20:13:37.758716 8058 raft_consensus.cc:359] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.758903 8058 raft_consensus.cc:385] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.758957 8058 raft_consensus.cc:740] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.759135 8058 consensus_queue.cc:260] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.759618 8058 ts_tablet_manager.cc:1434] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:37.759866 8058 tablet_bootstrap.cc:492] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.760345 7797 raft_consensus.cc:2468] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.760418 9270 ts_tablet_manager.cc:1929] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:37.760509 9270 log.cc:1199] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/79ce82aca20d44819f28785322e935ae
I20260505 20:13:37.760562 8989 raft_consensus.cc:2749] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.760833 9270 ts_tablet_manager.cc:1950] T 79ce82aca20d44819f28785322e935ae P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:37.764614 7935 raft_consensus.cc:2468] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.765554 8058 tablet_bootstrap.cc:654] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.765720 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 85) took 1955 ms. Trace:
I20260505 20:13:37.765826 9121 rpcz_store.cc:276] 0505 20:13:35.810109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810141 (+ 32us) service_pool.cc:224] Handling call
0505 20:13:37.489435 (+1679294us) ts_tablet_manager.cc:1151] Deleting tablet 949fecb197084426b5a6adb959f5c886
0505 20:13:37.489461 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:37.576681 (+ 87220us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:37.670454 (+ 93773us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:37.765699 (+ 95245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1679137}
I20260505 20:13:37.766206 9121 tablet_replica.cc:333] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:37.766445 9121 raft_consensus.cc:2243] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:37.766472 8054 raft_consensus.cc:359] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.766641 8054 raft_consensus.cc:385] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.770473 9190 raft_consensus.cc:515] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.771248 9190 leader_election.cc:290] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.778633 8053 tablet_bootstrap.cc:492] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.766690 8054 raft_consensus.cc:740] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.778795 8053 ts_tablet_manager.cc:1403] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.000s
I20260505 20:13:37.779628 8053 raft_consensus.cc:359] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.779801 8053 raft_consensus.cc:385] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.779847 8053 raft_consensus.cc:740] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.778909 8054 consensus_queue.cc:260] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.780077 8053 consensus_queue.cc:260] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.780519 8054 ts_tablet_manager.cc:1434] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260505 20:13:37.780839 8054 tablet_bootstrap.cc:492] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.766778 9121 raft_consensus.cc:2272] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:37.785166 9121 ts_tablet_manager.cc:1916] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:37.787269 8053 ts_tablet_manager.cc:1434] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260505 20:13:37.789239 8054 tablet_bootstrap.cc:654] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.790380 9270 tablet_replica.cc:333] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:37.790405 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 79ce82aca20d44819f28785322e935ae (table default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]) successfully deleted
I20260505 20:13:37.790588 9270 raft_consensus.cc:2243] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:37.790911 9270 raft_consensus.cc:2272] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:37.791462 9270 ts_tablet_manager.cc:1916] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:37.792172 7399 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260505 20:13:37.793527 8053 tablet_bootstrap.cc:492] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.793586 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
W20260505 20:13:37.794018 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4816f1ccb82e4641b2dcfe9ce9b55fae already in progress: creating tablet
I20260505 20:13:37.794922 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:37.795143 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:37.795207 8053 tablet_bootstrap.cc:654] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.795378 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:37.795712 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:37.796032 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_af2341b021674fe494cd635374e98c3e [id=3734c4511d224584aeed0efd6bac453d]). Expected version 1 got 0
I20260505 20:13:37.796521 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:37.796679 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:37.797005 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:37.797185 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:37.797406 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:37.797643 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
W20260505 20:13:37.798344 7399 consensus_peers.cc:597] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d -> Peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Couldn't send request to peer 73028cd481e446daa9432a35522a7967. Status: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260505 20:13:37.798890 8940 webserver.cc:492] Webserver started at http://127.7.33.254:35921/ using document root <none> and password file <none>
I20260505 20:13:37.799688 8054 tablet_bootstrap.cc:492] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.799925 8054 ts_tablet_manager.cc:1403] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260505 20:13:37.800120 8940 fs_manager.cc:362] Metadata directory not provided
I20260505 20:13:37.800318 8940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260505 20:13:37.800948 8054 raft_consensus.cc:359] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.802018 8058 tablet_bootstrap.cc:492] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.802201 8058 ts_tablet_manager.cc:1403] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.003s
I20260505 20:13:37.802977 8058 raft_consensus.cc:359] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.803215 8058 raft_consensus.cc:385] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.803328 8058 raft_consensus.cc:740] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.803568 8058 consensus_queue.cc:260] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.804124 8058 ts_tablet_manager.cc:1434] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:37.804482 8058 tablet_bootstrap.cc:492] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.806193 8058 tablet_bootstrap.cc:654] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.806346 8054 raft_consensus.cc:385] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.806474 8054 raft_consensus.cc:740] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.806738 8054 consensus_queue.cc:260] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.807304 8054 ts_tablet_manager.cc:1434] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260505 20:13:37.807639 8054 tablet_bootstrap.cc:492] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.809018 8054 tablet_bootstrap.cc:654] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.813871 8940 fs_manager.cc:714] Time spent opening directory manager: real 0.011s user 0.007s sys 0.000s
I20260505 20:13:37.814841 7411 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 82) took 2579 ms. Trace:
I20260505 20:13:37.815006 7411 rpcz_store.cc:276] 0505 20:13:35.235205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.686531 (+2451326us) service_pool.cc:224] Handling call
0505 20:13:37.814778 (+128247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:37.820053 7406 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 1f317f62391b422db2bf2a97ef928f99
I20260505 20:13:37.820577 7406 catalog_manager.cc:6741] ReplaceTablet: tablet 1f317f62391b422db2bf2a97ef928f99 deleted and replaced by tablet 9b4a8afcd1a64ddeb23a9c91a4060130
I20260505 20:13:37.820701 7406 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 76) took 2775 ms. Trace:
I20260505 20:13:37.820962 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f317f62391b422db2bf2a97ef928f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4a8afcd1a64ddeb23a9c91a4060130) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.820902 7406 rpcz_store.cc:276] 0505 20:13:35.045468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.531388 (+2485920us) service_pool.cc:224] Handling call
0505 20:13:37.571361 (+ 39973us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d974e85b 00007f70d01e2107 00007f70d01e1e35 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:37.820654 (+249293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.812800 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.812945 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.812952 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:37.812954 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.813066 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.813080 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.813085 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.813165 (+ 80us) tablet.cc:701] Row locks acquired
0505 20:13:37.813167 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:37.813206 (+ 39us) write_op.cc:270] Start()
0505 20:13:37.813251 (+ 45us) write_op.cc:276] Timestamp: P: 1778012017813343 usec, L: 0
0505 20:13:37.813255 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.813459 (+ 204us) log.cc:844] Serialized 625 byte log entry
0505 20:13:37.819133 (+ 5674us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.819264 (+ 131us) write_op.cc:301] APPLY: starting
0505 20:13:37.819308 (+ 44us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.819354 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.819379 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.819480 (+ 101us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.819536 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:37.819544 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:37.819615 (+ 71us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.819675 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.819696 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:37.819702 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.819794 (+ 92us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.819799 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":91016448,"child_traces":[["op",{"apply.queue_time_us":83,"apply.run_cpu_time_us":499,"apply.run_wall_time_us":498,"num_ops":2,"prepare.queue_time_us":68,"prepare.run_cpu_time_us":783,"prepare.run_wall_time_us":782,"raft.queue_time_us":459,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":299,"replication_time_us":5849}]]}
I20260505 20:13:37.821663 7406 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_4ea12411a44f4701a2b87ff72c38e8d6" } modify_external_catalogs: true
I20260505 20:13:37.821872 7406 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_4ea12411a44f4701a2b87ff72c38e8d6" } modify_external_catalogs: true
I20260505 20:13:37.823037 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f317f62391b422db2bf2a97ef928f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4a8afcd1a64ddeb23a9c91a4060130) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.823575 8986 raft_consensus.cc:493] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.823711 8986 raft_consensus.cc:515] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.824316 8986 leader_election.cc:290] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.827425 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 7f34a3f1f30b4165a0c60fab482dce36
I20260505 20:13:37.827836 7407 catalog_manager.cc:6741] ReplaceTablet: tablet 7f34a3f1f30b4165a0c60fab482dce36 deleted and replaced by tablet 8ff674539e1045408c212b533ca8a3db
I20260505 20:13:37.827934 7407 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 84) took 2459 ms. Trace:
I20260505 20:13:37.828025 7407 rpcz_store.cc:276] 0505 20:13:35.368053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.700120 (+2332067us) service_pool.cc:224] Handling call
0505 20:13:37.827901 (+127781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.814172 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.814291 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.814297 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:37.814300 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:37.814404 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.814414 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.814419 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.814491 (+ 72us) tablet.cc:701] Row locks acquired
0505 20:13:37.814494 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:37.814522 (+ 28us) write_op.cc:270] Start()
0505 20:13:37.814547 (+ 25us) write_op.cc:276] Timestamp: P: 1778012017814664 usec, L: 0
0505 20:13:37.814550 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.814691 (+ 141us) log.cc:844] Serialized 625 byte log entry
0505 20:13:37.826116 (+ 11425us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.826305 (+ 189us) write_op.cc:301] APPLY: starting
0505 20:13:37.826320 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.826359 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.826391 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.826489 (+ 98us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.826555 (+ 66us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:37.826562 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.826631 (+ 69us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.826692 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.826708 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:37.826714 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.826783 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.826787 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":540,"prepare.run_cpu_time_us":604,"prepare.run_wall_time_us":604,"raft.queue_time_us":2874,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":11537}]]}
I20260505 20:13:37.828810 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9be38cc8ceb7408d9d7853cba373f215" } modify_external_catalogs: true
I20260505 20:13:37.828979 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9be38cc8ceb7408d9d7853cba373f215" } modify_external_catalogs: true
I20260505 20:13:37.829322 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:37.829735 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f34a3f1f30b4165a0c60fab482dce36 with delete_type TABLET_DATA_DELETED (replaced by tablet 8ff674539e1045408c212b533ca8a3db) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:37.830513 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f34a3f1f30b4165a0c60fab482dce36 with delete_type TABLET_DATA_DELETED (replaced by tablet 8ff674539e1045408c212b533ca8a3db) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:37.834887 9190 raft_consensus.cc:493] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.835029 9190 raft_consensus.cc:515] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.835599 9190 leader_election.cc:290] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.836042 8053 tablet_bootstrap.cc:492] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.836198 8053 ts_tablet_manager.cc:1403] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.004s
I20260505 20:13:37.837482 8053 raft_consensus.cc:359] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.837652 8053 raft_consensus.cc:385] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.837715 8053 raft_consensus.cc:740] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.837997 8053 consensus_queue.cc:260] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.838514 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 949fecb197084426b5a6adb959f5c886 (table default.Table_5e2133ac533b4b6084978252a3244509 [id=db04ad55e6964d88bb71e0eab4cc4f65]) successfully deleted
I20260505 20:13:37.839191 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f34a3f1f30b4165a0c60fab482dce36 with delete_type TABLET_DATA_DELETED (replaced by tablet 8ff674539e1045408c212b533ca8a3db) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.839524 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f317f62391b422db2bf2a97ef928f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b4a8afcd1a64ddeb23a9c91a4060130) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:37.840220 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.841223 7870 leader_election.cc:343] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.841341 8053 ts_tablet_manager.cc:1434] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:37.841629 8053 tablet_bootstrap.cc:492] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:37.842623 7308 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 64898.7us
I20260505 20:13:37.843554 8053 tablet_bootstrap.cc:654] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.862926 9322 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260505 20:13:37.871403 8054 tablet_bootstrap.cc:492] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.871949 8054 ts_tablet_manager.cc:1403] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.005s
I20260505 20:13:37.873138 8940 fs_manager.cc:730] Time spent opening block manager: real 0.049s user 0.002s sys 0.003s
I20260505 20:13:37.873390 8940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data,/tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
uuid: "73028cd481e446daa9432a35522a7967"
format_stamp: "Formatted at 2026-05-05 20:13:17 on dist-test-slave-1fq8"
I20260505 20:13:37.874544 8940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260505 20:13:37.878443 8058 tablet_bootstrap.cc:492] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:37.878772 8058 ts_tablet_manager.cc:1403] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.002s
I20260505 20:13:37.880900 8058 raft_consensus.cc:359] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.881196 8058 raft_consensus.cc:385] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.881345 8058 raft_consensus.cc:740] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.881736 8058 consensus_queue.cc:260] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.882510 8053 tablet_bootstrap.cc:492] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.882799 8053 ts_tablet_manager.cc:1403] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.002s
I20260505 20:13:37.883561 8053 raft_consensus.cc:359] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.883718 8053 raft_consensus.cc:385] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.883769 8053 raft_consensus.cc:740] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.883939 8053 consensus_queue.cc:260] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.886194 8058 ts_tablet_manager.cc:1434] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260505 20:13:37.885908 8054 raft_consensus.cc:359] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.887162 8054 raft_consensus.cc:385] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.887832 8054 raft_consensus.cc:740] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.888232 8058 tablet_bootstrap.cc:492] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:37.891094 8053 ts_tablet_manager.cc:1434] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260505 20:13:37.890064 8054 consensus_queue.cc:260] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.891427 8053 tablet_bootstrap.cc:492] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:37.892045 8986 raft_consensus.cc:493] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.892174 8986 raft_consensus.cc:515] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.892789 8986 leader_election.cc:290] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:37.895414 8054 ts_tablet_manager.cc:1434] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260505 20:13:37.898195 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.898536 8054 tablet_bootstrap.cc:492] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:37.899488 7870 leader_election.cc:343] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.899593 8053 tablet_bootstrap.cc:654] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.904978 8058 tablet_bootstrap.cc:654] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.910528 8054 tablet_bootstrap.cc:654] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:37.910957 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506b421a774c4929813205dba0fac32b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:37.911144 7658 raft_consensus.cc:2468] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:37.924506 9242 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.924659 9242 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.926394 9242 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.926136 8054 tablet_bootstrap.cc:492] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:37.926957 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bebda2a5c5a4c43a244504837cf0923" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:37.927099 7801 raft_consensus.cc:3060] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.927318 9207 raft_consensus.cc:493] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.927443 9207 raft_consensus.cc:515] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.928010 9207 leader_election.cc:290] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:37.928555 8054 ts_tablet_manager.cc:1403] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.002s
I20260505 20:13:37.928974 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bdfc75a494635837178cb16c08c1c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.929131 7793 raft_consensus.cc:2468] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:37.930430 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:37.931325 7870 leader_election.cc:343] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.931320 8054 raft_consensus.cc:359] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.931634 8054 raft_consensus.cc:385] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.931751 8054 raft_consensus.cc:740] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.933615 8054 consensus_queue.cc:260] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:37.934158 7802 raft_consensus.cc:3060] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:37.935133 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.935436 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.937333 8054 ts_tablet_manager.cc:1434] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260505 20:13:37.940091 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.940600 8054 tablet_bootstrap.cc:492] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:37.941704 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:37.941974 8053 tablet_bootstrap.cc:492] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:37.943053 9300 tablet.cc:1724] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:37.943418 8053 ts_tablet_manager.cc:1403] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.005s
I20260505 20:13:37.944710 9242 raft_consensus.cc:493] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:37.945170 9242 raft_consensus.cc:515] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.946194 9242 leader_election.cc:290] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:37.946866 7596 leader_election.cc:304] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:37.951313 8557 raft_consensus.cc:2804] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:37.951503 8557 raft_consensus.cc:697] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:37.951869 8557 consensus_queue.cc:237] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:37.954694 7801 raft_consensus.cc:2468] T 6bebda2a5c5a4c43a244504837cf0923 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:37.959983 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:37.960820 9271 ts_tablet_manager.cc:1929] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:37.961012 9271 log.cc:1199] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/79ce82aca20d44819f28785322e935ae
I20260505 20:13:37.961594 9271 ts_tablet_manager.cc:1950] T 79ce82aca20d44819f28785322e935ae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:37.962206 9270 ts_tablet_manager.cc:1929] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:37.962432 9270 log.cc:1199] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/4628e33d204c452ab12acf76f754f2ad
I20260505 20:13:37.963246 9121 ts_tablet_manager.cc:1929] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:37.963450 9121 log.cc:1199] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b8d50ceda0ff4bb6b49920c922dfee9e
I20260505 20:13:37.962389 8053 raft_consensus.cc:359] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:37.963996 9121 ts_tablet_manager.cc:1950] T b8d50ceda0ff4bb6b49920c922dfee9e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:37.964430 8053 raft_consensus.cc:385] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:37.965121 8053 raft_consensus.cc:740] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:37.978071 9270 ts_tablet_manager.cc:1950] T 4628e33d204c452ab12acf76f754f2ad P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:37.985695 7596 leader_election.cc:304] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:37.988474 7869 leader_election.cc:343] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.988657 7869 leader_election.cc:304] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:37.989346 9207 raft_consensus.cc:2749] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.990108 8693 raft_consensus.cc:2804] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:37.990224 8693 raft_consensus.cc:493] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:37.990298 8693 raft_consensus.cc:3060] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:37.991175 7869 leader_election.cc:343] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:37.991285 7869 leader_election.cc:304] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:37.998219 7598 leader_election.cc:343] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 089517a7c2214dce9367b21beb555733
I20260505 20:13:37.999212 9207 raft_consensus.cc:2749] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:37.990317 8053 consensus_queue.cc:260] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.001808 8054 tablet_bootstrap.cc:654] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.019534 8053 ts_tablet_manager.cc:1434] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.074s user 0.004s sys 0.000s
I20260505 20:13:38.019907 8053 tablet_bootstrap.cc:492] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.021032 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:38.021456 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:38.021677 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:38.021960 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:38.022389 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
W20260505 20:13:38.023087 7869 leader_election.cc:343] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.023214 7869 leader_election.cc:304] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:38.023512 8986 raft_consensus.cc:2749] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:38.023943 7737 leader_election.cc:343] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 506b421a774c4929813205dba0fac32b
W20260505 20:13:38.024531 7869 leader_election.cc:343] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.024632 7869 leader_election.cc:304] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:38.024873 9135 raft_consensus.cc:2749] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.027463 8989 raft_consensus.cc:493] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.027599 8989 raft_consensus.cc:515] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.028249 8989 leader_election.cc:290] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.028373 8989 consensus_queue.cc:1048] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.028587 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.028759 7929 raft_consensus.cc:2468] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.031342 8053 tablet_bootstrap.cc:654] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.031308 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:38.031700 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:38.031953 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:38.032656 7412 catalog_manager.cc:5671] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:38.033118 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:38.033403 7412 catalog_manager.cc:5671] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:38.033766 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:38.034116 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:38.034336 7412 catalog_manager.cc:5671] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:38.034690 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:38.035084 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:38.035360 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:38.035660 7412 catalog_manager.cc:5671] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:38.036149 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:38.036935 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:38.037379 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:38.037675 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:38.038378 7737 leader_election.cc:304] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:38.038569 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:38.038650 9047 raft_consensus.cc:2804] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:38.038741 9047 raft_consensus.cc:493] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:38.038811 9047 raft_consensus.cc:3060] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.038859 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:38.042757 8054 tablet_bootstrap.cc:492] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.042924 8054 ts_tablet_manager.cc:1403] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.103s user 0.005s sys 0.001s
I20260505 20:13:38.043762 8054 raft_consensus.cc:359] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.043946 8054 raft_consensus.cc:385] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.044004 8054 raft_consensus.cc:740] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.044229 8054 consensus_queue.cc:260] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.045094 8054 ts_tablet_manager.cc:1434] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:38.045637 8054 tablet_bootstrap.cc:492] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.047528 8053 tablet_bootstrap.cc:492] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.047677 8053 ts_tablet_manager.cc:1403] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260505 20:13:38.048519 8053 raft_consensus.cc:359] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.048699 8053 raft_consensus.cc:385] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.048779 8053 raft_consensus.cc:740] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.049067 8053 consensus_queue.cc:260] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.051676 8054 tablet_bootstrap.cc:654] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.054082 8053 ts_tablet_manager.cc:1434] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:38.054497 8053 tablet_bootstrap.cc:492] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.056325 8053 tablet_bootstrap.cc:654] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.065188 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:38.065366 8053 tablet_bootstrap.cc:492] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.065507 8053 ts_tablet_manager.cc:1403] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260505 20:13:38.066068 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:38.066951 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:38.067409 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:38.067700 7412 catalog_manager.cc:5671] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:38.069235 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:38.070909 8053 raft_consensus.cc:359] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.071110 8053 raft_consensus.cc:385] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.071208 8053 raft_consensus.cc:740] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.072295 8053 consensus_queue.cc:260] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.072858 8053 ts_tablet_manager.cc:1434] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260505 20:13:38.073174 8053 tablet_bootstrap.cc:492] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.076509 9047 raft_consensus.cc:515] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.077527 9047 leader_election.cc:290] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.084654 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 4628e33d204c452ab12acf76f754f2ad (table default.Table_6de073da4783421daab1910cc27d67f7 [id=607b2027efa648778bfe22e03371919e]) successfully deleted
I20260505 20:13:38.085065 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:38.085475 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:38.086320 7412 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_af2341b021674fe494cd635374e98c3e [id=3734c4511d224584aeed0efd6bac453d]). Expected version 1 got 0
I20260505 20:13:38.083119 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:38.088461 7929 raft_consensus.cc:3060] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.095274 8054 tablet_bootstrap.cc:492] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.095429 8054 ts_tablet_manager.cc:1403] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.002s
I20260505 20:13:38.095654 9135 raft_consensus.cc:493] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.095839 9135 raft_consensus.cc:515] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.096246 8054 raft_consensus.cc:359] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.098510 8054 raft_consensus.cc:385] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.098610 8054 raft_consensus.cc:740] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.098747 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:38.098850 8054 consensus_queue.cc:260] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:38.099644 7869 leader_election.cc:343] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.098503 9135 leader_election.cc:290] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.101207 8053 tablet_bootstrap.cc:654] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.101209 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 79ce82aca20d44819f28785322e935ae (table default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]) successfully deleted
I20260505 20:13:38.100360 8054 ts_tablet_manager.cc:1434] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260505 20:13:38.102411 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4816f1ccb82e4641b2dcfe9ce9b55fae already in progress: creating tablet
I20260505 20:13:38.102751 8054 tablet_bootstrap.cc:492] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.102882 9271 tablet_replica.cc:333] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:38.103322 9271 raft_consensus.cc:2243] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:38.103545 9271 raft_consensus.cc:2272] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:38.104326 9271 ts_tablet_manager.cc:1916] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:38.104462 8054 tablet_bootstrap.cc:654] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.107872 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 87) took 2297 ms. Trace:
I20260505 20:13:38.108341 9135 raft_consensus.cc:493] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.108461 9135 raft_consensus.cc:515] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.109337 9135 leader_election.cc:290] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.109928 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:38.110498 7869 leader_election.cc:343] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.108081 9121 rpcz_store.cc:276] 0505 20:13:35.810281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810321 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:37.766115 (+1955794us) ts_tablet_manager.cc:1151] Deleting tablet b8d50ceda0ff4bb6b49920c922dfee9e
0505 20:13:37.766131 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:37.870499 (+104368us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:37.963149 (+ 92650us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:38.107836 (+144687us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1955671}
I20260505 20:13:38.118633 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b8d50ceda0ff4bb6b49920c922dfee9e (table default.Table_4236c5f7709145e588050eb7b3d4ae44 [id=4073d8bcda1046afb42e5be3af1a9acf]) successfully deleted
I20260505 20:13:38.120028 8054 tablet_bootstrap.cc:492] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.120203 8054 ts_tablet_manager.cc:1403] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20260505 20:13:38.121603 8054 raft_consensus.cc:359] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.121872 8054 raft_consensus.cc:385] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.121944 8054 raft_consensus.cc:740] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.122202 8054 consensus_queue.cc:260] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.125964 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.128364 7930 raft_consensus.cc:2393] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:38.128182 9121 tablet_replica.cc:333] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:38.128875 9121 raft_consensus.cc:2243] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:38.129086 9121 raft_consensus.cc:2272] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:38.129146 8054 ts_tablet_manager.cc:1434] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260505 20:13:38.129693 9121 ts_tablet_manager.cc:1916] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:38.134652 8053 tablet_bootstrap.cc:492] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.134814 8053 ts_tablet_manager.cc:1403] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
I20260505 20:13:38.134975 8054 tablet_bootstrap.cc:492] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.135667 8053 raft_consensus.cc:359] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.135869 8053 raft_consensus.cc:385] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.135936 8053 raft_consensus.cc:740] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.136170 8053 consensus_queue.cc:260] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.136704 8053 ts_tablet_manager.cc:1434] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:38.137006 8053 tablet_bootstrap.cc:492] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.138433 8054 tablet_bootstrap.cc:654] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.139117 8053 tablet_bootstrap.cc:654] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.144990 9135 raft_consensus.cc:493] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.145147 9135 raft_consensus.cc:515] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.145798 9135 leader_election.cc:290] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.146227 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:38.146744 7869 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:38.147866 7869 consensus_peers.cc:597] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7766caea43904162a2c289b7b17405d4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:38.000221 8058 tablet_bootstrap.cc:492] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:38.016691 9190 consensus_queue.cc:1048] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.152307 8058 ts_tablet_manager.cc:1403] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.265s user 0.029s sys 0.041s
W20260505 20:13:38.152597 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 154457us
I20260505 20:13:38.017830 9305 consensus_queue.cc:1048] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.028661 7596 leader_election.cc:304] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:38.156265 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 127692us
I20260505 20:13:38.156378 9305 raft_consensus.cc:2804] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:38.156495 9305 raft_consensus.cc:697] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:38.156718 9305 consensus_queue.cc:237] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.158267 9293 tablet.cc:1724] T 50680deff6fe4dcabbf5a3aeb47ac01e P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:38.075995 8693 raft_consensus.cc:515] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.159211 8693 leader_election.cc:290] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.085198 9028 raft_consensus.cc:493] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.159627 9028 raft_consensus.cc:515] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.160185 9028 leader_election.cc:290] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.057356 9270 tablet_replica.cc:333] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:38.017280 9156 consensus_queue.cc:1048] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.164489 8053 tablet_bootstrap.cc:492] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.164664 8053 ts_tablet_manager.cc:1403] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.004s
I20260505 20:13:38.165733 8053 raft_consensus.cc:359] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.166007 8053 raft_consensus.cc:385] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.166081 8053 raft_consensus.cc:740] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.166348 8053 consensus_queue.cc:260] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.166630 9242 raft_consensus.cc:493] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.166838 9242 raft_consensus.cc:515] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.167030 8053 ts_tablet_manager.cc:1434] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:38.167402 8053 tablet_bootstrap.cc:492] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.167683 9242 leader_election.cc:290] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.169579 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 373c03859f5b4fbead92ea1d6d20a5df (DEFAULT_TABLE table=default.Table_3efc97c4caca4799aeb91b8bc937a6e2 [id=e79e8e0b9c5a4a86b6dd9a1fa3b7e804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.153232 8058 raft_consensus.cc:359] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.169826 8058 raft_consensus.cc:385] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.169934 8058 raft_consensus.cc:740] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.170202 8058 consensus_queue.cc:260] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.170718 8058 ts_tablet_manager.cc:1434] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260505 20:13:38.172062 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 53f1318ef5bf439f97de685ae7d6f462 (DEFAULT_TABLE table=default.Table_bdbb2d2d9d3a41e78b2984438918dce3 [id=10cd3e3153354713804ceb88f2fde76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.173491 8053 tablet_bootstrap.cc:654] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.174813 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 373c03859f5b4fbead92ea1d6d20a5df (DEFAULT_TABLE table=default.Table_3efc97c4caca4799aeb91b8bc937a6e2 [id=e79e8e0b9c5a4a86b6dd9a1fa3b7e804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.176573 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 53f1318ef5bf439f97de685ae7d6f462 (DEFAULT_TABLE table=default.Table_bdbb2d2d9d3a41e78b2984438918dce3 [id=10cd3e3153354713804ceb88f2fde76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.177048 7770 tablet_service.cc:1511] Processing CreateTablet for tablet abe467e4f37442c19fcfe54f94e71657 (DEFAULT_TABLE table=default.Table_7addbcf649804fb18c9e05e383a4e3c1 [id=3405f422ae6c4f7e92510dcf5c313795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.180104 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 373c03859f5b4fbead92ea1d6d20a5df (DEFAULT_TABLE table=default.Table_3efc97c4caca4799aeb91b8bc937a6e2 [id=e79e8e0b9c5a4a86b6dd9a1fa3b7e804]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.180200 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 53f1318ef5bf439f97de685ae7d6f462 (DEFAULT_TABLE table=default.Table_bdbb2d2d9d3a41e78b2984438918dce3 [id=10cd3e3153354713804ceb88f2fde76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.180756 7900 tablet_service.cc:1511] Processing CreateTablet for tablet abe467e4f37442c19fcfe54f94e71657 (DEFAULT_TABLE table=default.Table_7addbcf649804fb18c9e05e383a4e3c1 [id=3405f422ae6c4f7e92510dcf5c313795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.182894 7641 tablet_service.cc:1511] Processing CreateTablet for tablet abe467e4f37442c19fcfe54f94e71657 (DEFAULT_TABLE table=default.Table_7addbcf649804fb18c9e05e383a4e3c1 [id=3405f422ae6c4f7e92510dcf5c313795]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.183059 7772 tablet_service.cc:1511] Processing CreateTablet for tablet de7b1e87b754414bb2ef025130ae6b65 (DEFAULT_TABLE table=default.Table_0eba07c811e94f2087287b9d563b1182 [id=2082c5dc5b8d4d2abdbeaf07003f1e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.184499 7917 tablet_service.cc:1511] Processing CreateTablet for tablet de7b1e87b754414bb2ef025130ae6b65 (DEFAULT_TABLE table=default.Table_0eba07c811e94f2087287b9d563b1182 [id=2082c5dc5b8d4d2abdbeaf07003f1e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.184948 7625 tablet_service.cc:1511] Processing CreateTablet for tablet de7b1e87b754414bb2ef025130ae6b65 (DEFAULT_TABLE table=default.Table_0eba07c811e94f2087287b9d563b1182 [id=2082c5dc5b8d4d2abdbeaf07003f1e02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.185310 7781 tablet_service.cc:1511] Processing CreateTablet for tablet c7085351ba8e4c78b684894460cec8e3 (DEFAULT_TABLE table=default.Table_362dc1330af04a4aaecae1384b4a78be [id=d643476d255b4c0c93714063a7cb67e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.186480 7912 tablet_service.cc:1511] Processing CreateTablet for tablet c7085351ba8e4c78b684894460cec8e3 (DEFAULT_TABLE table=default.Table_362dc1330af04a4aaecae1384b4a78be [id=d643476d255b4c0c93714063a7cb67e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.187150 8940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260505 20:13:38.188658 8058 tablet_bootstrap.cc:492] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:38.190436 7629 tablet_service.cc:1511] Processing CreateTablet for tablet c7085351ba8e4c78b684894460cec8e3 (DEFAULT_TABLE table=default.Table_362dc1330af04a4aaecae1384b4a78be [id=d643476d255b4c0c93714063a7cb67e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.190551 8058 tablet_bootstrap.cc:654] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.190872 7777 tablet_service.cc:1511] Processing CreateTablet for tablet 901e7923fc0949bab9442a696c3398eb (DEFAULT_TABLE table=default.Table_310113e02213479799b9a6ad43d88687 [id=370670eb52754b8d9a2348dfbea25087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.192373 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 901e7923fc0949bab9442a696c3398eb (DEFAULT_TABLE table=default.Table_310113e02213479799b9a6ad43d88687 [id=370670eb52754b8d9a2348dfbea25087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.192595 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 901e7923fc0949bab9442a696c3398eb (DEFAULT_TABLE table=default.Table_310113e02213479799b9a6ad43d88687 [id=370670eb52754b8d9a2348dfbea25087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.193881 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 566a6942cc904468a0cab3deae8a860b (DEFAULT_TABLE table=default.Table_8dcfa4ea18414fa5a138d1a90302652c [id=f52e533d485f4345ac75c8f06e50d17d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.195600 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 566a6942cc904468a0cab3deae8a860b (DEFAULT_TABLE table=default.Table_8dcfa4ea18414fa5a138d1a90302652c [id=f52e533d485f4345ac75c8f06e50d17d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.196823 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 566a6942cc904468a0cab3deae8a860b (DEFAULT_TABLE table=default.Table_8dcfa4ea18414fa5a138d1a90302652c [id=f52e533d485f4345ac75c8f06e50d17d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.198338 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 6d805583f5c64ea7a9fe2f658079b5c5 (DEFAULT_TABLE table=default.Table_74794425f97a418ab4f09ff2f3600476 [id=573a8468a590436f90382cb8cccbfc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.200057 8940 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260505 20:13:38.200783 8940 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260505 20:13:38.201257 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 44378.2us
I20260505 20:13:38.203162 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.203498 7930 raft_consensus.cc:2468] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.204037 7737 leader_election.cc:304] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:38.204413 9047 raft_consensus.cc:2804] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:38.204497 9047 raft_consensus.cc:493] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:38.204559 9047 raft_consensus.cc:3060] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.205209 7908 tablet_service.cc:1511] Processing CreateTablet for tablet 6d805583f5c64ea7a9fe2f658079b5c5 (DEFAULT_TABLE table=default.Table_74794425f97a418ab4f09ff2f3600476 [id=573a8468a590436f90382cb8cccbfc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.206152 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.207281 8054 tablet_bootstrap.cc:492] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.207458 8054 ts_tablet_manager.cc:1403] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.005s
I20260505 20:13:38.207749 8053 tablet_bootstrap.cc:492] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.207885 8053 ts_tablet_manager.cc:1403] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.004s
I20260505 20:13:38.208547 8054 raft_consensus.cc:359] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.208710 8053 raft_consensus.cc:359] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.208806 9270 raft_consensus.cc:2243] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:38.208874 8053 raft_consensus.cc:385] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.208793 8054 raft_consensus.cc:385] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.208930 8053 raft_consensus.cc:740] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.208952 8054 raft_consensus.cc:740] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.209059 9270 raft_consensus.cc:2272] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:38.209154 8054 consensus_queue.cc:260] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.209156 8053 consensus_queue.cc:260] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.209633 8053 ts_tablet_manager.cc:1434] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:38.209633 8054 ts_tablet_manager.cc:1434] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:38.209713 9270 ts_tablet_manager.cc:1916] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:38.209937 8053 tablet_bootstrap.cc:492] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.210179 8054 tablet_bootstrap.cc:492] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.212812 7634 tablet_service.cc:1511] Processing CreateTablet for tablet 6d805583f5c64ea7a9fe2f658079b5c5 (DEFAULT_TABLE table=default.Table_74794425f97a418ab4f09ff2f3600476 [id=573a8468a590436f90382cb8cccbfc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.213086 8053 tablet_bootstrap.cc:654] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.213335 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.214380 9242 raft_consensus.cc:493] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.214510 9242 raft_consensus.cc:515] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.215080 9242 leader_election.cc:290] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.215355 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fc0e6ac0fa4f8bbaef2fcf1ecbbd70" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.215524 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.215642 7930 raft_consensus.cc:2468] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.216058 7737 leader_election.cc:304] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:38.216142 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4a8afcd1a64ddeb23a9c91a4060130 (DEFAULT_TABLE table=default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.216576 9242 raft_consensus.cc:2804] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:38.216652 9242 raft_consensus.cc:493] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:38.216709 9242 raft_consensus.cc:3060] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.216866 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4a8afcd1a64ddeb23a9c91a4060130 (DEFAULT_TABLE table=default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.217080 9207 raft_consensus.cc:493] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.217192 9207 raft_consensus.cc:515] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.217888 9207 leader_election.cc:290] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.217846 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4a8afcd1a64ddeb23a9c91a4060130 (DEFAULT_TABLE table=default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.218221 7769 tablet_service.cc:1511] Processing CreateTablet for tablet cb672b1dfe7e4ed6ab9e73d328349238 (DEFAULT_TABLE table=default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.218376 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:38.218842 7869 leader_election.cc:343] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.219317 7907 tablet_service.cc:1511] Processing CreateTablet for tablet cb672b1dfe7e4ed6ab9e73d328349238 (DEFAULT_TABLE table=default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.219733 7626 tablet_service.cc:1511] Processing CreateTablet for tablet cb672b1dfe7e4ed6ab9e73d328349238 (DEFAULT_TABLE table=default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.220799 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 74d5ef7ac5f44d1c9c77e2e50ab2ea5e (DEFAULT_TABLE table=default.Table_9f99b5810baf4d94b7f7adab9e3f67f9 [id=74be77ac179d47baba43f0e825c62f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.221921 7915 tablet_service.cc:1511] Processing CreateTablet for tablet 74d5ef7ac5f44d1c9c77e2e50ab2ea5e (DEFAULT_TABLE table=default.Table_9f99b5810baf4d94b7f7adab9e3f67f9 [id=74be77ac179d47baba43f0e825c62f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.222361 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 74d5ef7ac5f44d1c9c77e2e50ab2ea5e (DEFAULT_TABLE table=default.Table_9f99b5810baf4d94b7f7adab9e3f67f9 [id=74be77ac179d47baba43f0e825c62f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.223762 8054 tablet_bootstrap.cc:654] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.224437 9303 tablet.cc:1724] T 50680deff6fe4dcabbf5a3aeb47ac01e P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:38.224601 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 0413d400b0f543509d2e68cb8d0ffdbd (DEFAULT_TABLE table=default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.226284 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 0413d400b0f543509d2e68cb8d0ffdbd (DEFAULT_TABLE table=default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.227329 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bdfc75a494635837178cb16c08c1c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:38.227360 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 0413d400b0f543509d2e68cb8d0ffdbd (DEFAULT_TABLE table=default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.227486 7793 raft_consensus.cc:3060] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.228358 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff674539e1045408c212b533ca8a3db (DEFAULT_TABLE table=default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.228726 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:38.228950 7802 raft_consensus.cc:2393] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:38.230855 7910 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff674539e1045408c212b533ca8a3db (DEFAULT_TABLE table=default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:38.233464 7870 leader_election.cc:343] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.233453 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff674539e1045408c212b533ca8a3db (DEFAULT_TABLE table=default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:38.233594 7870 leader_election.cc:304] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:38.234055 7870 leader_election.cc:343] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.234157 7870 leader_election.cc:304] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:38.234495 7870 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.234581 7870 leader_election.cc:304] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:38.235148 8986 raft_consensus.cc:2749] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.235333 8986 raft_consensus.cc:2749] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.235466 8986 raft_consensus.cc:2749] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.241345 8054 tablet_bootstrap.cc:492] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.241472 8054 ts_tablet_manager.cc:1403] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
I20260505 20:13:38.244922 7598 leader_election.cc:304] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:38.245617 7598 consensus_peers.cc:597] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44ddf95d810c4c80a5f78c1b7600cee4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:38.245921 9351 raft_consensus.cc:2804] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:38.246059 9351 raft_consensus.cc:697] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:38.246333 9351 consensus_queue.cc:237] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.255744 7736 leader_election.cc:304] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:38.256937 9304 raft_consensus.cc:493] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:38.257073 9304 raft_consensus.cc:515] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.257207 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bdfc75a494635837178cb16c08c1c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.257371 7936 raft_consensus.cc:2468] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:38.257568 9138 raft_consensus.cc:2804] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:38.257647 9138 raft_consensus.cc:493] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:38.257704 9138 raft_consensus.cc:3060] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.257864 9304 leader_election.cc:290] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:38.257853 8718 consensus_queue.cc:1048] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.258771 8053 tablet_bootstrap.cc:492] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.258678 9304 consensus_queue.cc:1048] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.258893 8053 ts_tablet_manager.cc:1403] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.001s
I20260505 20:13:38.259596 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.259704 8053 raft_consensus.cc:359] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.259840 8053 raft_consensus.cc:385] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.259894 8053 raft_consensus.cc:740] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.260097 8053 consensus_queue.cc:260] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.260596 8053 ts_tablet_manager.cc:1434] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:38.260887 8053 tablet_bootstrap.cc:492] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.261054 8054 raft_consensus.cc:359] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.261382 8054 raft_consensus.cc:385] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.262529 8054 raft_consensus.cc:740] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.262709 8053 tablet_bootstrap.cc:654] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.263622 7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69bdfc75a494635837178cb16c08c1c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:38.263780 7925 raft_consensus.cc:3060] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.264174 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.264993 8054 consensus_queue.cc:260] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.268610 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:38.269318 7596 leader_election.cc:343] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:38.270332 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "624398f68961440f8369a7859b0724c4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.272152 8054 ts_tablet_manager.cc:1434] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260505 20:13:38.272526 8054 tablet_bootstrap.cc:492] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.274468 8054 tablet_bootstrap.cc:654] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.275985 9351 consensus_queue.cc:1048] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.279002 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.279146 8053 tablet_bootstrap.cc:492] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.279204 7658 raft_consensus.cc:2468] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.279280 8053 ts_tablet_manager.cc:1403] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20260505 20:13:38.280155 8053 raft_consensus.cc:359] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.280320 8053 raft_consensus.cc:385] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.280375 8053 raft_consensus.cc:740] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.280570 8053 consensus_queue.cc:260] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.281172 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a3e9d404f14b43ae99c4a905f50086" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:38.281340 7658 raft_consensus.cc:3060] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.285665 8053 ts_tablet_manager.cc:1434] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:38.285996 8053 tablet_bootstrap.cc:492] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.287889 8989 consensus_queue.cc:1048] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.288367 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.289762 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fc0e6ac0fa4f8bbaef2fcf1ecbbd70" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.289986 7660 raft_consensus.cc:2468] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.290853 8053 tablet_bootstrap.cc:654] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.305637 8054 tablet_bootstrap.cc:492] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.306581 8053 tablet_bootstrap.cc:492] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.306730 8053 ts_tablet_manager.cc:1403] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.006s
I20260505 20:13:38.306700 9351 consensus_queue.cc:1048] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.310604 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bebda2a5c5a4c43a244504837cf0923" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:38.310904 7930 raft_consensus.cc:3060] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.310815 8053 raft_consensus.cc:359] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.311061 8053 raft_consensus.cc:385] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.311125 8053 raft_consensus.cc:740] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.311313 8053 consensus_queue.cc:260] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.311957 8053 ts_tablet_manager.cc:1434] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:38.312263 8053 tablet_bootstrap.cc:492] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.315791 8053 tablet_bootstrap.cc:654] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.318400 9366 tablet.cc:1724] T 20bdc29641404cee850f27e9c392fbc0 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:38.321566 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:38.322268 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:38.322634 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:38.324757 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:38.327422 9207 raft_consensus.cc:493] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.327591 9207 raft_consensus.cc:515] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.328339 9207 leader_election.cc:290] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.330911 8054 ts_tablet_manager.cc:1403] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260505 20:13:38.331764 8054 raft_consensus.cc:359] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.332679 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:38.334414 9384 tablet.cc:1724] T b9d2b417857347468529868b51ec07ab P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:38.335561 7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d805583f5c64ea7a9fe2f658079b5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.336241 8053 tablet_bootstrap.cc:492] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.336411 9047 raft_consensus.cc:515] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.336648 8053 ts_tablet_manager.cc:1403] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260505 20:13:38.337182 9047 leader_election.cc:290] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.338297 9028 consensus_queue.cc:1048] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.338376 8053 raft_consensus.cc:359] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.338665 8053 raft_consensus.cc:385] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.339058 8053 raft_consensus.cc:740] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.339521 8053 consensus_queue.cc:260] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.340592 8053 ts_tablet_manager.cc:1434] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260505 20:13:38.341192 8053 tablet_bootstrap.cc:492] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:38.333329 7869 leader_election.cc:343] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.343046 8054 raft_consensus.cc:385] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.343075 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:38.343138 8054 raft_consensus.cc:740] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.343242 7923 raft_consensus.cc:3060] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.344646 8054 consensus_queue.cc:260] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.346387 8053 tablet_bootstrap.cc:654] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.347056 8054 ts_tablet_manager.cc:1434] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260505 20:13:38.347337 8054 tablet_bootstrap.cc:492] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.349031 8054 tablet_bootstrap.cc:654] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.352321 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:38.354538 9047 raft_consensus.cc:493] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.354715 9047 raft_consensus.cc:515] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.355506 9047 leader_election.cc:290] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.355983 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7214ab77d7904f0e9d37cb8d7a5a53a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.356196 7928 raft_consensus.cc:2468] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.356743 7737 leader_election.cc:304] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:38.360610 8989 raft_consensus.cc:2804] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:38.360718 8989 raft_consensus.cc:493] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:38.360791 8989 raft_consensus.cc:3060] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.359565 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:38.364432 9047 raft_consensus.cc:493] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.364617 9047 raft_consensus.cc:515] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.365576 9047 leader_election.cc:290] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:38.366271 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.366537 7928 raft_consensus.cc:2393] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:38.383244 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:38.388795 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:38.391923 8054 tablet_bootstrap.cc:492] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.391768 8053 tablet_bootstrap.cc:492] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.392064 8054 ts_tablet_manager.cc:1403] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.003s
I20260505 20:13:38.392298 8053 ts_tablet_manager.cc:1403] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.001s
I20260505 20:13:38.395848 8053 raft_consensus.cc:359] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.396675 8053 raft_consensus.cc:385] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.396956 8053 raft_consensus.cc:740] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.397922 8053 consensus_queue.cc:260] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.400420 8053 ts_tablet_manager.cc:1434] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260505 20:13:38.401875 8053 tablet_bootstrap.cc:492] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.397681 7411 catalog_manager.cc:5671] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:38.405072 8054 raft_consensus.cc:359] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.406594 8054 raft_consensus.cc:385] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.407210 8054 raft_consensus.cc:740] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.410171 8053 tablet_bootstrap.cc:654] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.409096 8054 consensus_queue.cc:260] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.409253 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:38.411772 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c03859f5b4fbead92ea1d6d20a5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.411960 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff674539e1045408c212b533ca8a3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.412155 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0413d400b0f543509d2e68cb8d0ffdbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.412484 7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d805583f5c64ea7a9fe2f658079b5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.412691 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901e7923fc0949bab9442a696c3398eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.412192 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:38.415589 7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d5ef7ac5f44d1c9c77e2e50ab2ea5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.416254 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4a8afcd1a64ddeb23a9c91a4060130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.417865 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f1318ef5bf439f97de685ae7d6f462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.418608 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb672b1dfe7e4ed6ab9e73d328349238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.418972 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:38.421622 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566a6942cc904468a0cab3deae8a860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.424954 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe467e4f37442c19fcfe54f94e71657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.427639 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:38.428318 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de7b1e87b754414bb2ef025130ae6b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.428720 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:38.429272 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:38.429651 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:38.431704 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7085351ba8e4c78b684894460cec8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.439184 8054 ts_tablet_manager.cc:1434] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.047s user 0.002s sys 0.002s
I20260505 20:13:38.439543 8054 tablet_bootstrap.cc:492] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.441383 8054 tablet_bootstrap.cc:654] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.445405 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:38.445808 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:38.446203 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:38.446715 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:38.446870 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:38.447748 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:38.448784 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:38.449015 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:38.449389 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:38.377895 7929 raft_consensus.cc:2468] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:38.460104 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c03859f5b4fbead92ea1d6d20a5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.460824 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f1318ef5bf439f97de685ae7d6f462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.461369 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe467e4f37442c19fcfe54f94e71657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.461856 7772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de7b1e87b754414bb2ef025130ae6b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.462350 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7085351ba8e4c78b684894460cec8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.462752 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901e7923fc0949bab9442a696c3398eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.463202 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566a6942cc904468a0cab3deae8a860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.463650 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d805583f5c64ea7a9fe2f658079b5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.464105 7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb672b1dfe7e4ed6ab9e73d328349238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.464510 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d5ef7ac5f44d1c9c77e2e50ab2ea5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.464959 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0413d400b0f543509d2e68cb8d0ffdbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.465723 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff674539e1045408c212b533ca8a3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.473912 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4a8afcd1a64ddeb23a9c91a4060130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.475415 9138 raft_consensus.cc:515] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.476188 9138 leader_election.cc:290] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:38.449709 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_af2341b021674fe494cd635374e98c3e [id=3734c4511d224584aeed0efd6bac453d]). Expected version 1 got 0
I20260505 20:13:38.479054 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:38.479529 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:38.480093 8053 tablet_bootstrap.cc:492] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.480475 8053 ts_tablet_manager.cc:1403] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.015s
I20260505 20:13:38.480545 7411 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:38.481380 7406 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet a114db19f63346d9a67e9e3a8225caa4
W20260505 20:13:38.481413 7408 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67c582e419f746b28530c0971fede09f consensus state has no leader
I20260505 20:13:38.481889 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet be05357416b24dabaaa5f2ce2f33c82e
I20260505 20:13:38.482052 7406 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 86) took 2499 ms. Trace:
I20260505 20:13:38.482437 7409 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 85) took 2526 ms. Trace:
I20260505 20:13:38.482180 7406 rpcz_store.cc:276] 0505 20:13:35.982632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.821498 (+1838866us) service_pool.cc:224] Handling call
0505 20:13:37.821991 (+ 493us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.822132 (+ 141us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:37.822203 (+ 71us) catalog_manager.cc:2824] Locking tablets
0505 20:13:37.836899 (+ 14696us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:37.842895 (+ 5996us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:37.842993 (+ 98us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:38.481289 (+638296us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:38.482011 (+ 722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.838102 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.838235 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.838241 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:37.838244 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:37.838376 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.838391 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.838397 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.838545 (+ 148us) tablet.cc:701] Row locks acquired
0505 20:13:37.838548 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:37.838585 (+ 37us) write_op.cc:270] Start()
0505 20:13:37.838621 (+ 36us) write_op.cc:276] Timestamp: P: 1778012017838733 usec, L: 0
0505 20:13:37.838624 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.838808 (+ 184us) log.cc:844] Serialized 759 byte log entry
0505 20:13:37.842265 (+ 3457us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.842405 (+ 140us) write_op.cc:301] APPLY: starting
0505 20:13:37.842422 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.842468 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.842493 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.842560 (+ 67us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.842595 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:37.842602 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.842673 (+ 71us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.842726 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.842753 (+ 27us) write_op.cc:454] Released schema lock
0505 20:13:37.842759 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.842821 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.842825 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":410,"apply.run_wall_time_us":409,"num_ops":2,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":821,"prepare.run_wall_time_us":820,"raft.queue_time_us":371,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":213,"replication_time_us":3611}]]}
I20260505 20:13:38.482602 7409 rpcz_store.cc:276] 0505 20:13:35.956251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.703473 (+1747222us) service_pool.cc:224] Handling call
0505 20:13:37.703984 (+ 511us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.704130 (+ 146us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:37.704189 (+ 59us) catalog_manager.cc:2824] Locking tablets
0505 20:13:37.704323 (+ 134us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:37.719761 (+ 15438us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.719774 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:37.719922 (+ 148us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:37.720052 (+ 130us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:38.481828 (+761776us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:38.482389 (+ 561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.705071 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.705254 (+ 183us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.705263 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:37.705268 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:37.705444 (+ 176us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.705463 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.705470 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.705613 (+ 143us) tablet.cc:701] Row locks acquired
0505 20:13:37.705617 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.705658 (+ 41us) write_op.cc:270] Start()
0505 20:13:37.705701 (+ 43us) write_op.cc:276] Timestamp: P: 1778012017705751 usec, L: 0
0505 20:13:37.705707 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.705972 (+ 265us) log.cc:844] Serialized 728 byte log entry
0505 20:13:37.709387 (+ 3415us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.709512 (+ 125us) write_op.cc:301] APPLY: starting
0505 20:13:37.709529 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.709576 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.709605 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.709682 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.709717 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:37.709724 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.709823 (+ 99us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.709892 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.709914 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:37.709921 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":463,"apply.run_wall_time_us":463,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":1000,"prepare.run_wall_time_us":1012,"raft.queue_time_us":925,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":209,"replication_time_us":3651}]]}
I20260505 20:13:38.483696 7409 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_df8877e563ff4aa49f6f201934596c59" } new_table_name: "default.Table_dd9c3e8b30b640158efe23f97a264373" modify_external_catalogs: true
I20260505 20:13:38.490684 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet a114db19f63346d9a67e9e3a8225caa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:38.490970 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet be05357416b24dabaaa5f2ce2f33c82e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:38.481669 7408 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 68) took 3801 ms. Trace:
I20260505 20:13:38.492125 7408 rpcz_store.cc:276] 0505 20:13:34.679816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.227462 (+2547646us) service_pool.cc:224] Handling call
0505 20:13:37.369677 (+142215us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9743da6 00007f70d01d9146 00007f70d01d8e75 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:37.370819 (+ 1142us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.371043 (+ 224us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:37.371259 (+ 216us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:37.371340 (+ 81us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:37.433330 (+ 61990us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:38.481578 (+1048248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.372817 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.372940 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.372946 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:37.372949 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:37.374256 (+ 1307us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.374271 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.374276 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:37.374346 (+ 70us) tablet.cc:701] Row locks acquired
0505 20:13:37.374348 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:37.374387 (+ 39us) write_op.cc:270] Start()
0505 20:13:37.374422 (+ 35us) write_op.cc:276] Timestamp: P: 1778012017374555 usec, L: 0
0505 20:13:37.374425 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.374620 (+ 195us) log.cc:844] Serialized 405 byte log entry
0505 20:13:37.430262 (+ 55642us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.430443 (+ 181us) write_op.cc:301] APPLY: starting
0505 20:13:37.430464 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.430511 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.430535 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.430595 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.430634 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:37.430641 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.430745 (+ 104us) log.cc:844] Serialized 23 byte log entry
0505 20:13:37.430822 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.430848 (+ 26us) write_op.cc:454] Released schema lock
0505 20:13:37.430858 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.430942 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.430946 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":120718720,"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":497,"apply.run_wall_time_us":496,"num_ops":1,"prepare.queue_time_us":954,"prepare.run_cpu_time_us":766,"prepare.run_wall_time_us":1916,"raft.queue_time_us":997,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":205,"replication_time_us":55793}]]}
I20260505 20:13:38.493451 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_3e1807415b834caa9172f7fb69a96f22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:38.493942 7404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 359ab1033ccf4445862867f3f8b78ecd
I20260505 20:13:38.494589 7404 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 83) took 3230 ms. Trace:
I20260505 20:13:38.495028 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 359ab1033ccf4445862867f3f8b78ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:38.494702 7404 rpcz_store.cc:276] 0505 20:13:35.263905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.687427 (+2423522us) service_pool.cc:224] Handling call
0505 20:13:37.687880 (+ 453us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.688018 (+ 138us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:37.688076 (+ 58us) catalog_manager.cc:2824] Locking tablets
0505 20:13:37.811967 (+123891us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:37.827403 (+ 15436us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:37.827505 (+ 102us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:38.493883 (+666378us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:38.494522 (+ 639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.814803 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.814924 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.814931 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:37.814935 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:37.815023 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.815031 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.815036 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.815112 (+ 76us) tablet.cc:701] Row locks acquired
0505 20:13:37.815115 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:37.815140 (+ 25us) write_op.cc:270] Start()
0505 20:13:37.815161 (+ 21us) write_op.cc:276] Timestamp: P: 1778012017815283 usec, L: 0
0505 20:13:37.815164 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.815292 (+ 128us) log.cc:844] Serialized 759 byte log entry
0505 20:13:37.826182 (+ 10890us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.826849 (+ 667us) write_op.cc:301] APPLY: starting
0505 20:13:37.826858 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.826892 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.826911 (+ 19us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.826956 (+ 45us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.826981 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:37.826987 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:37.827032 (+ 45us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.827067 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.827085 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:37.827093 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.827149 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.827153 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":637,"apply.run_cpu_time_us":295,"apply.run_wall_time_us":295,"mutex_wait_us":1268,"num_ops":2,"prepare.queue_time_us":2065,"prepare.run_cpu_time_us":557,"prepare.run_wall_time_us":557,"raft.queue_time_us":2331,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":3,"replication_time_us":11002}]]}
I20260505 20:13:38.495671 7404 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_d6ff12d49b3b4a3c899c0a1a45c4d11b" } new_table_name: "default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc" modify_external_catalogs: true
I20260505 20:13:38.497221 7405 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet ec3374a8f51d4c1a94dbd24d4a9da0af
I20260505 20:13:38.497922 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 35ada922a36f4f329a5ff8b328dbef5f
I20260505 20:13:38.498469 7407 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 87) took 2507 ms. Trace:
I20260505 20:13:38.498569 7407 rpcz_store.cc:276] 0505 20:13:35.991217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.828644 (+1837427us) service_pool.cc:224] Handling call
0505 20:13:37.829064 (+ 420us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.829205 (+ 141us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:37.829262 (+ 57us) catalog_manager.cc:2824] Locking tablets
0505 20:13:37.847757 (+ 18495us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:37.854079 (+ 6322us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:37.991748 (+137669us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:38.497868 (+506120us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:38.498403 (+ 535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.848685 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.848812 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.848819 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:37.848821 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.848934 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.848948 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.848952 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.849047 (+ 95us) tablet.cc:701] Row locks acquired
0505 20:13:37.849049 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:37.849086 (+ 37us) write_op.cc:270] Start()
0505 20:13:37.849116 (+ 30us) write_op.cc:276] Timestamp: P: 1778012017849240 usec, L: 0
0505 20:13:37.849120 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.849308 (+ 188us) log.cc:844] Serialized 728 byte log entry
0505 20:13:37.852885 (+ 3577us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.853023 (+ 138us) write_op.cc:301] APPLY: starting
0505 20:13:37.853040 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.853091 (+ 51us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.853125 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.853191 (+ 66us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.853224 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:37.853231 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.853310 (+ 79us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.853361 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.853381 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:37.853387 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.853446 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.853450 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92,"apply.run_cpu_time_us":417,"apply.run_wall_time_us":417,"num_ops":2,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":731,"prepare.run_wall_time_us":1038,"raft.queue_time_us":319,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":216,"replication_time_us":3738}]]}
I20260505 20:13:38.499861 7407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_fdf9cb8321b64150bc72c38e08184712" } new_table_name: "default.Table_8f0bb844a18341278a0bc6b469a01b87" modify_external_catalogs: true
I20260505 20:13:38.506484 7405 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 81) took 3371 ms. Trace:
I20260505 20:13:38.506614 7405 rpcz_store.cc:276] 0505 20:13:35.134837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.684354 (+2549517us) service_pool.cc:224] Handling call
0505 20:13:37.684755 (+ 401us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:37.684896 (+ 141us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:37.684957 (+ 61us) catalog_manager.cc:2824] Locking tablets
0505 20:13:37.685100 (+ 143us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:37.698642 (+ 13542us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:37.698724 (+ 82us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:38.497157 (+798433us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:38.506414 (+ 9257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.685850 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.685962 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.685967 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:37.685969 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.686101 (+ 132us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.686116 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.686121 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:37.686225 (+ 104us) tablet.cc:701] Row locks acquired
0505 20:13:37.686229 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.686268 (+ 39us) write_op.cc:270] Start()
0505 20:13:37.686301 (+ 33us) write_op.cc:276] Timestamp: P: 1778012017686357 usec, L: 0
0505 20:13:37.686305 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.686505 (+ 200us) log.cc:844] Serialized 728 byte log entry
0505 20:13:37.691872 (+ 5367us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.692041 (+ 169us) write_op.cc:301] APPLY: starting
0505 20:13:37.692060 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.692107 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.692132 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.692203 (+ 71us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.692243 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:37.692250 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:37.692330 (+ 80us) log.cc:844] Serialized 29 byte log entry
0505 20:13:37.692405 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.692422 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:37.692429 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.692504 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.692511 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":114,"apply.run_cpu_time_us":455,"apply.run_wall_time_us":454,"num_ops":2,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":765,"prepare.run_wall_time_us":764,"raft.queue_time_us":471,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":223,"replication_time_us":5540}]]}
I20260505 20:13:38.507984 7405 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_0af890deafbf4b8a901edea12e3c1e22" } new_table_name: "default.Table_c78f870417f04deb8a5bd52ab26ba784" modify_external_catalogs: true
I20260505 20:13:38.509116 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet ec3374a8f51d4c1a94dbd24d4a9da0af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:38.514310 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ada922a36f4f329a5ff8b328dbef5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:38.516614 8053 raft_consensus.cc:359] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.516958 8053 raft_consensus.cc:385] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.517105 8053 raft_consensus.cc:740] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.517400 8053 consensus_queue.cc:260] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.518081 8053 ts_tablet_manager.cc:1434] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
W20260505 20:13:38.530272 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e1807415b834caa9172f7fb69a96f22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:38.534161 7409 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a96ed0d53064aa480d93420c6b41bc2 consensus state has no leader
I20260505 20:13:38.534358 7409 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 88) took 2371 ms. Trace:
I20260505 20:13:38.534474 7409 rpcz_store.cc:276] 0505 20:13:36.163100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.483449 (+2320349us) service_pool.cc:224] Handling call
0505 20:13:38.483944 (+ 495us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:38.484219 (+ 275us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:38.484484 (+ 265us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:38.513865 (+ 29381us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:38.519971 (+ 6106us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:38.534320 (+ 14349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.514602 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.514775 (+ 173us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.514785 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:38.514789 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:38.514940 (+ 151us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.514960 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.514967 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.515058 (+ 91us) tablet.cc:701] Row locks acquired
0505 20:13:38.515062 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:38.515099 (+ 37us) write_op.cc:270] Start()
0505 20:13:38.515143 (+ 44us) write_op.cc:276] Timestamp: P: 1778012018515114 usec, L: 0
0505 20:13:38.515147 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.515353 (+ 206us) log.cc:844] Serialized 405 byte log entry
0505 20:13:38.519330 (+ 3977us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.519465 (+ 135us) write_op.cc:301] APPLY: starting
0505 20:13:38.519482 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.519526 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.519554 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.519608 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.519643 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.519651 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:38.519747 (+ 96us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.519813 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.519835 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:38.519842 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.519947 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.519952 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":472,"apply.run_wall_time_us":472,"num_ops":1,"prepare.queue_time_us":42,"prepare.run_cpu_time_us":872,"prepare.run_wall_time_us":887,"raft.queue_time_us":1210,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":278,"replication_time_us":4152}]]}
I20260505 20:13:38.535365 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_6825628c592243e0996f4b1cd6f3d30c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.535964 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6825628c592243e0996f4b1cd6f3d30c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.539131 9242 raft_consensus.cc:515] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.540212 9242 leader_election.cc:290] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.543540 8053 tablet_bootstrap.cc:492] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:38.543661 7399 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 67c582e419f746b28530c0971fede09f (table default.Table_d788352d297e44d1874caf109ffc646c [id=0b04ae6c921741049ea506fe8323865c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 67c582e419f746b28530c0971fede09f consensus state has no leader
I20260505 20:13:38.545318 8053 tablet_bootstrap.cc:654] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.587515 8989 raft_consensus.cc:515] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.588583 8989 leader_election.cc:290] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.590529 8053 tablet_bootstrap.cc:492] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.590829 8053 ts_tablet_manager.cc:1403] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.004s
I20260505 20:13:38.596582 9138 raft_consensus.cc:493] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.596872 9138 raft_consensus.cc:515] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.598124 9138 leader_election.cc:290] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.599352 8053 raft_consensus.cc:359] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.602718 8053 raft_consensus.cc:385] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.602888 8053 raft_consensus.cc:740] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.608538 8053 consensus_queue.cc:260] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.610831 8989 raft_consensus.cc:493] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.611006 8989 raft_consensus.cc:515] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.611819 8989 leader_election.cc:290] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:38.614334 8053 ts_tablet_manager.cc:1434] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260505 20:13:38.634790 8053 tablet_bootstrap.cc:492] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.637169 8053 tablet_bootstrap.cc:654] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.649813 9156 consensus_queue.cc:1048] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.314s
I20260505 20:13:38.653972 9293 tablet.cc:1724] T 20bdc29641404cee850f27e9c392fbc0 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:38.656200 9354 tablet.cc:1724] T b9d2b417857347468529868b51ec07ab P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:38.668232 8693 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.509s user 0.006s sys 0.004s
I20260505 20:13:38.683166 7793 raft_consensus.cc:2468] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:38.710158 7658 raft_consensus.cc:2468] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:38.712595 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 456400us
W20260505 20:13:38.716228 9150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s user 0.004s sys 0.008s
W20260505 20:13:38.729768 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 393766us
W20260505 20:13:38.467792 7869 consensus_peers.cc:597] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79ce82aca20d44819f28785322e935ae. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:38.475095 7925 raft_consensus.cc:2468] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:38.734982 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 267341us
I20260505 20:13:38.509462 7923 raft_consensus.cc:2468] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:38.510104 8054 tablet_bootstrap.cc:492] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.585218 9135 raft_consensus.cc:493] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.736688 9402 raft_consensus.cc:493] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.736641 9135 raft_consensus.cc:515] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.736826 9402 raft_consensus.cc:515] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.737063 9207 raft_consensus.cc:493] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.737193 9207 raft_consensus.cc:515] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.737332 9135 leader_election.cc:290] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:38.695940 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 461617us
I20260505 20:13:38.737735 9207 leader_election.cc:290] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:38.738128 7870 leader_election.cc:343] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.738565 7870 leader_election.cc:304] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:38.739045 9135 raft_consensus.cc:2749] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.736656 8054 ts_tablet_manager.cc:1403] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.297s user 0.008s sys 0.002s
I20260505 20:13:38.740337 8054 raft_consensus.cc:359] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.740537 8054 raft_consensus.cc:385] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.740602 8054 raft_consensus.cc:740] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.740803 8054 consensus_queue.cc:260] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.740957 9135 raft_consensus.cc:493] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.741073 9135 raft_consensus.cc:515] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.741662 9135 leader_election.cc:290] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.742594 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.742760 7928 raft_consensus.cc:2468] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.743044 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d4e198c91c4a0e99d8b798a1dd3433" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.743290 7936 raft_consensus.cc:2468] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.743356 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ada922a36f4f329a5ff8b328dbef5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:38.742601 7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fc0e6ac0fa4f8bbaef2fcf1ecbbd70" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:38.743978 8054 ts_tablet_manager.cc:1434] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:38.744059 7925 raft_consensus.cc:3060] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.744298 8054 tablet_bootstrap.cc:492] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.743867 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 359ab1033ccf4445862867f3f8b78ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:38.744040 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet a114db19f63346d9a67e9e3a8225caa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:38.738128 9402 leader_election.cc:290] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.746459 8054 tablet_bootstrap.cc:654] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.748719 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet be05357416b24dabaaa5f2ce2f33c82e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:38.749353 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet ec3374a8f51d4c1a94dbd24d4a9da0af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:38.750660 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7214ab77d7904f0e9d37cb8d7a5a53a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:38.750900 7924 raft_consensus.cc:3060] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:38.751636 9135 raft_consensus.cc:493] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.751829 9135 raft_consensus.cc:515] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.752494 9135 leader_election.cc:290] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:38.767921 8301 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:55181 (request call id 236) took 767 ms (client timeout 1000 ms). Trace:
I20260505 20:13:38.780791 7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb672b1dfe7e4ed6ab9e73d328349238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.791708 7930 raft_consensus.cc:2468] T 6bebda2a5c5a4c43a244504837cf0923 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:38.792680 8940 thread.cc:641] maintenance_scheduler (maintenance) Time spent creating pthread: real 0.584s user 0.070s sys 0.076s
W20260505 20:13:38.792855 8940 thread.cc:608] maintenance_scheduler (maintenance) Time spent starting thread: real 0.585s user 0.070s sys 0.076s
I20260505 20:13:38.793411 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373c03859f5b4fbead92ea1d6d20a5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.793669 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901e7923fc0949bab9442a696c3398eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:38.795248 8301 rpcz_store.cc:269] 0505 20:13:38.000813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.015110 (+ 14297us) service_pool.cc:224] Handling call
0505 20:13:38.767827 (+752717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:38.795799 8054 tablet_bootstrap.cc:492] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.795950 8054 ts_tablet_manager.cc:1403] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.004s
I20260505 20:13:38.797013 8054 raft_consensus.cc:359] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.797199 8054 raft_consensus.cc:385] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.797254 8054 raft_consensus.cc:740] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:38.792385 8693 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.509s user 0.006s sys 0.004s
I20260505 20:13:38.803109 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 89) took 2405 ms. Trace:
I20260505 20:13:38.803238 7408 rpcz_store.cc:276] 0505 20:13:36.397899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.493148 (+2095249us) service_pool.cc:224] Handling call
0505 20:13:38.551834 (+ 58686us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.552507 (+ 673us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.771421 (+218914us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.802877 (+ 31456us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.803030 (+ 153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.641924 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.642032 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.642038 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:38.642041 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.642118 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.642127 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.642133 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.642211 (+ 78us) tablet.cc:701] Row locks acquired
0505 20:13:38.642214 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:38.642240 (+ 26us) write_op.cc:270] Start()
0505 20:13:38.642268 (+ 28us) write_op.cc:276] Timestamp: P: 1778012018642309 usec, L: 0
0505 20:13:38.642271 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.642406 (+ 135us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.769030 (+126624us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.770072 (+ 1042us) write_op.cc:301] APPLY: starting
0505 20:13:38.770086 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.770127 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.770162 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.770292 (+ 130us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.770328 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.770339 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:38.770402 (+ 63us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.770448 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.770464 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:38.770471 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.770524 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.770528 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":967,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":449,"num_ops":2,"prepare.queue_time_us":88882,"prepare.run_cpu_time_us":570,"prepare.run_wall_time_us":858,"raft.queue_time_us":35,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":126738}]]}
I20260505 20:13:38.804469 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_ceeb6434b7b447ddbffcb553beddcdd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.805111 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceeb6434b7b447ddbffcb553beddcdd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.811148 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 93) took 1131 ms. Trace:
I20260505 20:13:38.811275 7409 rpcz_store.cc:276] 0505 20:13:37.679305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.535137 (+855832us) service_pool.cc:224] Handling call
0505 20:13:38.536064 (+ 927us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.536558 (+ 494us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.716111 (+179553us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.810996 (+ 94885us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.811103 (+ 107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.555993 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.556082 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.556086 (+ 4us) write_op.cc:435] Acquired schema lock
0505 20:13:38.556089 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.556159 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.556168 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.556172 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.556249 (+ 77us) tablet.cc:701] Row locks acquired
0505 20:13:38.556251 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.556276 (+ 25us) write_op.cc:270] Start()
0505 20:13:38.556301 (+ 25us) write_op.cc:276] Timestamp: P: 1778012018556311 usec, L: 0
0505 20:13:38.556305 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.556436 (+ 131us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.713137 (+156701us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.714650 (+ 1513us) write_op.cc:301] APPLY: starting
0505 20:13:38.714665 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.714705 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.714742 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.714896 (+ 154us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.714935 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.714944 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:38.715010 (+ 66us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.715062 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.715079 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:38.715087 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.715163 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.715169 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1469,"apply.run_cpu_time_us":501,"apply.run_wall_time_us":501,"num_ops":2,"prepare.queue_time_us":18930,"prepare.run_cpu_time_us":544,"prepare.run_wall_time_us":9147,"raft.queue_time_us":1359,"raft.run_cpu_time_us":18,"raft.run_wall_time_us":19,"replication_time_us":156809}]]}
I20260505 20:13:38.812155 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_91806f12d20746a398c9250e524e24ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.812742 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91806f12d20746a398c9250e524e24ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.797633 8054 consensus_queue.cc:260] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.818706 8054 ts_tablet_manager.cc:1434] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260505 20:13:38.819022 8054 tablet_bootstrap.cc:492] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.821053 8054 tablet_bootstrap.cc:654] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.824453 9138 raft_consensus.cc:493] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.827988 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 95) took 1106 ms. Trace:
I20260505 20:13:38.828254 7409 rpcz_store.cc:276] 0505 20:13:37.722051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.811964 (+1089913us) service_pool.cc:224] Handling call
0505 20:13:38.812831 (+ 867us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.813264 (+ 433us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.827655 (+ 14391us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.827809 (+ 154us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.827945 (+ 136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.817950 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.818082 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.818089 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:38.818092 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.818190 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.818205 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.818211 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.818320 (+ 109us) tablet.cc:701] Row locks acquired
0505 20:13:38.818322 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.818359 (+ 37us) write_op.cc:270] Start()
0505 20:13:38.818394 (+ 35us) write_op.cc:276] Timestamp: P: 1778012018818494 usec, L: 0
0505 20:13:38.818397 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.818625 (+ 228us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.826346 (+ 7721us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.826526 (+ 180us) write_op.cc:301] APPLY: starting
0505 20:13:38.826546 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.826614 (+ 68us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.826690 (+ 76us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.826898 (+ 208us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.826954 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.826966 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:38.827100 (+ 134us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.827380 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.827408 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:38.827418 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.827522 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.827528 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":790,"apply.run_wall_time_us":989,"num_ops":2,"prepare.queue_time_us":4162,"prepare.run_cpu_time_us":803,"prepare.run_wall_time_us":804,"raft.queue_time_us":1422,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":288,"replication_time_us":7916}]]}
I20260505 20:13:38.830331 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_a4bda75b1627411aa15f0542c6bee79d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.831271 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4bda75b1627411aa15f0542c6bee79d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:38.831831 9305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s user 0.000s sys 0.009s
W20260505 20:13:38.839192 9305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s user 0.000s sys 0.010s
W20260505 20:13:38.839972 9150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s user 0.004s sys 0.008s
I20260505 20:13:38.840369 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet a114db19f63346d9a67e9e3a8225caa4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:38.841138 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 94) took 1130 ms. Trace:
I20260505 20:13:38.841296 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ada922a36f4f329a5ff8b328dbef5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:38.841248 7408 rpcz_store.cc:276] 0505 20:13:37.710352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.804225 (+1093873us) service_pool.cc:224] Handling call
0505 20:13:38.805217 (+ 992us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.814829 (+ 9612us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.840852 (+ 26023us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.840976 (+ 124us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.841078 (+ 102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.820169 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.820302 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.820307 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:38.820311 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:38.820404 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.820417 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.820422 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.820507 (+ 85us) tablet.cc:701] Row locks acquired
0505 20:13:38.820510 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:38.820540 (+ 30us) write_op.cc:270] Start()
0505 20:13:38.820579 (+ 39us) write_op.cc:276] Timestamp: P: 1778012018820679 usec, L: 0
0505 20:13:38.820582 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.820731 (+ 149us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.835919 (+ 15188us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.840079 (+ 4160us) write_op.cc:301] APPLY: starting
0505 20:13:38.840097 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.840135 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.840159 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.840263 (+ 104us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.840305 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.840314 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:38.840388 (+ 74us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.840648 (+ 260us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.840672 (+ 24us) write_op.cc:454] Released schema lock
0505 20:13:38.840679 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.840749 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.840753 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4097,"apply.run_cpu_time_us":481,"apply.run_wall_time_us":669,"mutex_wait_us":4690,"num_ops":2,"prepare.queue_time_us":4740,"prepare.run_cpu_time_us":654,"prepare.run_wall_time_us":654,"raft.queue_time_us":430,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":15308}]]}
W20260505 20:13:38.842353 9219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s user 0.003s sys 0.054s
I20260505 20:13:38.842530 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_f0554d77c3dd47b988956769f1598f28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.843283 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0554d77c3dd47b988956769f1598f28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.844414 9400 consensus_queue.cc:1048] T bda4fd8b0f214da7a1e8b944e1820c0c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.114s
I20260505 20:13:38.846269 7598 leader_election.cc:304] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:38.846720 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 116450us
W20260505 20:13:38.849535 7598 leader_election.cc:343] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:38.849762 7598 leader_election.cc:304] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:38.852837 7628 tablet_service.cc:1558] Processing DeleteTablet for tablet be05357416b24dabaaa5f2ce2f33c82e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:38.853055 7640 tablet_service.cc:1558] Processing DeleteTablet for tablet 359ab1033ccf4445862867f3f8b78ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:38.853221 7644 tablet_service.cc:1558] Processing DeleteTablet for tablet ec3374a8f51d4c1a94dbd24d4a9da0af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:37 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:38.853462 9219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s user 0.003s sys 0.054s
I20260505 20:13:38.855754 9397 raft_consensus.cc:2749] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.856031 8557 raft_consensus.cc:2749] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:38.856243 7598 consensus_peers.cc:597] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:38.856961 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 97) took 1073 ms. Trace:
I20260505 20:13:38.856974 7598 leader_election.cc:304] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:38.857535 9028 raft_consensus.cc:2804] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:38.857059 7408 rpcz_store.cc:276] 0505 20:13:37.783114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.842291 (+1059177us) service_pool.cc:224] Handling call
0505 20:13:38.843427 (+ 1136us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.843931 (+ 504us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.856672 (+ 12741us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.856792 (+ 120us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.856893 (+ 101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.846490 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.846583 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.846588 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:38.846590 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:38.846663 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.846672 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.846678 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.846739 (+ 61us) tablet.cc:701] Row locks acquired
0505 20:13:38.846741 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.846769 (+ 28us) write_op.cc:270] Start()
0505 20:13:38.846792 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018846917 usec, L: 0
0505 20:13:38.846796 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.846958 (+ 162us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.852188 (+ 5230us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.853111 (+ 923us) write_op.cc:301] APPLY: starting
0505 20:13:38.853124 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.853158 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.853182 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.853308 (+ 126us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.853346 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.853355 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:38.853415 (+ 60us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.853472 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.853488 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:38.853494 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.853557 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.853562 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":883,"apply.run_cpu_time_us":438,"apply.run_wall_time_us":438,"mutex_wait_us":1998,"num_ops":2,"prepare.queue_time_us":2044,"prepare.run_cpu_time_us":573,"prepare.run_wall_time_us":572,"raft.queue_time_us":326,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":5367}]]}
I20260505 20:13:38.857633 9028 raft_consensus.cc:697] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:38.857921 9028 consensus_queue.cc:237] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.858343 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet 6166653cbc58470c8ba4926048ba1384 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:38.858825 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 96) took 1120 ms. Trace:
I20260505 20:13:38.858959 9351 raft_consensus.cc:493] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.859122 9351 raft_consensus.cc:515] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.858935 7409 rpcz_store.cc:276] 0505 20:13:37.738155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.830076 (+1091921us) service_pool.cc:224] Handling call
0505 20:13:38.831461 (+ 1385us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.831993 (+ 532us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.858602 (+ 26609us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.858695 (+ 93us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.858784 (+ 89us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.844716 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.844865 (+ 149us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.844873 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:38.844877 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:38.844994 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.845011 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.845018 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.845104 (+ 86us) tablet.cc:701] Row locks acquired
0505 20:13:38.845106 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.845138 (+ 32us) write_op.cc:270] Start()
0505 20:13:38.845169 (+ 31us) write_op.cc:276] Timestamp: P: 1778012018845286 usec, L: 0
0505 20:13:38.845172 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.845325 (+ 153us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.849430 (+ 4105us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.852344 (+ 2914us) write_op.cc:301] APPLY: starting
0505 20:13:38.852365 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.852428 (+ 63us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.852505 (+ 77us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.852693 (+ 188us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.852738 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.852750 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:38.852842 (+ 92us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.852915 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.852934 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:38.852940 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.853032 (+ 92us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.853038 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2846,"apply.run_cpu_time_us":665,"apply.run_wall_time_us":665,"num_ops":2,"prepare.queue_time_us":12097,"prepare.run_cpu_time_us":718,"prepare.run_wall_time_us":716,"raft.queue_time_us":1000,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":214,"replication_time_us":4228}]]}
I20260505 20:13:38.859872 9351 leader_election.cc:290] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.850827 9400 consensus_queue.cc:1048] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260505 20:13:38.863126 7596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.008s sys 0.014s
W20260505 20:13:38.863327 7596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s user 0.008s sys 0.014s
W20260505 20:13:38.863960 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 529018us
I20260505 20:13:38.865209 9396 raft_consensus.cc:493] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
W20260505 20:13:38.869297 9304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s user 0.010s sys 0.040s
W20260505 20:13:38.869544 9304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s user 0.010s sys 0.041s
I20260505 20:13:38.870096 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_8c382c0a59964e009edd392fe01a4e6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:38.865379 9396 raft_consensus.cc:515] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.870914 9396 leader_election.cc:290] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:38.876391 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:38.877074 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c382c0a59964e009edd392fe01a4e6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.877733 8054 tablet_bootstrap.cc:492] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:38.877924 8054 ts_tablet_manager.cc:1403] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.002s
I20260505 20:13:38.878743 8054 raft_consensus.cc:359] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.878933 8054 raft_consensus.cc:385] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.879007 8054 raft_consensus.cc:740] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.879196 8054 consensus_queue.cc:260] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.887080 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 99) took 1006 ms. Trace:
I20260505 20:13:38.887362 7409 rpcz_store.cc:276] 0505 20:13:37.880725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.869860 (+989135us) service_pool.cc:224] Handling call
0505 20:13:38.877286 (+ 7426us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.877795 (+ 509us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.886716 (+ 8921us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.886722 (+ 6us) write_op.cc:454] Released schema lock
0505 20:13:38.886819 (+ 97us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.886935 (+ 116us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.887034 (+ 99us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.878536 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.878648 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.878653 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:38.878656 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.878757 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.878774 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.878779 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.878862 (+ 83us) tablet.cc:701] Row locks acquired
0505 20:13:38.878864 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.878901 (+ 37us) write_op.cc:270] Start()
0505 20:13:38.878960 (+ 59us) write_op.cc:276] Timestamp: P: 1778012018879060 usec, L: 0
0505 20:13:38.878965 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.879153 (+ 188us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.883595 (+ 4442us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.884024 (+ 429us) write_op.cc:301] APPLY: starting
0505 20:13:38.884047 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.884105 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.884145 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.884303 (+ 158us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.884352 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.884362 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:38.884461 (+ 99us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.884530 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.884556 (+ 26us) write_op.cc:454] Released schema lock
0505 20:13:38.884565 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":364,"apply.run_cpu_time_us":606,"apply.run_wall_time_us":605,"num_ops":2,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":746,"raft.queue_time_us":1328,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":269,"replication_time_us":4594}]]}
I20260505 20:13:38.888626 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.889128 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.888062 7925 raft_consensus.cc:2468] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:38.889817 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.890134 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_43987c8c0ed94d89ad7af5dbbd9f684f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:38.890285 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.895707 9396 raft_consensus.cc:493] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.896013 9396 raft_consensus.cc:515] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:38.896148 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43987c8c0ed94d89ad7af5dbbd9f684f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.896829 9396 leader_election.cc:290] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:38.896991 9396 raft_consensus.cc:493] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.897109 9396 raft_consensus.cc:515] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.897706 9396 leader_election.cc:290] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:38.898454 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0dd5d7870453bb1b771405daeb22f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.900563 8054 ts_tablet_manager.cc:1434] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260505 20:13:38.900909 8054 tablet_bootstrap.cc:492] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:38.903016 9368 raft_consensus.cc:493] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.903304 8054 tablet_bootstrap.cc:654] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:38.903198 9368 raft_consensus.cc:515] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.903983 9368 leader_election.cc:290] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.905526 9300 tablet.cc:1724] T 50680deff6fe4dcabbf5a3aeb47ac01e P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:38.914529 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 100) took 1029 ms. Trace:
I20260505 20:13:38.914825 7409 rpcz_store.cc:276] 0505 20:13:37.885234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.889111 (+1003877us) service_pool.cc:224] Handling call
0505 20:13:38.896299 (+ 7188us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.896948 (+ 649us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.914096 (+ 17148us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.914104 (+ 8us) write_op.cc:454] Released schema lock
0505 20:13:38.914202 (+ 98us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.914343 (+ 141us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.914470 (+ 127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.905830 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.905964 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.905971 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:38.905974 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.906079 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.906093 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.906097 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.906178 (+ 81us) tablet.cc:701] Row locks acquired
0505 20:13:38.906180 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.906217 (+ 37us) write_op.cc:270] Start()
0505 20:13:38.906258 (+ 41us) write_op.cc:276] Timestamp: P: 1778012018906387 usec, L: 0
0505 20:13:38.906262 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.906454 (+ 192us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.910546 (+ 4092us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.911134 (+ 588us) write_op.cc:301] APPLY: starting
0505 20:13:38.911158 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.911221 (+ 63us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.911256 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.911404 (+ 148us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.911470 (+ 66us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.911482 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:38.911584 (+ 102us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.911647 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.911675 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:38.911684 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":517,"apply.run_cpu_time_us":622,"apply.run_wall_time_us":621,"num_ops":2,"prepare.queue_time_us":8158,"prepare.run_cpu_time_us":745,"prepare.run_wall_time_us":745,"raft.queue_time_us":1109,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":299,"replication_time_us":4248}]]}
I20260505 20:13:38.916698 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_119a805c79074b88a4c5e8fd03583d77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.917598 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_119a805c79074b88a4c5e8fd03583d77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:38.918340 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:38.919021 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7214ab77d7904f0e9d37cb8d7a5a53a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.919205 7658 raft_consensus.cc:2468] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:38.919750 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168d9a40a69d4beab8e79a97e7723e69" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:38.922535 7870 leader_election.cc:343] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.922701 7870 leader_election.cc:304] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:38.923020 9403 raft_consensus.cc:2749] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:38.924273 9421 tablet.cc:1724] T b9d2b417857347468529868b51ec07ab P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:38.925271 7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.925518 7925 raft_consensus.cc:2468] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
W20260505 20:13:38.927023 7870 consensus_peers.cc:597] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:38.927932 7870 leader_election.cc:343] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.930903 9415 tablet.cc:1724] T 20bdc29641404cee850f27e9c392fbc0 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:38.931559 7870 leader_election.cc:343] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:38.939602 7870 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:38.940279 7870 leader_election.cc:343] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.942389 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 101) took 1053 ms. Trace:
I20260505 20:13:38.942607 7409 rpcz_store.cc:276] 0505 20:13:37.888742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.916455 (+1027713us) service_pool.cc:224] Handling call
0505 20:13:38.917796 (+ 1341us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.918911 (+ 1115us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.941939 (+ 23028us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.941952 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:38.942071 (+ 119us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.942221 (+ 150us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.942344 (+ 123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.921855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.921998 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.922007 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:38.922012 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:38.922129 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.922146 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.922153 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.922228 (+ 75us) tablet.cc:701] Row locks acquired
0505 20:13:38.922232 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:38.922266 (+ 34us) write_op.cc:270] Start()
0505 20:13:38.922297 (+ 31us) write_op.cc:276] Timestamp: P: 1778012018922444 usec, L: 0
0505 20:13:38.922301 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.922484 (+ 183us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.926098 (+ 3614us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.926247 (+ 149us) write_op.cc:301] APPLY: starting
0505 20:13:38.926264 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.926314 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.926353 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.926458 (+ 105us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.926514 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.926526 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:38.926604 (+ 78us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.926670 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.926702 (+ 32us) write_op.cc:454] Released schema lock
0505 20:13:38.926708 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":514,"apply.run_wall_time_us":514,"num_ops":2,"prepare.queue_time_us":2376,"prepare.run_cpu_time_us":756,"prepare.run_wall_time_us":756,"raft.queue_time_us":1006,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":217,"replication_time_us":3766}]]}
I20260505 20:13:38.943548 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.944234 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f1318ef5bf439f97de685ae7d6f462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.944475 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_1d096597f5214bc6b4c42eb448e89612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:38.945392 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d096597f5214bc6b4c42eb448e89612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:38.945986 7870 leader_election.cc:343] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:38.946633 9349 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.627s user 0.007s sys 0.006s
W20260505 20:13:38.946708 9349 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.627s user 0.007s sys 0.006s
I20260505 20:13:38.958455 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d5ef7ac5f44d1c9c77e2e50ab2ea5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.958464 9135 raft_consensus.cc:493] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.958628 9135 raft_consensus.cc:515] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:38.959233 9135 leader_election.cc:290] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.959272 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4a8afcd1a64ddeb23a9c91a4060130. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:38.959558 7870 leader_election.cc:343] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.959720 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566a6942cc904468a0cab3deae8a860b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.960265 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:38.960978 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de7b1e87b754414bb2ef025130ae6b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.961501 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7085351ba8e4c78b684894460cec8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.962862 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:38.963047 7936 raft_consensus.cc:2468] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:38.963851 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0413d400b0f543509d2e68cb8d0ffdbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:38.964895 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe467e4f37442c19fcfe54f94e71657. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:38.965355 9190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s user 0.001s sys 0.011s
W20260505 20:13:38.965531 9190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s user 0.001s sys 0.011s
I20260505 20:13:38.967916 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff674539e1045408c212b533ca8a3db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:38.968463 8058 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.777s user 0.020s sys 0.032s
W20260505 20:13:38.968659 8058 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.777s user 0.020s sys 0.032s
I20260505 20:13:38.970018 8058 tablet_bootstrap.cc:492] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:38.970258 8058 ts_tablet_manager.cc:1403] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.782s user 0.022s sys 0.032s
I20260505 20:13:38.974056 8718 raft_consensus.cc:493] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:38.974267 8718 raft_consensus.cc:515] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:38.974401 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:38.975538 9219 consensus_queue.cc:1048] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.976404 9028 consensus_queue.cc:1048] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:38.977171 7598 leader_election.cc:304] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:38.977633 7870 leader_election.cc:343] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:38.978374 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 102) took 1076 ms. Trace:
I20260505 20:13:38.978725 8053 tablet_bootstrap.cc:492] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:38.978902 8053 ts_tablet_manager.cc:1403] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.348s user 0.001s sys 0.010s
I20260505 20:13:38.979768 8053 raft_consensus.cc:359] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.979954 8053 raft_consensus.cc:385] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:38.980041 8053 raft_consensus.cc:740] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:38.980234 8053 consensus_queue.cc:260] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.979861 7409 rpcz_store.cc:276] 0505 20:13:37.901613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.944203 (+1042590us) service_pool.cc:224] Handling call
0505 20:13:38.945619 (+ 1416us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:38.946156 (+ 537us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:38.977998 (+ 31842us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.978006 (+ 8us) write_op.cc:454] Released schema lock
0505 20:13:38.978097 (+ 91us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:38.978220 (+ 123us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:38.978331 (+ 111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.951266 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.951442 (+ 176us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.951450 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:38.951455 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:38.951594 (+ 139us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.951614 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.951621 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:38.951767 (+ 146us) tablet.cc:701] Row locks acquired
0505 20:13:38.951771 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:38.951818 (+ 47us) write_op.cc:270] Start()
0505 20:13:38.951865 (+ 47us) write_op.cc:276] Timestamp: P: 1778012018952002 usec, L: 0
0505 20:13:38.951872 (+ 7us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.952122 (+ 250us) log.cc:844] Serialized 433 byte log entry
0505 20:13:38.956553 (+ 4431us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.956708 (+ 155us) write_op.cc:301] APPLY: starting
0505 20:13:38.956731 (+ 23us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.956792 (+ 61us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.956841 (+ 49us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.956993 (+ 152us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.957045 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:38.957057 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:38.957157 (+ 100us) log.cc:844] Serialized 29 byte log entry
0505 20:13:38.957249 (+ 92us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.957277 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:38.957287 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":664,"apply.run_wall_time_us":663,"num_ops":2,"prepare.queue_time_us":4560,"prepare.run_cpu_time_us":1008,"prepare.run_wall_time_us":1008,"raft.queue_time_us":1365,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":327,"replication_time_us":4652}]]}
I20260505 20:13:38.980757 8053 ts_tablet_manager.cc:1434] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:38.979701 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:38.985775 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:38.986239 9138 raft_consensus.cc:515] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:38.986690 7924 raft_consensus.cc:2468] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:38.987150 9270 ts_tablet_manager.cc:1929] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:38.987251 9270 log.cc:1199] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e041ebc882b14484a51fe3a6589cddd6
I20260505 20:13:38.987625 9270 ts_tablet_manager.cc:1950] T e041ebc882b14484a51fe3a6589cddd6 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:38.988296 9271 ts_tablet_manager.cc:1929] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:38.988391 9271 log.cc:1199] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/4628e33d204c452ab12acf76f754f2ad
I20260505 20:13:38.988854 9271 ts_tablet_manager.cc:1950] T 4628e33d204c452ab12acf76f754f2ad P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:38.989552 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:38.989873 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:38.990293 7409 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_b05a62cc3a7e446e915328413ead238d" } modify_external_catalogs: true
I20260505 20:13:38.991344 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:38.991384 7409 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_b05a62cc3a7e446e915328413ead238d" } modify_external_catalogs: true
I20260505 20:13:38.993532 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:38.996850 8053 tablet_bootstrap.cc:492] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:38.997768 9138 leader_election.cc:290] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:38.998447 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:38.998584 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:38.999810 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:39.001714 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_d788352d297e44d1874caf109ffc646c [id=0b04ae6c921741049ea506fe8323865c]). Expected version 1 got 0
I20260505 20:13:39.009985 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:39.012270 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:39.013929 8718 leader_election.cc:290] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:39.013724 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:39.018504 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:39.019910 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0dd5d7870453bb1b771405daeb22f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.021170 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.021243 7737 leader_election.cc:304] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.022260 7737 leader_election.cc:304] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.022701 9138 raft_consensus.cc:2804] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.022226 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:39.022827 9138 raft_consensus.cc:697] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:39.022881 9371 raft_consensus.cc:2804] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.022964 9371 raft_consensus.cc:697] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:39.020442 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.025837 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 89) took 1776 ms. Trace:
I20260505 20:13:39.022490 7737 leader_election.cc:304] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.027427 9242 raft_consensus.cc:2804] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.027518 9242 raft_consensus.cc:493] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.027583 9242 raft_consensus.cc:3060] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.027495 7737 leader_election.cc:304] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.023056 9138 consensus_queue.cc:237] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.031576 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
W20260505 20:13:39.033978 7737 leader_election.cc:343] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 506b421a774c4929813205dba0fac32b
I20260505 20:13:39.033691 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:39.034499 7737 leader_election.cc:304] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.034933 8989 consensus_queue.cc:1048] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260505 20:13:39.025938 9271 rpcz_store.cc:276] 0505 20:13:37.249090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.250639 (+ 1549us) service_pool.cc:224] Handling call
0505 20:13:38.102800 (+852161us) ts_tablet_manager.cc:1151] Deleting tablet 4628e33d204c452ab12acf76f754f2ad
0505 20:13:38.102815 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:38.675041 (+572226us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:38.988236 (+313195us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.025820 (+ 37584us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":851991}
I20260505 20:13:39.044328 9271 tablet_replica.cc:333] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:39.044595 9271 raft_consensus.cc:2243] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:39.044793 9271 raft_consensus.cc:2272] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.045467 9271 ts_tablet_manager.cc:1916] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:39.046077 8989 raft_consensus.cc:2804] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.046167 8989 raft_consensus.cc:493] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.046222 8989 raft_consensus.cc:3060] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.023119 9371 consensus_queue.cc:237] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.049955 9156 raft_consensus.cc:2804] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.050143 9156 raft_consensus.cc:493] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.050303 9156 raft_consensus.cc:3060] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.052444 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.053853 9219 consensus_queue.cc:1048] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:39.054951 9368 raft_consensus.cc:493] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:39.054944 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 77435.2us
I20260505 20:13:39.055145 9368 raft_consensus.cc:515] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.055876 9368 leader_election.cc:290] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.056980 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 87) took 1794 ms. Trace:
I20260505 20:13:39.056569 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:39.057103 9270 rpcz_store.cc:276] 0505 20:13:37.262205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.262351 (+ 146us) service_pool.cc:224] Handling call
0505 20:13:38.057284 (+794933us) ts_tablet_manager.cc:1151] Deleting tablet e041ebc882b14484a51fe3a6589cddd6
0505 20:13:38.057298 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:38.787153 (+729855us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:38.987079 (+199926us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.056949 (+ 69870us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106295,"tablet-delete.queue_time_us":794780}
I20260505 20:13:39.057682 9270 tablet_replica.cc:333] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:39.057982 9270 raft_consensus.cc:2243] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:39.058308 9270 raft_consensus.cc:2272] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.059046 9270 ts_tablet_manager.cc:1916] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:39.061117 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e041ebc882b14484a51fe3a6589cddd6 (table default.Table_90124bd7f0774a3ab49bcd90a3ec3733 [id=d4a0d51cd26f49eab032102e2064e622]) successfully deleted
I20260505 20:13:39.062736 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:38.971354 8058 raft_consensus.cc:359] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.067550 8058 raft_consensus.cc:385] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.067677 8058 raft_consensus.cc:740] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.068019 8058 consensus_queue.cc:260] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.068835 8058 ts_tablet_manager.cc:1434] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.098s user 0.002s sys 0.000s
I20260505 20:13:39.069253 8058 tablet_bootstrap.cc:492] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.071393 8058 tablet_bootstrap.cc:654] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.076725 8053 tablet_bootstrap.cc:654] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.081478 9437 raft_consensus.cc:493] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.081853 9437 raft_consensus.cc:515] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.082808 9437 leader_election.cc:290] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.083082 9437 raft_consensus.cc:2804] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.083280 9437 raft_consensus.cc:697] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:39.083667 9437 consensus_queue.cc:237] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:39.085848 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 51385.8us
I20260505 20:13:39.086149 7737 leader_election.cc:304] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.086252 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 4628e33d204c452ab12acf76f754f2ad (table default.Table_6de073da4783421daab1910cc27d67f7 [id=607b2027efa648778bfe22e03371919e]) successfully deleted
W20260505 20:13:39.087249 7869 leader_election.cc:343] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.087316 9242 raft_consensus.cc:515] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.087391 7869 leader_election.cc:304] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.087819 9242 leader_election.cc:290] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.087916 9368 raft_consensus.cc:2749] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.087965 9242 raft_consensus.cc:2804] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.088043 9242 raft_consensus.cc:697] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:39.088253 9242 consensus_queue.cc:237] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.088472 8989 raft_consensus.cc:515] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.088757 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:39.089057 8989 leader_election.cc:290] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:39.091419 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:39.091949 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 50680deff6fe4dcabbf5a3aeb47ac01e (table default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd]). Expected version 2 got 0
I20260505 20:13:39.092445 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:39.091634 9156 raft_consensus.cc:515] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.093729 9156 leader_election.cc:290] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:39.094471 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
W20260505 20:13:39.095767 7869 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.095960 7869 leader_election.cc:304] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.096474 9368 raft_consensus.cc:2749] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.097262 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bfd96314244e6cbbb4d5b48841e06f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.097522 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.097581 7923 raft_consensus.cc:2468] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.097800 7924 raft_consensus.cc:2393] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:39.097961 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
W20260505 20:13:39.098408 7869 leader_election.cc:343] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.098536 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:39.098543 7869 leader_election.cc:304] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:39.098544 7598 leader_election.cc:343] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:39.098898 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_af2341b021674fe494cd635374e98c3e [id=3734c4511d224584aeed0efd6bac453d]). Expected version 1 got 0
I20260505 20:13:39.098978 9368 raft_consensus.cc:2749] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.101241 7869 leader_election.cc:343] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.101420 7869 leader_election.cc:304] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.101886 9368 raft_consensus.cc:2749] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.104605 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet b9d2b417857347468529868b51ec07ab (table default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd]). Expected version 1 got 0
I20260505 20:13:39.105536 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 20bdc29641404cee850f27e9c392fbc0 (table default.Table_f8a78065267349b482f885d8be417dbf [id=2e394d60c73d48ad9efb558eb5df83a0]). Expected version 1 got 0
I20260505 20:13:39.106554 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:39.107669 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:39.108268 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:39.109052 7406 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:39.109999 7413 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_e152f139ba5447bda8846c89d2ea6628 [id=1ed317cfce51417387701aaed2ebdc70] alter complete (version 2)
I20260505 20:13:39.112257 9354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47850 (request call id 200) took 1064 ms. Trace:
I20260505 20:13:39.112363 9354 rpcz_store.cc:276] 0505 20:13:38.047698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.047765 (+ 67us) service_pool.cc:224] Handling call
0505 20:13:39.112190 (+1064425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.048236 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0505 20:13:38.048339 (+ 103us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0505 20:13:38.048349 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0505 20:13:38.048355 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0505 20:13:38.048393 (+ 38us) alter_schema_op.cc:128] START. Timestamp: 1778012018048421
0505 20:13:38.048397 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.048593 (+ 196us) log.cc:844] Serialized 173 byte log entry
0505 20:13:38.319570 (+270977us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.656136 (+336566us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0505 20:13:38.960833 (+304697us) log.cc:844] Serialized 5 byte log entry
0505 20:13:39.111724 (+150891us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.112061 (+ 337us) log.cc:844] Serialized 14 byte log entry
0505 20:13:39.112125 (+ 64us) alter_schema_op.cc:73] Released schema lock
0505 20:13:39.112132 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":336481,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":8191,"prepare.run_wall_time_us":15901,"raft.queue_time_us":89,"raft.run_cpu_time_us":735,"raft.run_wall_time_us":732,"replication_time_us":271139,"spinlock_wait_cycles":768,"thread_start_us":641373,"threads_started":2,"wal-append.queue_time_us":14412}]]}
I20260505 20:13:39.117259 9436 raft_consensus.cc:493] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.117509 9436 raft_consensus.cc:515] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.118221 9436 leader_election.cc:290] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:39.118727 7405 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 616cd8f1a6124d2e89e170c5e1ff2385 consensus state has no leader
I20260505 20:13:39.118947 7405 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 92) took 1689 ms. Trace:
I20260505 20:13:39.119030 7405 rpcz_store.cc:276] 0505 20:13:37.429643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.507718 (+1078075us) service_pool.cc:224] Handling call
0505 20:13:38.547529 (+ 39811us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:38.547795 (+ 266us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:38.548025 (+ 230us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:38.548134 (+ 109us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:38.716841 (+168707us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:39.118885 (+402044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.565245 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.565440 (+ 195us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.565449 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:38.565454 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:38.565602 (+ 148us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.565616 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.565623 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.565707 (+ 84us) tablet.cc:701] Row locks acquired
0505 20:13:38.565712 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:38.565813 (+ 101us) write_op.cc:270] Start()
0505 20:13:38.565867 (+ 54us) write_op.cc:276] Timestamp: P: 1778012018565841 usec, L: 0
0505 20:13:38.565874 (+ 7us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.640157 (+ 74283us) log.cc:844] Serialized 405 byte log entry
0505 20:13:38.640690 (+ 533us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:38.713676 (+ 72986us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.715241 (+ 1565us) write_op.cc:301] APPLY: starting
0505 20:13:38.715253 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.715284 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.715288 (+ 4us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.715325 (+ 37us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.715358 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.715368 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:38.715441 (+ 73us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.715485 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.715499 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:38.715512 (+ 13us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1519,"apply.run_cpu_time_us":328,"apply.run_wall_time_us":327,"num_ops":1,"prepare.queue_time_us":16491,"prepare.run_cpu_time_us":1673,"prepare.run_wall_time_us":75590,"raft.queue_time_us":60,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":147772,"spinlock_wait_cycles":170384256,"thread_start_us":54626,"threads_started":1}]]}
I20260505 20:13:39.119927 7405 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f7765b40e19645f281ad2da563b7a009" } modify_external_catalogs: true
I20260505 20:13:39.120115 7405 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f7765b40e19645f281ad2da563b7a009" } modify_external_catalogs: true
W20260505 20:13:39.120175 7869 leader_election.cc:343] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.120304 7869 leader_election.cc:304] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.120741 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.121016 7923 raft_consensus.cc:2468] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.121457 9402 raft_consensus.cc:2749] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.121500 7407 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f54b7c83e66c473db8470e5c4c4decab consensus state has no leader
I20260505 20:13:39.121678 7407 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 91) took 1704 ms. Trace:
I20260505 20:13:39.121793 7407 rpcz_store.cc:276] 0505 20:13:37.417079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.499633 (+1082554us) service_pool.cc:224] Handling call
0505 20:13:38.531293 (+ 31660us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:38.531505 (+ 212us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:38.531705 (+ 200us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:38.531777 (+ 72us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:38.716053 (+184276us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:39.121620 (+405567us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.555295 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.555413 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.555421 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:38.555423 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:38.555523 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.555534 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.555539 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.555602 (+ 63us) tablet.cc:701] Row locks acquired
0505 20:13:38.555604 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.555636 (+ 32us) write_op.cc:270] Start()
0505 20:13:38.555676 (+ 40us) write_op.cc:276] Timestamp: P: 1778012018555669 usec, L: 0
0505 20:13:38.555681 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.555876 (+ 195us) log.cc:844] Serialized 405 byte log entry
0505 20:13:38.713044 (+157168us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.713983 (+ 939us) write_op.cc:301] APPLY: starting
0505 20:13:38.714009 (+ 26us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.714067 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.714097 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.714165 (+ 68us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.714210 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.714218 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:38.714328 (+ 110us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.714408 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.714434 (+ 26us) write_op.cc:454] Released schema lock
0505 20:13:38.714443 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.714557 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.714564 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":864,"apply.run_cpu_time_us":568,"apply.run_wall_time_us":567,"num_ops":1,"prepare.queue_time_us":23082,"prepare.run_cpu_time_us":677,"prepare.run_wall_time_us":676,"raft.queue_time_us":1860,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":5,"replication_time_us":157316}]]}
I20260505 20:13:39.122676 7407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_bdbb2d2d9d3a41e78b2984438918dce3" } new_table_name: "default.Table_bf48cc2ebe77443c9853c922b28b8897" modify_external_catalogs: true
W20260505 20:13:39.123422 7869 leader_election.cc:343] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.123538 7869 leader_election.cc:304] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.123680 7598 leader_election.cc:304] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:39.124092 9349 raft_consensus.cc:2804] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.124168 9349 raft_consensus.cc:493] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.124226 9349 raft_consensus.cc:3060] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:39.124269 7598 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:39.127367 9402 raft_consensus.cc:2749] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.128647 7869 leader_election.cc:343] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.129045 7869 leader_election.cc:304] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.129541 9402 raft_consensus.cc:2749] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.132616 7407 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53f1318ef5bf439f97de685ae7d6f462 consensus state has no leader
I20260505 20:13:39.133034 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_225b81788b06457ba1ad9809609dc97d" } modify_external_catalogs: true
I20260505 20:13:39.133188 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_225b81788b06457ba1ad9809609dc97d" } modify_external_catalogs: true
I20260505 20:13:39.134227 9436 raft_consensus.cc:493] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.134416 9436 raft_consensus.cc:515] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.134999 9436 leader_election.cc:290] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:39.135375 7404 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95c591e3f33d4606be7181e380fadcf6 consensus state has no leader
I20260505 20:13:39.135496 7412 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_a65a6e246b6348ce8bf48dc0d2b13c86 [id=bad5400c5cdc48eea57213e792147647] alter complete (version 3)
I20260505 20:13:39.135568 7404 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 90) took 1718 ms. Trace:
I20260505 20:13:39.135653 7404 rpcz_store.cc:276] 0505 20:13:37.416964 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.495457 (+1078493us) service_pool.cc:224] Handling call
0505 20:13:38.495860 (+ 403us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:38.496141 (+ 281us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:38.530743 (+ 34602us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:38.530861 (+ 118us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:38.558849 (+ 27988us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:39.135506 (+576657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.532294 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.532403 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.532409 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:38.532412 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.532514 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.532530 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.532534 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.532599 (+ 65us) tablet.cc:701] Row locks acquired
0505 20:13:38.532602 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:38.532636 (+ 34us) write_op.cc:270] Start()
0505 20:13:38.532680 (+ 44us) write_op.cc:276] Timestamp: P: 1778012018532658 usec, L: 0
0505 20:13:38.532683 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.532885 (+ 202us) log.cc:844] Serialized 405 byte log entry
0505 20:13:38.557947 (+ 25062us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.558303 (+ 356us) write_op.cc:301] APPLY: starting
0505 20:13:38.558325 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.558403 (+ 78us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.558447 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.558507 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.558553 (+ 46us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.558562 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:38.558649 (+ 87us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.558711 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.558732 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:38.558741 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.558830 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.558834 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":300,"apply.run_cpu_time_us":518,"apply.run_wall_time_us":518,"num_ops":1,"prepare.queue_time_us":767,"prepare.run_cpu_time_us":707,"prepare.run_wall_time_us":707,"raft.queue_time_us":10079,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":346,"replication_time_us":25233}]]}
I20260505 20:13:39.136397 7404 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_cc693952864d4827804cf959c57b2435" } modify_external_catalogs: true
I20260505 20:13:39.136557 7404 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_cc693952864d4827804cf959c57b2435" } modify_external_catalogs: true
I20260505 20:13:39.144109 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:39.146473 7870 leader_election.cc:343] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.150630 8054 tablet_bootstrap.cc:492] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.150857 8054 ts_tablet_manager.cc:1403] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.250s user 0.006s sys 0.000s
I20260505 20:13:39.150821 9354 tablet.cc:1724] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:39.151829 8054 raft_consensus.cc:359] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.152127 8054 raft_consensus.cc:385] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.152248 8054 raft_consensus.cc:740] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.152510 8054 consensus_queue.cc:260] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.165812 7405 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 5060bba634d440a09840e36e37a80d46
I20260505 20:13:39.166702 7405 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_2329ffef76eb4466bffb67019f9ad8ca" } modify_external_catalogs: true
I20260505 20:13:39.166905 7405 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_2329ffef76eb4466bffb67019f9ad8ca" } modify_external_catalogs: true
I20260505 20:13:39.175357 7404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 3dbc2221555e4f598d65835ae640fe4a
I20260505 20:13:39.176170 7404 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_59e5c20b026c4ceb9e6452635dffc57f" } new_table_name: "default.Table_0432c9aaef794e18aacbe94ea9a7ff5c" modify_external_catalogs: true
I20260505 20:13:39.181444 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "506b421a774c4929813205dba0fac32b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:39.181677 7661 raft_consensus.cc:3060] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.184372 9349 raft_consensus.cc:515] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.185111 9349 leader_election.cc:290] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:39.182749 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94fc0e6ac0fa4f8bbaef2fcf1ecbbd70" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:39.190493 7662 raft_consensus.cc:3060] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.192301 7801 raft_consensus.cc:3060] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.200003 9271 ts_tablet_manager.cc:1929] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:39.200361 9271 log.cc:1199] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e041ebc882b14484a51fe3a6589cddd6
I20260505 20:13:39.201555 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 5060bba634d440a09840e36e37a80d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:39.202095 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dbc2221555e4f598d65835ae640fe4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:39.202123 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.202294 7802 raft_consensus.cc:2468] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:39.202375 8989 raft_consensus.cc:493] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.202481 8989 raft_consensus.cc:515] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.203033 8989 leader_election.cc:290] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.203379 8989 raft_consensus.cc:493] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.203497 8989 raft_consensus.cc:515] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.203889 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.203998 8989 leader_election.cc:290] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:39.204555 7404 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 335acbbc84624d61b779a422f29919fa consensus state has no leader
I20260505 20:13:39.204909 7404 master_service.cc:954] ReplaceTablet: received request to replace tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:39.206490 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dbc2221555e4f598d65835ae640fe4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.211859 7762 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 131) took 1182 ms. Trace:
I20260505 20:13:39.212073 7762 rpcz_store.cc:276] 0505 20:13:38.029852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.029924 (+ 72us) service_pool.cc:224] Handling call
0505 20:13:38.693241 (+663317us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x6160001b4054. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:39.211822 (+518581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854900480}
I20260505 20:13:39.215318 7413 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890] alter complete (version 1)
I20260505 20:13:39.221735 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7214ab77d7904f0e9d37cb8d7a5a53a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:39.222040 7658 raft_consensus.cc:3060] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.222944 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.223172 7660 raft_consensus.cc:2393] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:39.223459 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d4e198c91c4a0e99d8b798a1dd3433" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.165113 9368 raft_consensus.cc:493] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.223948 9368 raft_consensus.cc:515] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.175307 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 5060bba634d440a09840e36e37a80d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.225128 9368 leader_election.cc:290] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.178102 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:39.225564 7936 raft_consensus.cc:3060] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.179348 9415 tablet.cc:1724] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:39.182657 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dbc2221555e4f598d65835ae640fe4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.200776 9429 raft_consensus.cc:493] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.223479 9402 raft_consensus.cc:493] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.227568 9402 raft_consensus.cc:515] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.227737 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.228296 9402 leader_election.cc:290] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.228387 8054 ts_tablet_manager.cc:1434] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.077s user 0.002s sys 0.000s
I20260505 20:13:39.228797 8054 tablet_bootstrap.cc:492] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.228839 9429 raft_consensus.cc:515] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.229934 9429 leader_election.cc:290] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:39.232646 7870 leader_election.cc:343] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.233376 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.233467 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 5060bba634d440a09840e36e37a80d46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.233847 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.240957 7736 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.241523 7736 leader_election.cc:304] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.242153 9436 raft_consensus.cc:2749] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.250759 7758 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 133) took 1201 ms. Trace:
W20260505 20:13:39.250804 7870 leader_election.cc:343] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.251009 7758 rpcz_store.cc:276] 0505 20:13:38.049461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.049519 (+ 58us) service_pool.cc:224] Handling call
0505 20:13:38.604223 (+554704us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x6160001b4054. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:38.824543 (+220320us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x618000061c8c. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf186452e 00007fdbf165f25c 00007fdbf418bcb8 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8
0505 20:13:39.243685 (+419142us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x616000133354. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:39.250738 (+ 7053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062492672}
I20260505 20:13:39.251456 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
W20260505 20:13:39.251984 7870 leader_election.cc:343] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.252333 7924 raft_consensus.cc:3060] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.258669 7795 raft_consensus.cc:3060] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.259706 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.259929 7800 raft_consensus.cc:2393] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:39.259946 7793 raft_consensus.cc:3060] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.261976 7404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_ce966f7989d74488a1ee2deb24e99c67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.262576 7404 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce966f7989d74488a1ee2deb24e99c67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.263622 9219 consensus_queue.cc:1048] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:39.265978 7736 leader_election.cc:343] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.269006 9293 tablet.cc:1724] T d411638715f747469f9f3dc490c0257c P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:39.270910 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:39.271178 7792 raft_consensus.cc:2393] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:39.271099 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:39.271288 7799 raft_consensus.cc:3060] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.273027 9190 consensus_queue.cc:1048] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:39.273875 9242 consensus_queue.cc:1048] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:39.277848 9242 consensus_queue.cc:1048] T f29fd054d41e4c48ab0da8dec2b952d5 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:39.279363 7736 leader_election.cc:343] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.279868 7736 leader_election.cc:304] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.280524 9138 consensus_queue.cc:1048] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:39.281136 7736 leader_election.cc:343] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.288317 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:39.289455 9444 log.cc:927] Time spent T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
W20260505 20:13:39.289587 8889 log.cc:927] Time spent T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260505 20:13:39.291394 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 59f5348c229744ab98f0de3da40de6c5
I20260505 20:13:39.291503 9271 ts_tablet_manager.cc:1950] T e041ebc882b14484a51fe3a6589cddd6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:39.292115 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_acc159ccea854f3cb3316337e3034cf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.292759 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acc159ccea854f3cb3316337e3034cf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.295876 8054 tablet_bootstrap.cc:654] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.298235 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 59f5348c229744ab98f0de3da40de6c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:39.300806 9121 ts_tablet_manager.cc:1929] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:39.300977 9121 log.cc:1199] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/249cad23ecfe4b9dbbd34f2a1fa899e3
I20260505 20:13:39.301391 9121 ts_tablet_manager.cc:1950] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:39.301934 7662 raft_consensus.cc:2468] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.303647 7635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47850 (request call id 208) took 1107 ms. Trace:
I20260505 20:13:39.303736 7635 rpcz_store.cc:276] 0505 20:13:38.196532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.196593 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:38.198673 (+ 2080us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:38.198712 (+ 39us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:39.015009 (+816297us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.303454 (+288445us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:39.303628 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:39.308897 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.309769 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 59f5348c229744ab98f0de3da40de6c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.309980 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.310496 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.310583 9436 raft_consensus.cc:2749] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.311269 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:39.312161 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d4e198c91c4a0e99d8b798a1dd3433" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:39.312332 7923 raft_consensus.cc:3060] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.313791 7405 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 5b6326375bac48f0944eeeaa9b39682c
I20260505 20:13:39.314793 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b6326375bac48f0944eeeaa9b39682c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.315043 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.315279 7929 raft_consensus.cc:2393] T 982da795cf2c4e578f3392066b1cc1ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:39.317327 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.318003 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 6166653cbc58470c8ba4926048ba1384
I20260505 20:13:39.318091 9270 ts_tablet_manager.cc:1929] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:39.318219 9270 log.cc:1199] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:39.318575 7408 catalog_manager.cc:6741] ReplaceTablet: tablet 6166653cbc58470c8ba4926048ba1384 deleted and replaced by tablet 051c258c37544e639000578b1b017abb
I20260505 20:13:39.318631 9270 ts_tablet_manager.cc:1950] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:39.318696 7408 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 98) took 1498 ms. Trace:
I20260505 20:13:39.318849 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.319012 7929 raft_consensus.cc:2468] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.318802 7408 rpcz_store.cc:276] 0505 20:13:37.819784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.858258 (+1038474us) service_pool.cc:224] Handling call
0505 20:13:39.318664 (+460406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:39.257677 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:39.257831 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:39.257836 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:39.257838 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:39.257935 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:39.257945 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:39.257949 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:39.258013 (+ 64us) tablet.cc:701] Row locks acquired
0505 20:13:39.258015 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:39.258045 (+ 30us) write_op.cc:270] Start()
0505 20:13:39.258077 (+ 32us) write_op.cc:276] Timestamp: P: 1778012019258149 usec, L: 0
0505 20:13:39.258083 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:39.258242 (+ 159us) log.cc:844] Serialized 659 byte log entry
0505 20:13:39.311757 (+ 53515us) op_driver.cc:464] REPLICATION: finished
0505 20:13:39.312631 (+ 874us) write_op.cc:301] APPLY: starting
0505 20:13:39.312645 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:39.312682 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:39.312715 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:39.312818 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:39.312869 (+ 51us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:39.312878 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:39.312942 (+ 64us) log.cc:844] Serialized 29 byte log entry
0505 20:13:39.312987 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.313002 (+ 15us) write_op.cc:454] Released schema lock
0505 20:13:39.313008 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:39.313077 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.313081 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":837,"apply.run_cpu_time_us":441,"apply.run_wall_time_us":441,"num_ops":2,"prepare.queue_time_us":216,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":661,"raft.queue_time_us":65,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":53654}]]}
I20260505 20:13:39.319963 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet ca16deae2e4f4f9a9069822b57c5bc7f
I20260505 20:13:39.323895 8058 tablet_bootstrap.cc:492] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.324047 8058 ts_tablet_manager.cc:1403] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.255s user 0.003s sys 0.002s
I20260505 20:13:39.324975 8058 raft_consensus.cc:359] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.325172 8058 raft_consensus.cc:385] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.325233 8058 raft_consensus.cc:740] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.325445 8058 consensus_queue.cc:260] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.326740 8053 tablet_bootstrap.cc:492] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:39.326903 8053 ts_tablet_manager.cc:1403] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.344s user 0.002s sys 0.007s
I20260505 20:13:39.333428 7596 leader_election.cc:304] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:39.333722 9219 raft_consensus.cc:2749] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:39.334882 7777 tablet_service.cc:1558] Processing DeleteTablet for tablet 6166653cbc58470c8ba4926048ba1384 with delete_type TABLET_DATA_DELETED (replaced by tablet 051c258c37544e639000578b1b017abb) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:39.334942 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet ca16deae2e4f4f9a9069822b57c5bc7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:38 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:39.335119 7778 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b6326375bac48f0944eeeaa9b39682c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:39.335896 8053 raft_consensus.cc:359] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.336352 8053 raft_consensus.cc:385] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.336467 8053 raft_consensus.cc:740] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.336767 8053 consensus_queue.cc:260] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.337810 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 6166653cbc58470c8ba4926048ba1384 with delete_type TABLET_DATA_DELETED (replaced by tablet 051c258c37544e639000578b1b017abb) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.338297 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b6326375bac48f0944eeeaa9b39682c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.338471 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet ca16deae2e4f4f9a9069822b57c5bc7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:38 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.339037 8058 ts_tablet_manager.cc:1434] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260505 20:13:39.339423 8058 tablet_bootstrap.cc:492] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.340394 8053 ts_tablet_manager.cc:1434] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.013s user 0.002s sys 0.002s
I20260505 20:13:39.344200 8054 tablet_bootstrap.cc:492] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.344369 8054 ts_tablet_manager.cc:1403] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.116s user 0.000s sys 0.003s
I20260505 20:13:39.345340 8054 raft_consensus.cc:359] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.345557 8054 raft_consensus.cc:385] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.345659 8054 raft_consensus.cc:740] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.345950 8054 consensus_queue.cc:260] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.341632 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:39.347922 8058 tablet_bootstrap.cc:654] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.349068 8053 tablet_bootstrap.cc:492] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:39.341933 9437 raft_consensus.cc:493] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.349839 9437 raft_consensus.cc:515] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.350546 9437 leader_election.cc:290] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.342128 9371 raft_consensus.cc:493] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.350803 9371 raft_consensus.cc:515] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.351415 9371 leader_election.cc:290] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:39.353338 8053 tablet_bootstrap.cc:654] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:39.344554 7764 consensus_meta.cc:287] T 566a6942cc904468a0cab3deae8a860b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.714s user 0.017s sys 0.002s
I20260505 20:13:39.357149 7764 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 192) took 1163 ms. Trace:
I20260505 20:13:39.357151 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet 59f5348c229744ab98f0de3da40de6c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.357249 7764 rpcz_store.cc:276] 0505 20:13:38.193412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.193533 (+ 121us) service_pool.cc:224] Handling call
0505 20:13:38.194068 (+ 535us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:38.194092 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:38.630422 (+436330us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.356975 (+726553us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:39.357133 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:39.351253 9429 raft_consensus.cc:493] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.355760 9421 tablet.cc:1724] T d411638715f747469f9f3dc490c0257c P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:39.359280 8054 ts_tablet_manager.cc:1434] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260505 20:13:39.359855 9429 raft_consensus.cc:515] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.361290 9429 leader_election.cc:290] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.361346 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 6166653cbc58470c8ba4926048ba1384 with delete_type TABLET_DATA_DELETED (replaced by tablet 051c258c37544e639000578b1b017abb) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.361292 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet ca16deae2e4f4f9a9069822b57c5bc7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:38 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.363780 8054 tablet_bootstrap.cc:492] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:39.368952 7869 leader_election.cc:343] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.369194 7869 leader_election.cc:304] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.369464 9207 raft_consensus.cc:2749] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.372284 7869 leader_election.cc:343] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.373277 7869 leader_election.cc:304] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.374378 9207 raft_consensus.cc:2749] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.374771 9371 raft_consensus.cc:493] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.374914 9371 raft_consensus.cc:515] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:39.375245 7596 leader_election.cc:343] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:39.375368 7596 leader_election.cc:304] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:39.375569 9371 leader_election.cc:290] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.375624 9190 raft_consensus.cc:2749] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.376031 7869 leader_election.cc:343] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.376161 7869 leader_election.cc:304] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.379726 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:39.381933 9207 raft_consensus.cc:2749] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.381945 9371 raft_consensus.cc:493] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.382056 9371 raft_consensus.cc:515] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:39.382269 7598 consensus_peers.cc:597] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 089517a7c2214dce9367b21beb555733. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:39.382357 7869 leader_election.cc:343] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.382467 7869 leader_election.cc:304] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.382685 9371 leader_election.cc:290] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.382699 9207 raft_consensus.cc:2749] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.383518 7737 leader_election.cc:304] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.383857 9371 raft_consensus.cc:2804] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.383937 9371 raft_consensus.cc:493] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.384009 9371 raft_consensus.cc:3060] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.384891 7737 leader_election.cc:304] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.385453 9437 raft_consensus.cc:2804] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.385556 9437 raft_consensus.cc:493] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.385629 9437 raft_consensus.cc:3060] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:39.386174 7737 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:39.386871 7737 leader_election.cc:304] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.387166 9138 raft_consensus.cc:2804] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.387250 9138 raft_consensus.cc:493] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.387326 9138 raft_consensus.cc:3060] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.389814 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c720fc66db36402a83a7690d70a40353" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.390054 7926 raft_consensus.cc:2468] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.389842 7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.390247 7927 raft_consensus.cc:2468] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.391887 8054 tablet_bootstrap.cc:654] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.399490 7661 raft_consensus.cc:2468] T 506b421a774c4929813205dba0fac32b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.402628 8058 tablet_bootstrap.cc:492] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.402765 8058 ts_tablet_manager.cc:1403] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.001s
I20260505 20:13:39.403321 7658 raft_consensus.cc:2468] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.403580 8058 raft_consensus.cc:359] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.403741 8058 raft_consensus.cc:385] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.403797 8058 raft_consensus.cc:740] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.403995 8058 consensus_queue.cc:260] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.409559 7936 raft_consensus.cc:2468] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:39.411868 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_63b0ad358b5c4957b4c3a6e362396654"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.412516 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63b0ad358b5c4957b4c3a6e362396654 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.413622 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.413846 7929 raft_consensus.cc:2468] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.416091 9242 raft_consensus.cc:2749] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.416272 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_715d14ca91c444228fa0c3d82b39a15b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:39.416738 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1323c894d742909e2add9b8f7e2577" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:39.416795 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_715d14ca91c444228fa0c3d82b39a15b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.416905 7936 raft_consensus.cc:2468] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.417234 8058 ts_tablet_manager.cc:1434] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260505 20:13:39.422483 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.429803 9354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:47850 (request call id 201) took 1309 ms. Trace:
I20260505 20:13:39.429939 7737 leader_election.cc:304] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.430231 9242 raft_consensus.cc:2804] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.430330 9242 raft_consensus.cc:493] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.430418 9242 raft_consensus.cc:3060] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.434182 9354 rpcz_store.cc:276] 0505 20:13:38.120770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.120853 (+ 83us) service_pool.cc:224] Handling call
0505 20:13:39.429773 (+1308920us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.121323 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0505 20:13:38.121453 (+ 130us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0505 20:13:38.121463 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0505 20:13:38.121471 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0505 20:13:38.121527 (+ 56us) alter_schema_op.cc:128] START. Timestamp: 1778012018121582
0505 20:13:38.121531 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.840824 (+719293us) log.cc:844] Serialized 173 byte log entry
0505 20:13:38.841191 (+ 367us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x616000167254. stack: 00007fd6a5153086 00007fd6a5152e40 00007fd6a410c3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fd6b1079f22 00007fd6b2462c55 00007fd6b2461779 00007fd6b2469ba0 00007fd6b24699ad 0000000000aa4cac 00007fd6a5198f6f 00007fd6a519c28b 00007fd6a519c108 0000000000aa4cac
0505 20:13:39.124856 (+283665us) op_driver.cc:464] REPLICATION: finished
0505 20:13:39.150788 (+ 25932us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0505 20:13:39.151421 (+ 633us) log.cc:844] Serialized 5 byte log entry
0505 20:13:39.428885 (+277464us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.429256 (+ 371us) log.cc:844] Serialized 14 byte log entry
0505 20:13:39.429680 (+ 424us) alter_schema_op.cc:73] Released schema lock
0505 20:13:39.429688 (+ 8us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":25849,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":5415,"prepare.run_wall_time_us":719944,"raft.queue_time_us":593,"raft.run_cpu_time_us":533,"raft.run_wall_time_us":533,"replication_time_us":1003281,"spinlock_wait_cycles":1655130240}]]}
I20260505 20:13:39.430325 7737 leader_election.cc:304] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.438060 9436 raft_consensus.cc:2804] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.438141 9436 raft_consensus.cc:493] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.438210 9436 raft_consensus.cc:3060] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.449155 7737 leader_election.cc:304] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
W20260505 20:13:39.452050 7869 consensus_peers.cc:597] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:39.452544 7869 leader_election.cc:343] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:39.453131 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 77952.8us
I20260505 20:13:39.456430 9190 consensus_queue.cc:1048] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:39.458480 9190 consensus_queue.cc:1048] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:39.459227 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 67129.7us
I20260505 20:13:39.461796 7598 leader_election.cc:304] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:39.462208 9219 raft_consensus.cc:2804] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.462379 9219 raft_consensus.cc:697] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:39.462729 9219 consensus_queue.cc:237] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.462807 7404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_b722a262b8644d8aabebc34e3bcef77b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.463614 7404 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b722a262b8644d8aabebc34e3bcef77b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.465426 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bfd96314244e6cbbb4d5b48841e06f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.466594 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6326375bac48f0944eeeaa9b39682c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.467288 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.467935 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f697fa87e7fe4da0b70bfa42a8818660" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:39.468146 7662 raft_consensus.cc:2393] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:39.469549 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d4e198c91c4a0e99d8b798a1dd3433" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:39.469713 7662 raft_consensus.cc:3060] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.478880 8989 raft_consensus.cc:2804] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.478996 8989 raft_consensus.cc:493] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.479071 8989 raft_consensus.cc:3060] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.479172 8053 tablet_bootstrap.cc:492] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:39.479558 8053 ts_tablet_manager.cc:1403] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.131s user 0.005s sys 0.000s
I20260505 20:13:39.479554 7410 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_53865526cc344c468eaca63580090168 [id=a5fa8efcbe7e4be9b25d0396d732a97c] alter complete (version 2)
I20260505 20:13:39.480517 8053 raft_consensus.cc:359] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.480715 8053 raft_consensus.cc:385] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.480772 8053 raft_consensus.cc:740] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.480741 7411 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_1417634859e24df0a5944012b79d7673 [id=e7cb019ada204b03bb293a8367c06c0b] alter complete (version 2)
I20260505 20:13:39.481010 8053 consensus_queue.cc:260] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.481931 8053 ts_tablet_manager.cc:1434] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:39.482249 8053 tablet_bootstrap.cc:492] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:39.491242 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.491308 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.491531 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.491640 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.491793 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.491884 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.492003 7641 tablet_service.cc:1558] Processing DeleteTablet for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:35 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.492488 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.492648 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:39.492750 7627 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47850 (request call id 207) took 1300 ms. Trace:
I20260505 20:13:39.492843 7627 rpcz_store.cc:276] 0505 20:13:38.192342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.192403 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:38.197617 (+ 5214us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:38.197651 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:39.198185 (+1000534us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.406010 (+207825us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:39.492736 (+ 86726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:39.493122 7625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47850 (request call id 205) took 1308 ms. Trace:
I20260505 20:13:39.493189 7625 rpcz_store.cc:276] 0505 20:13:38.184694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.184753 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:38.189591 (+ 4838us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:38.189613 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:39.198548 (+1008935us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.406667 (+208119us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:39.493110 (+ 86443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:39.493465 7633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47850 (request call id 214) took 1260 ms. Trace:
I20260505 20:13:39.493525 7633 rpcz_store.cc:276] 0505 20:13:38.233183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.233244 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:38.233654 (+ 410us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:38.233686 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:39.198826 (+965140us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.408894 (+210068us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:39.493453 (+ 84559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:39.493633 8058 tablet_bootstrap.cc:492] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.495064 8058 tablet_bootstrap.cc:654] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.495776 7629 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47850 (request call id 206) took 1305 ms. Trace:
I20260505 20:13:39.495849 7629 rpcz_store.cc:276] 0505 20:13:38.190171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.190235 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:38.197508 (+ 7273us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:38.197552 (+ 44us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:39.199068 (+1001516us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.423734 (+224666us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:39.495763 (+ 72029us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260505 20:13:39.504832 7410 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a114db19f63346d9a67e9e3a8225caa4 consensus state has no leader
I20260505 20:13:39.505699 7799 raft_consensus.cc:2468] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:39.507544 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 86) took 3697 ms. Trace:
I20260505 20:13:39.507716 9121 rpcz_store.cc:276] 0505 20:13:35.810194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810448 (+ 254us) service_pool.cc:224] Handling call
0505 20:13:38.128122 (+2317674us) ts_tablet_manager.cc:1151] Deleting tablet 249cad23ecfe4b9dbbd34f2a1fa899e3
0505 20:13:38.128134 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:38.801520 (+673386us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.300726 (+499206us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.507507 (+206781us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2306976}
I20260505 20:13:39.508231 9121 tablet_replica.cc:333] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:39.508466 9121 raft_consensus.cc:2243] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:39.508790 9121 raft_consensus.cc:2272] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.509373 9121 ts_tablet_manager.cc:1916] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:39.511013 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 90) took 2261 ms. Trace:
I20260505 20:13:39.511127 9271 rpcz_store.cc:276] 0505 20:13:37.249174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.250825 (+ 1651us) service_pool.cc:224] Handling call
0505 20:13:39.044259 (+1793434us) ts_tablet_manager.cc:1151] Deleting tablet e041ebc882b14484a51fe3a6589cddd6
0505 20:13:39.044273 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.094210 (+ 49937us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.199904 (+105694us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.510987 (+311083us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1793314}
I20260505 20:13:39.511613 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 91) took 2262 ms. Trace:
I20260505 20:13:39.511688 9271 rpcz_store.cc:276] 0505 20:13:37.249261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.250961 (+ 1700us) service_pool.cc:224] Handling call
0505 20:13:39.511467 (+2260506us) ts_tablet_manager.cc:1151] Deleting tablet ee19f65120184eca9495513b68440b4f
0505 20:13:39.511479 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.511599 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2260350}
I20260505 20:13:39.512014 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 92) took 2262 ms. Trace:
I20260505 20:13:39.512080 9271 rpcz_store.cc:276] 0505 20:13:37.249351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.251137 (+ 1786us) service_pool.cc:224] Handling call
0505 20:13:39.511917 (+2260780us) ts_tablet_manager.cc:1151] Deleting tablet 296494f478244052971e12a09f0b15b4
0505 20:13:39.511927 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.512000 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2260627}
I20260505 20:13:39.512408 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 93) took 2262 ms. Trace:
I20260505 20:13:39.512495 9271 rpcz_store.cc:276] 0505 20:13:37.249431 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.251316 (+ 1885us) service_pool.cc:224] Handling call
0505 20:13:39.512303 (+2260987us) ts_tablet_manager.cc:1151] Deleting tablet b393bfc209b6461aab958ebf49014d25
0505 20:13:39.512314 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.512391 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2260776}
I20260505 20:13:39.512780 9271 tablet_replica.cc:333] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:39.513005 9271 raft_consensus.cc:2243] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:39.513181 9271 raft_consensus.cc:2272] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.514428 9468 raft_consensus.cc:493] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:39.515970 9468 raft_consensus.cc:515] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.518314 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e041ebc882b14484a51fe3a6589cddd6 (table default.Table_90124bd7f0774a3ab49bcd90a3ec3733 [id=d4a0d51cd26f49eab032102e2064e622]) successfully deleted
W20260505 20:13:39.518608 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet ee19f65120184eca9495513b68440b4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee19f65120184eca9495513b68440b4f already in progress: creating tablet
W20260505 20:13:39.518843 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 296494f478244052971e12a09f0b15b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296494f478244052971e12a09f0b15b4 already in progress: creating tablet
W20260505 20:13:39.519022 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet b393bfc209b6461aab958ebf49014d25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b393bfc209b6461aab958ebf49014d25 already in progress: creating tablet
I20260505 20:13:39.520377 7924 raft_consensus.cc:2468] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:39.520793 9190 consensus_queue.cc:1048] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260505 20:13:39.521315 8058 tablet_bootstrap.cc:492] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.521435 9468 leader_election.cc:290] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:39.521509 8058 ts_tablet_manager.cc:1403] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.005s
I20260505 20:13:39.521780 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 89) took 2247 ms. Trace:
W20260505 20:13:39.521782 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 72194.1us
I20260505 20:13:39.521879 9270 rpcz_store.cc:276] 0505 20:13:37.262740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.262874 (+ 134us) service_pool.cc:224] Handling call
0505 20:13:39.057595 (+1794721us) ts_tablet_manager.cc:1151] Deleting tablet e2554ecdcfd64ca6ba75e6b4077a5ab3
0505 20:13:39.057615 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.193160 (+135545us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.317998 (+124838us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.510447 (+192449us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1794565}
I20260505 20:13:39.522253 9270 tablet_replica.cc:333] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:39.522513 9270 raft_consensus.cc:2243] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:39.522516 7737 leader_election.cc:304] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.522709 9270 raft_consensus.cc:2272] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.522778 9471 raft_consensus.cc:2804] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.522850 9471 raft_consensus.cc:493] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.522921 9471 raft_consensus.cc:3060] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.523430 9270 ts_tablet_manager.cc:1916] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:39.527033 8058 raft_consensus.cc:359] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.527259 8058 raft_consensus.cc:385] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.527323 8058 raft_consensus.cc:740] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.527563 8058 consensus_queue.cc:260] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.528177 8058 ts_tablet_manager.cc:1434] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:39.528550 8058 tablet_bootstrap.cc:492] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.530954 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 (table default.Table_d991da0b0d3b445b918500a013593fe2 [id=600d612bf56b43cab35d268b714affa3]) successfully deleted
I20260505 20:13:39.531459 9271 ts_tablet_manager.cc:1916] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:39.537292 7662 raft_consensus.cc:2468] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.540354 8054 tablet_bootstrap.cc:492] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.540547 8054 ts_tablet_manager.cc:1403] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.177s user 0.020s sys 0.000s
I20260505 20:13:39.541467 8054 raft_consensus.cc:359] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.541659 8054 raft_consensus.cc:385] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.541716 8054 raft_consensus.cc:740] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.541970 8054 consensus_queue.cc:260] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.542555 8054 ts_tablet_manager.cc:1434] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:39.542870 8054 tablet_bootstrap.cc:492] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.544656 8054 tablet_bootstrap.cc:654] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.546463 9429 raft_consensus.cc:493] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.546623 9429 raft_consensus.cc:515] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.547400 9429 leader_election.cc:290] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:39.548704 7397 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6c20374c4df742799110a12f3fea5daa consensus state has no leader
I20260505 20:13:39.550125 8058 tablet_bootstrap.cc:654] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.553052 8054 tablet_bootstrap.cc:492] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.553186 8054 ts_tablet_manager.cc:1403] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260505 20:13:39.553479 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 (table default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]) successfully deleted
I20260505 20:13:39.553814 8054 raft_consensus.cc:359] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.554008 8054 raft_consensus.cc:385] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.554049 8054 raft_consensus.cc:740] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.554239 8054 consensus_queue.cc:260] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.555008 8054 ts_tablet_manager.cc:1434] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:39.555341 8054 tablet_bootstrap.cc:492] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.556999 8054 tablet_bootstrap.cc:654] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.558429 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:39.558561 7737 leader_election.cc:343] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 0112c04befa14c48bb5b2e7dfb60dac7
W20260505 20:13:39.561031 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 63328.4us
I20260505 20:13:39.563746 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982da795cf2c4e578f3392066b1cc1ea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:39.564800 7410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 247) took 3360 ms (client timeout 1000 ms). Trace:
I20260505 20:13:39.564872 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec5c094e2bb4a4481825df17becde52" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:39.564987 7410 rpcz_store.cc:269] 0505 20:13:36.203848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:36.208907 (+ 5059us) service_pool.cc:224] Handling call
0505 20:13:39.564733 (+3355826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:37.250743 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:37.250848 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:37.250853 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:37.250855 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:37.251116 (+ 261us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:37.251134 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:37.251139 (+ 5us) tablet.cc:685] Acquiring locks for 5 operations
0505 20:13:37.251384 (+ 245us) tablet.cc:701] Row locks acquired
0505 20:13:37.251388 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:37.251434 (+ 46us) write_op.cc:270] Start()
0505 20:13:37.251470 (+ 36us) write_op.cc:276] Timestamp: P: 1778012017251551 usec, L: 0
0505 20:13:37.251474 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:37.260743 (+ 9269us) log.cc:844] Serialized 2039 byte log entry
0505 20:13:37.260962 (+ 219us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:37.268588 (+ 7626us) op_driver.cc:464] REPLICATION: finished
0505 20:13:37.268745 (+ 157us) write_op.cc:301] APPLY: starting
0505 20:13:37.268764 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:37.268897 (+ 133us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:37.268899 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:37.269061 (+ 162us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:37.269101 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0505 20:13:37.269114 (+ 13us) write_op.cc:312] APPLY: finished
0505 20:13:37.269227 (+ 113us) log.cc:844] Serialized 47 byte log entry
0505 20:13:37.269297 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.269336 (+ 39us) write_op.cc:454] Released schema lock
0505 20:13:37.269349 (+ 13us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:37.269439 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:37.269443 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:39.414050 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:39.414175 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:39.414181 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:39.414183 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:39.414301 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:39.414313 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:39.414318 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:39.414408 (+ 90us) tablet.cc:701] Row locks acquired
0505 20:13:39.414410 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:39.414451 (+ 41us) write_op.cc:270] Start()
0505 20:13:39.414488 (+ 37us) write_op.cc:276] Timestamp: P: 1778012019414613 usec, L: 0
0505 20:13:39.414491 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:39.414640 (+ 149us) log.cc:844] Serialized 356 byte log entry
0505 20:13:39.475663 (+ 61023us) op_driver.cc:464] REPLICATION: finished
0505 20:13:39.477236 (+ 1573us) write_op.cc:301] APPLY: starting
0505 20:13:39.477250 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:39.477286 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:39.477330 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:39.477376 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:39.477400 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:39.477407 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:39.477472 (+ 65us) log.cc:844] Serialized 23 byte log entry
0505 20:13:39.477521 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.477535 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:39.477541 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:39.477610 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.477616 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":89362,"reported_tablets":239,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":684,"apply.run_wall_time_us":680,"mutex_wait_us":32776,"num_ops":5,"prepare.queue_time_us":38915,"prepare.run_cpu_time_us":1419,"prepare.run_wall_time_us":10301,"raft.queue_time_us":6191,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":302,"replication_time_us":17039,"spinlock_wait_cycles":20723584}],["op",{"apply.queue_time_us":1530,"apply.run_cpu_time_us":363,"apply.run_wall_time_us":362,"num_ops":1,"prepare.queue_time_us":66458,"prepare.run_cpu_time_us":7097,"prepare.run_wall_time_us":23831,"raft.queue_time_us":4772,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":61133,"spinlock_wait_cycles":27392,"thread_start_us":23092,"threads_started":1}]]}
I20260505 20:13:39.570292 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.571669 8058 tablet_bootstrap.cc:492] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.571903 8054 tablet_bootstrap.cc:492] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.571945 8058 ts_tablet_manager.cc:1403] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.001s
I20260505 20:13:39.572054 8054 ts_tablet_manager.cc:1403] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.004s
I20260505 20:13:39.573696 9190 raft_consensus.cc:493] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.573925 9190 raft_consensus.cc:515] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.574664 9190 leader_election.cc:290] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:39.576257 8058 raft_consensus.cc:359] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.576545 8058 raft_consensus.cc:385] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.576659 8058 raft_consensus.cc:740] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.577001 8058 consensus_queue.cc:260] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.577848 8058 ts_tablet_manager.cc:1434] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260505 20:13:39.577968 8054 raft_consensus.cc:359] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.578137 8054 raft_consensus.cc:385] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.578198 8054 raft_consensus.cc:740] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.578440 8058 tablet_bootstrap.cc:492] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.578420 8054 consensus_queue.cc:260] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.580681 8054 ts_tablet_manager.cc:1434] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260505 20:13:39.582139 8054 tablet_bootstrap.cc:492] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.582732 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.586174 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:39.589618 7870 leader_election.cc:343] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.589816 7870 leader_election.cc:304] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.590276 9429 raft_consensus.cc:2749] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.590862 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c720fc66db36402a83a7690d70a40353" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.591080 7663 raft_consensus.cc:2468] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.591964 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.592533 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1323c894d742909e2add9b8f7e2577" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.592696 7659 raft_consensus.cc:2468] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.592917 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.593057 7660 raft_consensus.cc:2468] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:39.593521 8054 tablet_bootstrap.cc:654] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.594384 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:39.594565 7659 raft_consensus.cc:2468] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.595220 8058 tablet_bootstrap.cc:654] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:39.596436 7870 leader_election.cc:343] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.601585 7923 raft_consensus.cc:2468] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.607764 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_f13be87025af439a91adf9854e37e2ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:39.608184 8054 tablet_bootstrap.cc:492] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.608417 8054 ts_tablet_manager.cc:1403] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
W20260505 20:13:39.608516 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f13be87025af439a91adf9854e37e2ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.609189 8054 raft_consensus.cc:359] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.609941 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_03f0e27f76de45acb9e0f5f39fdf8185"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:39.610203 8054 raft_consensus.cc:385] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.610337 8054 raft_consensus.cc:740] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:39.610494 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03f0e27f76de45acb9e0f5f39fdf8185 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.610610 8054 consensus_queue.cc:260] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.611379 8054 ts_tablet_manager.cc:1434] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:39.611683 8054 tablet_bootstrap.cc:492] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.612866 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_071db5e448ef4e9a81bef912b563e4f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.613360 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_071db5e448ef4e9a81bef912b563e4f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.615463 7404 master_service.cc:954] ReplaceTablet: received request to replace tablet 004a8e72cab44d31af3369b8df1e434e from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:39.616322 8054 tablet_bootstrap.cc:654] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.620659 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_e24a5b3e210f404ebb7c5318dca671ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.621316 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e24a5b3e210f404ebb7c5318dca671ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.628293 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_2cb44a73b96d4348b431b5858a965f3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.628865 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cb44a73b96d4348b431b5858a965f3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.638262 7407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_cd598a32a4d2447fa0f086a3982ced52" } new_table_name: "default.Table_38a781e02b0a4a03ae8f23957324408e" modify_external_catalogs: true
I20260505 20:13:39.638468 8054 tablet_bootstrap.cc:492] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.638633 8054 ts_tablet_manager.cc:1403] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260505 20:13:39.639303 8054 raft_consensus.cc:359] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.639477 8054 raft_consensus.cc:385] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.639539 8054 raft_consensus.cc:740] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.639735 7409 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_bf62bacfeaa24c4ca237490e17c20ad8" } new_table_name: "default.Table_d060494d3ac54935b43caaa840049305" modify_external_catalogs: true
I20260505 20:13:39.639743 8054 consensus_queue.cc:260] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.640214 8054 ts_tablet_manager.cc:1434] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:39.650303 7408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_6d8507ea845641ba9e0d0f6228317e2e" } new_table_name: "default.Table_f2d015cb493f4183a7d05923517efc02" modify_external_catalogs: true
W20260505 20:13:39.655699 7870 consensus_peers.cc:597] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:39.657380 7736 leader_election.cc:304] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:39.657972 9468 raft_consensus.cc:2804] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.658115 9468 raft_consensus.cc:697] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
W20260505 20:13:39.659713 7736 leader_election.cc:343] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.661026 7736 leader_election.cc:304] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.662928 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.663126 7923 raft_consensus.cc:2468] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:39.675231 8054 tablet_bootstrap.cc:492] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.677030 8054 tablet_bootstrap.cc:654] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.678762 7799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.679252 9436 raft_consensus.cc:515] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.679991 9436 leader_election.cc:290] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.668985 8053 tablet_bootstrap.cc:700] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent opening tablet: real 0.186s user 0.001s sys 0.000s
I20260505 20:13:39.658373 9468 consensus_queue.cc:237] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.683663 8053 tablet_bootstrap.cc:654] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:39.661978 7736 leader_election.cc:343] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.685485 7736 leader_election.cc:304] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.686021 7736 leader_election.cc:304] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:39.686065 7410 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_04fbe642f303409aa1460277282bd5ef" } new_table_name: "default.Table_18063423a686432f95c0ef71f46f5fff" modify_external_catalogs: true
I20260505 20:13:39.686270 9469 raft_consensus.cc:2749] T f697fa87e7fe4da0b70bfa42a8818660 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.686280 7736 leader_election.cc:343] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:39.687364 7736 leader_election.cc:304] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.686535 9436 raft_consensus.cc:2804] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.687629 9469 raft_consensus.cc:2749] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.687753 9436 raft_consensus.cc:697] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
W20260505 20:13:39.689073 7869 leader_election.cc:343] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.689280 7869 leader_election.cc:304] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.689625 9207 raft_consensus.cc:2749] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.690467 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:39.690661 7924 raft_consensus.cc:3060] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.688544 7736 leader_election.cc:304] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.700623 7736 leader_election.cc:304] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:39.700836 9469 raft_consensus.cc:3060] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.701159 8718 raft_consensus.cc:2749] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:39.701496 7736 leader_election.cc:343] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:39.702239 7736 leader_election.cc:343] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.687984 9436 consensus_queue.cc:237] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.706681 9271 ts_tablet_manager.cc:1929] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:39.706856 9271 log.cc:1199] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/64a82a9d144746338b3fc6550aa35d3c
I20260505 20:13:39.708374 7598 leader_election.cc:304] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:39.709524 8054 tablet_bootstrap.cc:492] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:39.709756 8054 ts_tablet_manager.cc:1403] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.001s
I20260505 20:13:39.710568 8054 raft_consensus.cc:359] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.710810 8054 raft_consensus.cc:385] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.710934 8054 raft_consensus.cc:740] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.711194 8054 consensus_queue.cc:260] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.711797 8054 ts_tablet_manager.cc:1434] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:39.715102 9156 raft_consensus.cc:2804] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.715263 9156 raft_consensus.cc:697] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:39.715637 8054 tablet_bootstrap.cc:492] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:39.715543 9156 consensus_queue.cc:237] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.717007 9432 raft_consensus.cc:2749] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:39.717286 8054 tablet_bootstrap.cc:654] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.718353 7924 raft_consensus.cc:2468] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:39.718848 9219 raft_consensus.cc:493] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.719045 9219 raft_consensus.cc:515] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.719919 8718 raft_consensus.cc:493] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.720358 9219 leader_election.cc:290] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:39.721720 9270 ts_tablet_manager.cc:1929] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:39.722187 9270 log.cc:1199] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b966b4bbaf9f4774af96051f857f02f7
I20260505 20:13:39.723466 9121 ts_tablet_manager.cc:1929] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:39.724282 9121 log.cc:1199] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/bd01314146a34257b444a622829b2fe4
I20260505 20:13:39.731555 9270 ts_tablet_manager.cc:1950] T b966b4bbaf9f4774af96051f857f02f7 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:39.733618 9121 ts_tablet_manager.cc:1950] T bd01314146a34257b444a622829b2fe4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:39.738852 7598 leader_election.cc:304] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:39.739334 9304 raft_consensus.cc:2804] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.739423 9304 raft_consensus.cc:493] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.739499 9304 raft_consensus.cc:3060] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.745216 8058 tablet_bootstrap.cc:492] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.745409 8058 ts_tablet_manager.cc:1403] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.167s user 0.006s sys 0.006s
I20260505 20:13:39.746483 8058 raft_consensus.cc:359] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.746688 8058 raft_consensus.cc:385] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.746737 8058 raft_consensus.cc:740] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.746918 8058 consensus_queue.cc:260] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.747326 8058 ts_tablet_manager.cc:1434] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:39.747670 8058 tablet_bootstrap.cc:492] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.748769 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.749115 7924 raft_consensus.cc:2393] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:39.749320 8058 tablet_bootstrap.cc:654] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.750680 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:39.752019 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 848160f5d68542ab98d2cc21353ddc62 (DEFAULT_TABLE table=default.Table_1d096597f5214bc6b4c42eb448e89612 [id=eb80243f4c6447c0baade0fa36686ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.752488 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848160f5d68542ab98d2cc21353ddc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.752022 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 1093b46e86064e61b836c6d878114892 (DEFAULT_TABLE table=default.Table_43987c8c0ed94d89ad7af5dbbd9f684f [id=f821a4215c59467c8e4b311a39475ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.754245 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1093b46e86064e61b836c6d878114892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.754628 7629 tablet_service.cc:1511] Processing CreateTablet for tablet 848160f5d68542ab98d2cc21353ddc62 (DEFAULT_TABLE table=default.Table_1d096597f5214bc6b4c42eb448e89612 [id=eb80243f4c6447c0baade0fa36686ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.754990 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848160f5d68542ab98d2cc21353ddc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.752388 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 7f344c87342e4b34bb0fc4126f84c7c6 (DEFAULT_TABLE table=default.Table_8c382c0a59964e009edd392fe01a4e6d [id=48dee0de60274816920a4254addeb0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.757866 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f344c87342e4b34bb0fc4126f84c7c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.759194 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 1093b46e86064e61b836c6d878114892 (DEFAULT_TABLE table=default.Table_43987c8c0ed94d89ad7af5dbbd9f684f [id=f821a4215c59467c8e4b311a39475ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.759541 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1093b46e86064e61b836c6d878114892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.770429 7913 tablet_service.cc:1511] Processing CreateTablet for tablet e295edfdcbfe489281dff1b86ab990f1 (DEFAULT_TABLE table=default.Table_3e1807415b834caa9172f7fb69a96f22 [id=0cd8c6ddaf0a4b15bb979b863a85abc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.770862 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e295edfdcbfe489281dff1b86ab990f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.779328 7914 tablet_service.cc:1511] Processing CreateTablet for tablet df4b4b2635a046338127062dd1bcf50b (DEFAULT_TABLE table=default.Table_f0554d77c3dd47b988956769f1598f28 [id=906780fc8acf4939a302f11f74b2485c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.780194 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4b4b2635a046338127062dd1bcf50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.781100 7625 tablet_service.cc:1511] Processing CreateTablet for tablet 7f344c87342e4b34bb0fc4126f84c7c6 (DEFAULT_TABLE table=default.Table_8c382c0a59964e009edd392fe01a4e6d [id=48dee0de60274816920a4254addeb0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.781481 7625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f344c87342e4b34bb0fc4126f84c7c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.785593 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 57cd3e4d3aff4045a8f720847a32f381 (DEFAULT_TABLE table=default.Table_119a805c79074b88a4c5e8fd03583d77 [id=426ea3db6c3543259c4f84e4b2c1370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.785969 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce1907f1bc54d6190db3e24f3113cc3 (DEFAULT_TABLE table=default.Table_a4bda75b1627411aa15f0542c6bee79d [id=4b50a9dade8e49e6b14c39efe7578fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.786039 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cd3e4d3aff4045a8f720847a32f381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.786350 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 051c258c37544e639000578b1b017abb (DEFAULT_TABLE table=default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.786725 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051c258c37544e639000578b1b017abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.779811 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 328492294ae34fda957804e616755f4f (DEFAULT_TABLE table=default.Table_91806f12d20746a398c9250e524e24ee [id=e53fc6ea60bd4640a03cc408a5c5715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.792264 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 328492294ae34fda957804e616755f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.796605 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce1907f1bc54d6190db3e24f3113cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.798238 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:39.798988 7627 tablet_service.cc:1511] Processing CreateTablet for tablet e295edfdcbfe489281dff1b86ab990f1 (DEFAULT_TABLE table=default.Table_3e1807415b834caa9172f7fb69a96f22 [id=0cd8c6ddaf0a4b15bb979b863a85abc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.802590 9429 raft_consensus.cc:493] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.802721 9429 raft_consensus.cc:515] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:39.803328 9429 leader_election.cc:290] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.803892 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_04fbe642f303409aa1460277282bd5ef [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 1 got 0
I20260505 20:13:39.804175 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:39.804255 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4ef586ac044dc9961dc9e465ca9153 (DEFAULT_TABLE table=default.Table_ceeb6434b7b447ddbffcb553beddcdd1 [id=b3c1cdd1f7624a76825f82ccd0d05038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.804414 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:39.804643 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4ef586ac044dc9961dc9e465ca9153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.804811 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:39.804945 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:39.799467 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e295edfdcbfe489281dff1b86ab990f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.805292 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_d788352d297e44d1874caf109ffc646c [id=0b04ae6c921741049ea506fe8323865c]). Expected version 1 got 0
I20260505 20:13:39.805549 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:39.805951 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:39.806970 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:39.808481 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:39.808907 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:39.809103 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:39.809708 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:39.799693 9304 raft_consensus.cc:515] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.809983 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:39.810113 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:39.810420 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:39.810438 9304 leader_election.cc:290] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:39.810673 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:39.810817 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:39.810811 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:39.810967 7924 raft_consensus.cc:3060] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.811883 7632 tablet_service.cc:1511] Processing CreateTablet for tablet df4b4b2635a046338127062dd1bcf50b (DEFAULT_TABLE table=default.Table_f0554d77c3dd47b988956769f1598f28 [id=906780fc8acf4939a302f11f74b2485c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.812238 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4b4b2635a046338127062dd1bcf50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.813334 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:39.813607 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:39.813895 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:39.814947 8058 tablet_bootstrap.cc:492] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.815129 8058 ts_tablet_manager.cc:1403] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260505 20:13:39.816042 8058 raft_consensus.cc:359] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.816195 8058 raft_consensus.cc:385] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.816242 8058 raft_consensus.cc:740] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.816448 8058 consensus_queue.cc:260] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.816995 8058 ts_tablet_manager.cc:1434] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:39.817261 8058 tablet_bootstrap.cc:492] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.818905 8058 tablet_bootstrap.cc:654] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.827250 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 88) took 2564 ms. Trace:
I20260505 20:13:39.827507 9270 rpcz_store.cc:276] 0505 20:13:37.262639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.263068 (+ 429us) service_pool.cc:224] Handling call
0505 20:13:39.522182 (+2259114us) ts_tablet_manager.cc:1151] Deleting tablet b966b4bbaf9f4774af96051f857f02f7
0505 20:13:39.522198 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.609556 (+ 87358us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.721638 (+112082us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.827217 (+105579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258993}
I20260505 20:13:39.828293 9270 tablet_replica.cc:333] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:39.828842 9270 raft_consensus.cc:2243] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:39.829118 9270 raft_consensus.cc:2272] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.829876 9270 ts_tablet_manager.cc:1916] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:39.834473 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 328492294ae34fda957804e616755f4f (DEFAULT_TABLE table=default.Table_91806f12d20746a398c9250e524e24ee [id=e53fc6ea60bd4640a03cc408a5c5715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.835016 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 328492294ae34fda957804e616755f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.839881 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:39.841483 7641 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce1907f1bc54d6190db3e24f3113cc3 (DEFAULT_TABLE table=default.Table_a4bda75b1627411aa15f0542c6bee79d [id=4b50a9dade8e49e6b14c39efe7578fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.841945 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce1907f1bc54d6190db3e24f3113cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.842713 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:39.844848 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_cd598a32a4d2447fa0f086a3982ced52 [id=633565e251844b0aa66147472deee05f]). Expected version 2 got 0
I20260505 20:13:39.847188 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 57cd3e4d3aff4045a8f720847a32f381 (DEFAULT_TABLE table=default.Table_119a805c79074b88a4c5e8fd03583d77 [id=426ea3db6c3543259c4f84e4b2c1370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.847352 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 051c258c37544e639000578b1b017abb (DEFAULT_TABLE table=default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.847575 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cd3e4d3aff4045a8f720847a32f381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.847784 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051c258c37544e639000578b1b017abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.852635 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c (DEFAULT_TABLE table=default.Table_6825628c592243e0996f4b1cd6f3d30c [id=801a4657329f44c7900ab019555c1af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.853116 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.857904 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:39.858584 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4ef586ac044dc9961dc9e465ca9153 (DEFAULT_TABLE table=default.Table_ceeb6434b7b447ddbffcb553beddcdd1 [id=b3c1cdd1f7624a76825f82ccd0d05038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.859066 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4ef586ac044dc9961dc9e465ca9153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.864775 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:39.864775 9156 consensus_queue.cc:1048] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:39.865698 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:39.866467 7900 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c (DEFAULT_TABLE table=default.Table_6825628c592243e0996f4b1cd6f3d30c [id=801a4657329f44c7900ab019555c1af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:39.866623 8058 tablet_bootstrap.cc:492] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:39.866890 8058 ts_tablet_manager.cc:1403] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.005s
I20260505 20:13:39.867005 7900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:39.868147 8058 raft_consensus.cc:359] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.868456 8058 raft_consensus.cc:385] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:39.868569 8058 raft_consensus.cc:740] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:39.868870 8058 consensus_queue.cc:260] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.869688 8058 ts_tablet_manager.cc:1434] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:39.870127 8058 tablet_bootstrap.cc:492] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:39.870456 8989 raft_consensus.cc:515] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.870609 9271 ts_tablet_manager.cc:1950] T 64a82a9d144746338b3fc6550aa35d3c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:39.871120 8989 leader_election.cc:290] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.720077 8718 raft_consensus.cc:515] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.872434 8718 leader_election.cc:290] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.872694 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:39.872900 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:39.874168 8058 tablet_bootstrap.cc:654] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.875216 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:39.878132 7405 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
W20260505 20:13:39.878528 7410 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 010c399e14624550bf02ea248d653538 consensus state has no leader
I20260505 20:13:39.878927 7410 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_8c382c0a59964e009edd392fe01a4e6d" } modify_external_catalogs: true
I20260505 20:13:39.879097 7410 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_8c382c0a59964e009edd392fe01a4e6d" } modify_external_catalogs: true
I20260505 20:13:39.888257 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 7f344c87342e4b34bb0fc4126f84c7c6
I20260505 20:13:39.888929 7410 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_1d096597f5214bc6b4c42eb448e89612" } modify_external_catalogs: true
I20260505 20:13:39.889137 7410 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_1d096597f5214bc6b4c42eb448e89612" } modify_external_catalogs: true
I20260505 20:13:39.890599 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f344c87342e4b34bb0fc4126f84c7c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.898072 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 848160f5d68542ab98d2cc21353ddc62
I20260505 20:13:39.898108 7924 raft_consensus.cc:2468] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:39.899399 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 848160f5d68542ab98d2cc21353ddc62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:39.899875 7410 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_d788352d297e44d1874caf109ffc646c" } new_table_name: "default.Table_300994ffa33b43dba2f1dda51861e3f1" modify_external_catalogs: true
W20260505 20:13:39.903970 9437 consensus_meta.cc:287] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.518s user 0.003s sys 0.000s
I20260505 20:13:39.904125 9437 raft_consensus.cc:515] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.904726 9437 leader_election.cc:290] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:39.905222 7598 leader_election.cc:304] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:39.905678 9219 raft_consensus.cc:2804] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.905810 9219 raft_consensus.cc:697] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:39.906049 9219 consensus_queue.cc:237] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:39.908066 7410 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67c582e419f746b28530c0971fede09f consensus state has no leader
I20260505 20:13:39.909042 7410 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3e1807415b834caa9172f7fb69a96f22" } modify_external_catalogs: true
I20260505 20:13:39.909276 7410 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3e1807415b834caa9172f7fb69a96f22" } modify_external_catalogs: true
I20260505 20:13:39.915939 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 90) took 4105 ms. Trace:
I20260505 20:13:39.916081 9121 rpcz_store.cc:276] 0505 20:13:35.810544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810604 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:39.508159 (+3697555us) ts_tablet_manager.cc:1151] Deleting tablet bd01314146a34257b444a622829b2fe4
0505 20:13:39.508172 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.616632 (+108460us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.723385 (+106753us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.915887 (+192502us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3697412}
I20260505 20:13:39.916710 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet bd01314146a34257b444a622829b2fe4 (table default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]) successfully deleted
I20260505 20:13:39.917229 9121 tablet_replica.cc:333] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:39.917253 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet e295edfdcbfe489281dff1b86ab990f1
I20260505 20:13:39.917802 9121 raft_consensus.cc:2243] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:39.917953 7407 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2b0dd5d7870453bb1b771405daeb22f consensus state has no leader
I20260505 20:13:39.918154 9121 raft_consensus.cc:2272] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:39.918327 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_1088b8bf1039442b9962d35ee73ea794" } modify_external_catalogs: true
I20260505 20:13:39.918530 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_1088b8bf1039442b9962d35ee73ea794" } modify_external_catalogs: true
I20260505 20:13:39.919073 9121 ts_tablet_manager.cc:1916] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:39.920411 7409 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1e4b516283f441bb77f038816afa4ed consensus state has no leader
I20260505 20:13:39.920755 7409 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_362dc1330af04a4aaecae1384b4a78be" } modify_external_catalogs: true
I20260505 20:13:39.920895 7409 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_362dc1330af04a4aaecae1384b4a78be" } modify_external_catalogs: true
I20260505 20:13:39.922385 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet e295edfdcbfe489281dff1b86ab990f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:39.922500 7408 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cb3d246d6b443b8933648fe4f4aa5c2 consensus state has no leader
I20260505 20:13:39.922730 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet b6895af5f55b4bc183065626417090a4 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:39.925966 7411 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_7fed6273ecc7495982a3888baed39d0d [id=fcfe44f6abce4d00b4290752ab326b49] alter complete (version 3)
I20260505 20:13:39.875627 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.926770 7793 raft_consensus.cc:2393] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:39.927141 9488 tablet.cc:1724] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:39.939968 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:39.940055 7737 leader_election.cc:304] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.942296 7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
W20260505 20:13:39.942443 7869 leader_election.cc:343] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:39.942487 7925 raft_consensus.cc:3060] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.942704 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:39.942891 7924 raft_consensus.cc:2393] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:39.943133 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.943269 7923 raft_consensus.cc:2468] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:39.944063 7412 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 248) took 2449 ms (client timeout 1000 ms). Trace:
W20260505 20:13:39.944175 7412 rpcz_store.cc:269] 0505 20:13:37.494145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.508121 (+ 13976us) service_pool.cc:224] Handling call
0505 20:13:37.567621 (+ 59500us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:38.111820 (+544199us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.111830 (+ 10us) write_op.cc:454] Released schema lock
0505 20:13:39.943992 (+1832162us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.098110 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.098256 (+ 146us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.098264 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:38.098267 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.098496 (+ 229us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.098512 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.098520 (+ 8us) tablet.cc:685] Acquiring locks for 5 operations
0505 20:13:38.098735 (+ 215us) tablet.cc:701] Row locks acquired
0505 20:13:38.098738 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:38.098783 (+ 45us) write_op.cc:270] Start()
0505 20:13:38.098824 (+ 41us) write_op.cc:276] Timestamp: P: 1778012018098827 usec, L: 0
0505 20:13:38.098828 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.099058 (+ 230us) log.cc:844] Serialized 2039 byte log entry
0505 20:13:38.103541 (+ 4483us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.103707 (+ 166us) write_op.cc:301] APPLY: starting
0505 20:13:38.103725 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.103787 (+ 62us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.103826 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.103952 (+ 126us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.103995 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0505 20:13:38.104002 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:38.104109 (+ 107us) log.cc:844] Serialized 47 byte log entry
0505 20:13:38.104182 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.104209 (+ 27us) write_op.cc:454] Released schema lock
0505 20:13:38.104217 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0505 20:13:38.642804 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.642904 (+ 100us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.642908 (+ 4us) write_op.cc:435] Acquired schema lock
0505 20:13:38.642912 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:38.642999 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.643008 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.643011 (+ 3us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.643056 (+ 45us) tablet.cc:701] Row locks acquired
0505 20:13:38.643060 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:38.643084 (+ 24us) write_op.cc:270] Start()
0505 20:13:38.643182 (+ 98us) write_op.cc:276] Timestamp: P: 1778012018643154 usec, L: 0
0505 20:13:38.643186 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.643318 (+ 132us) log.cc:844] Serialized 356 byte log entry
0505 20:13:38.769201 (+125883us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.770573 (+ 1372us) write_op.cc:301] APPLY: starting
0505 20:13:38.770581 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.770605 (+ 24us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.770629 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.770675 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.770708 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.770719 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:38.770785 (+ 66us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.770825 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.770842 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:38.770849 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":138957,"reported_tablets":240,"spinlock_wait_cycles":15006080,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":571,"apply.run_wall_time_us":570,"num_ops":5,"prepare.queue_time_us":76,"prepare.run_cpu_time_us":1092,"prepare.run_wall_time_us":1099,"raft.queue_time_us":1318,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":330,"replication_time_us":4675}],["op",{"apply.queue_time_us":1302,"apply.run_cpu_time_us":329,"apply.run_wall_time_us":329,"num_ops":1,"prepare.queue_time_us":59704,"prepare.run_cpu_time_us":576,"prepare.run_wall_time_us":895,"raft.queue_time_us":29,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":125986}]]}
I20260505 20:13:39.945860 7737 leader_election.cc:304] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:39.946053 9432 raft_consensus.cc:493] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:39.946213 9432 raft_consensus.cc:515] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:39.948312 8718 raft_consensus.cc:2804] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:39.948432 8718 raft_consensus.cc:697] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:39.949357 9504 tablet.cc:1724] T d411638715f747469f9f3dc490c0257c P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:39.954454 7411 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 259) took 2217 ms (client timeout 1000 ms). Trace:
I20260505 20:13:39.948674 8718 consensus_queue.cc:237] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:39.954625 7411 rpcz_store.cc:269] 0505 20:13:37.736605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.815599 (+ 78994us) service_pool.cc:224] Handling call
0505 20:13:39.954378 (+2138779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.533032 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.533120 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.533125 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:38.533128 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.533195 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.533204 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.533209 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.533253 (+ 44us) tablet.cc:701] Row locks acquired
0505 20:13:38.533255 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:38.533277 (+ 22us) write_op.cc:270] Start()
0505 20:13:38.533300 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018533304 usec, L: 0
0505 20:13:38.533304 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.533438 (+ 134us) log.cc:844] Serialized 530 byte log entry
0505 20:13:38.558026 (+ 24588us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.558913 (+ 887us) write_op.cc:301] APPLY: starting
0505 20:13:38.558927 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.558964 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.559000 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.559044 (+ 44us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.559079 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.559089 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:38.559144 (+ 55us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.559185 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.559201 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:38.559208 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0505 20:13:39.437921 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:39.440865 (+ 2944us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:39.440872 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:39.440874 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:39.440989 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:39.441002 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:39.441006 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:39.441075 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:39.441078 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:39.441115 (+ 37us) write_op.cc:270] Start()
0505 20:13:39.441148 (+ 33us) write_op.cc:276] Timestamp: P: 1778012019441290 usec, L: 0
0505 20:13:39.441151 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:39.441373 (+ 222us) log.cc:844] Serialized 356 byte log entry
0505 20:13:39.476212 (+ 34839us) op_driver.cc:464] REPLICATION: finished
0505 20:13:39.477681 (+ 1469us) write_op.cc:301] APPLY: starting
0505 20:13:39.477694 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:39.477760 (+ 66us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:39.477798 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:39.477847 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:39.477885 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:39.477897 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:39.477960 (+ 63us) log.cc:844] Serialized 23 byte log entry
0505 20:13:39.478012 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.478027 (+ 15us) write_op.cc:454] Released schema lock
0505 20:13:39.478035 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:39.478109 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.478115 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:39.509860 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:39.510117 (+ 257us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:39.510125 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:39.510129 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:39.510254 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:39.510266 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:39.510270 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:39.510338 (+ 68us) tablet.cc:701] Row locks acquired
0505 20:13:39.510342 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:39.510382 (+ 40us) write_op.cc:270] Start()
0505 20:13:39.510417 (+ 35us) write_op.cc:276] Timestamp: P: 1778012019510387 usec, L: 0
0505 20:13:39.510421 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:39.615982 (+105561us) log.cc:844] Serialized 356 byte log entry
0505 20:13:39.616502 (+ 520us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:39.625766 (+ 9264us) op_driver.cc:464] REPLICATION: finished
0505 20:13:39.626006 (+ 240us) write_op.cc:301] APPLY: starting
0505 20:13:39.626030 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:39.626088 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:39.626093 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:39.626206 (+ 113us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:39.626252 (+ 46us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:39.626422 (+ 170us) write_op.cc:312] APPLY: finished
0505 20:13:39.626522 (+ 100us) log.cc:844] Serialized 23 byte log entry
0505 20:13:39.626811 (+ 289us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.626834 (+ 23us) write_op.cc:454] Released schema lock
0505 20:13:39.626844 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:39.627015 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.627021 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27941,"reported_tablets":233,"child_traces":[["op",{"apply.queue_time_us":850,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":1,"prepare.queue_time_us":925,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":22205,"raft.queue_time_us":9462,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":24702,"thread_start_us":103414,"threads_started":2}],["op",{"apply.queue_time_us":1425,"apply.run_cpu_time_us":416,"apply.run_wall_time_us":415,"num_ops":1,"prepare.queue_time_us":89922,"prepare.run_cpu_time_us":807,"prepare.run_wall_time_us":3553,"raft.queue_time_us":643,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":35018}],["op",{"apply.queue_time_us":180,"apply.run_cpu_time_us":578,"apply.run_wall_time_us":997,"num_ops":1,"prepare.queue_time_us":27495,"prepare.run_cpu_time_us":1658,"prepare.run_wall_time_us":106731,"raft.queue_time_us":2627,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":268,"replication_time_us":115294,"spinlock_wait_cycles":242466176}]]}
I20260505 20:13:39.956954 9432 leader_election.cc:290] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:39.957141 9432 raft_consensus.cc:2804] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.957228 9432 raft_consensus.cc:493] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.957315 9432 raft_consensus.cc:3060] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.957238 7411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_9d55ccc940bc44609d7d09a1528c18e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:39.958137 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_7600175864414daab21997f8f179690e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.958591 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7600175864414daab21997f8f179690e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.971271 7404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_9a5dd3a6512a4416839b43746ab27ca1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.971957 7404 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a5dd3a6512a4416839b43746ab27ca1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.981527 7404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_7bf454b705824f97ae876a407740a0e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.982234 7404 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bf454b705824f97ae876a407740a0e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.982554 9219 raft_consensus.cc:493] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:39.982725 9219 raft_consensus.cc:515] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:39.983469 9219 leader_election.cc:290] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:39.984887 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:39.985085 7923 raft_consensus.cc:2468] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:39.985885 7598 leader_election.cc:304] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:39.986989 9219 raft_consensus.cc:2804] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:39.987088 9219 raft_consensus.cc:493] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:39.987164 9219 raft_consensus.cc:3060] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:39.991289 9513 consensus_queue.cc:1048] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:39.991341 7404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_fa08808641b84eb9a54f9a5a39e9b97a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.991940 7404 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa08808641b84eb9a54f9a5a39e9b97a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:39.994221 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_8aa3142c5bb74a9e95ac8f8efd637552"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:39.995025 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aa3142c5bb74a9e95ac8f8efd637552 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:40.003871 7404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_aa48f9a5f71b4a5ca3661a5a822ce5c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:40.004505 7404 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa48f9a5f71b4a5ca3661a5a822ce5c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:40.005035 9371 consensus_meta.cc:287] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.621s user 0.003s sys 0.000s
I20260505 20:13:40.005189 9371 raft_consensus.cc:515] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.006845 7925 raft_consensus.cc:2468] T 2faf7c64c3c340ceb8c87e416a32a7ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.011248 9371 leader_election.cc:290] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.014068 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b966b4bbaf9f4774af96051f857f02f7 (table default.Table_7e6c02c635da4beeac8892d580b67a93 [id=9ba85af1a1ee48e691f3b92e820c0500]) successfully deleted
I20260505 20:13:40.019205 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_e93051733d2d4ef6aa1fb89a96110372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:40.022451 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e93051733d2d4ef6aa1fb89a96110372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:40.024096 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_32ed2f79e9ac4de79eab05b72aeb3afb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:40.028059 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32ed2f79e9ac4de79eab05b72aeb3afb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:40.032480 7411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d55ccc940bc44609d7d09a1528c18e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:40.042567 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_3a4483646c944eeea474544647e55eb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:40.043519 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a4483646c944eeea474544647e55eb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:40.052937 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet e295edfdcbfe489281dff1b86ab990f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:40.056610 7598 consensus_peers.cc:597] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:40.058804 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f344c87342e4b34bb0fc4126f84c7c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:40.059276 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 848160f5d68542ab98d2cc21353ddc62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:40.060441 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet c7085351ba8e4c78b684894460cec8e3
I20260505 20:13:40.061590 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet f697fa87e7fe4da0b70bfa42a8818660
I20260505 20:13:40.062660 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet c7085351ba8e4c78b684894460cec8e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:40.062860 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet f697fa87e7fe4da0b70bfa42a8818660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:40.066676 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:40.066890 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:40.067049 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet f62626fb4f8445e3a6e2822277181762 with delete_type TABLET_DATA_DELETED (replaced by tablet d138d27f444f45d28acdc7d72a9649f5) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:40.067207 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet bd01314146a34257b444a622829b2fe4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:40.067793 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:40.073472 7413 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 283) took 3248 ms (client timeout 1000 ms). Trace:
I20260505 20:13:40.092248 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a" } modify_external_catalogs: true
I20260505 20:13:40.092492 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_cfa41be85fdb4f8a890cbe6ac6d13d5a" } modify_external_catalogs: true
W20260505 20:13:40.073787 7413 rpcz_store.cc:269] 0505 20:13:36.824985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.202875 (+377890us) service_pool.cc:224] Handling call
0505 20:13:37.261260 (+ 58385us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:40.073393 (+2812133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:38.640858 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:38.640996 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:38.641002 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:38.641005 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:38.641114 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:38.641127 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:38.641132 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:38.641197 (+ 65us) tablet.cc:701] Row locks acquired
0505 20:13:38.641200 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:38.641237 (+ 37us) write_op.cc:270] Start()
0505 20:13:38.641271 (+ 34us) write_op.cc:276] Timestamp: P: 1778012018641302 usec, L: 0
0505 20:13:38.641275 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:38.641417 (+ 142us) log.cc:844] Serialized 356 byte log entry
0505 20:13:38.768810 (+127393us) op_driver.cc:464] REPLICATION: finished
0505 20:13:38.769377 (+ 567us) write_op.cc:301] APPLY: starting
0505 20:13:38.769399 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:38.769450 (+ 51us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:38.769525 (+ 75us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:38.769605 (+ 80us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:38.769655 (+ 50us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:38.769666 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:38.769799 (+ 133us) log.cc:844] Serialized 23 byte log entry
0505 20:13:38.769872 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.769891 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:38.769898 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:38.769989 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:38.769995 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:39.195085 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:39.195199 (+ 114us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:39.195206 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:39.195210 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:39.195341 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:39.195359 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:39.195367 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:39.195452 (+ 85us) tablet.cc:701] Row locks acquired
0505 20:13:39.195456 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:39.195502 (+ 46us) write_op.cc:270] Start()
0505 20:13:39.195546 (+ 44us) write_op.cc:276] Timestamp: P: 1778012019195576 usec, L: 0
0505 20:13:39.195552 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:39.195770 (+ 218us) log.cc:844] Serialized 356 byte log entry
0505 20:13:39.212471 (+ 16701us) op_driver.cc:464] REPLICATION: finished
0505 20:13:39.213440 (+ 969us) write_op.cc:301] APPLY: starting
0505 20:13:39.213458 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:39.213503 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:39.213538 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:39.213596 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:39.213632 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:39.213639 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:39.213722 (+ 83us) log.cc:844] Serialized 23 byte log entry
0505 20:13:39.215005 (+ 1283us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.215024 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:39.215030 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:39.215096 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:39.215100 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158027,"reported_tablets":220,"spinlock_wait_cycles":87133440,"child_traces":[["op",{"apply.queue_time_us":441,"apply.run_cpu_time_us":617,"apply.run_wall_time_us":617,"num_ops":1,"prepare.queue_time_us":91466,"prepare.run_cpu_time_us":671,"prepare.run_wall_time_us":1063,"raft.queue_time_us":41,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":127439}],["op",{"apply.queue_time_us":902,"apply.run_cpu_time_us":484,"apply.run_wall_time_us":1654,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":782,"prepare.run_wall_time_us":782,"raft.queue_time_us":69,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":16885}]]}
I20260505 20:13:40.102442 7413 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_c8ad976998f340cf8dcfe84814ef6234" } modify_external_catalogs: true
I20260505 20:13:40.103314 7413 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_c8ad976998f340cf8dcfe84814ef6234" } modify_external_catalogs: true
W20260505 20:13:40.105379 9242 consensus_meta.cc:287] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.675s user 0.001s sys 0.005s
I20260505 20:13:40.105535 9242 raft_consensus.cc:515] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.107141 9429 raft_consensus.cc:493] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.107326 9429 raft_consensus.cc:515] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.108063 9429 leader_election.cc:290] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.108223 9429 raft_consensus.cc:493] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.108332 9429 raft_consensus.cc:515] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.108918 9429 leader_election.cc:290] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.111771 9219 raft_consensus.cc:515] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.112730 9219 leader_election.cc:290] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:40.113579 7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:40.114130 7925 raft_consensus.cc:3060] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.113549 7412 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3b4a78f1dba2415d8d85b7dea798ed28" } new_table_name: "default.Table_5a10edf039e649cdaebec19cc78b2149" modify_external_catalogs: true
I20260505 20:13:40.121100 7410 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_ac5b74d3d36f45ec9885c20f92938f45" } new_table_name: "default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775" modify_external_catalogs: true
I20260505 20:13:40.117244 7411 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_18063423a686432f95c0ef71f46f5fff" } new_table_name: "default.Table_b2504b0b75a543b38871f8112aad5cf1" modify_external_catalogs: true
I20260505 20:13:40.125252 7409 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_c0743365402b4252bd3c5c7a95a9e5ee" } new_table_name: "default.Table_fa95c378428d48efba91d72f220584de" modify_external_catalogs: true
I20260505 20:13:40.127755 7407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_38d192fd0ccf420588d860dddcd2394c" } new_table_name: "default.Table_a91e1a8b17584952ba88c0b5b69ef059" modify_external_catalogs: true
W20260505 20:13:40.122732 7406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 284) took 2136 ms (client timeout 1000 ms). Trace:
I20260505 20:13:40.137813 9242 leader_election.cc:290] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:40.141848 7406 rpcz_store.cc:269] 0505 20:13:37.984338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.483115 (+498777us) service_pool.cc:224] Handling call
0505 20:13:40.120907 (+1637792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53529,"reported_tablets":218}
W20260505 20:13:40.144356 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 194875us
I20260505 20:13:40.147553 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bfd96314244e6cbbb4d5b48841e06f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:40.147720 8053 tablet_bootstrap.cc:492] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.147814 7923 raft_consensus.cc:3060] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.147866 8053 ts_tablet_manager.cc:1403] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.666s user 0.010s sys 0.000s
I20260505 20:13:40.148522 8053 raft_consensus.cc:359] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.148792 8053 raft_consensus.cc:385] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.148882 8053 raft_consensus.cc:740] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.149026 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c720fc66db36402a83a7690d70a40353" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:40.149134 8053 consensus_queue.cc:260] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.149243 7924 raft_consensus.cc:3060] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.149760 8053 ts_tablet_manager.cc:1434] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:40.150490 8053 tablet_bootstrap.cc:492] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:40.150779 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19720f3a29f34515a952e50f4fec9f97" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:40.150821 7801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:40.151723 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:40.153134 7801 raft_consensus.cc:2393] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:40.155205 8053 tablet_bootstrap.cc:654] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:39.728507 8054 tablet_bootstrap.cc:492] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:40.169152 8054 ts_tablet_manager.cc:1403] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.454s user 0.002s sys 0.002s
I20260505 20:13:40.157390 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:40.157701 7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:40.159842 7737 leader_election.cc:304] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
W20260505 20:13:40.163946 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 421032us
I20260505 20:13:40.170506 8989 raft_consensus.cc:2804] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:40.170617 7737 leader_election.cc:343] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 949fecb197084426b5a6adb959f5c886
I20260505 20:13:40.170639 8989 raft_consensus.cc:697] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:40.171006 8989 consensus_queue.cc:237] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.178239 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9f684cd880b4a748cab49795de11503" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.180375 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.181281 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.183315 8053 tablet_bootstrap.cc:492] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.184900 8053 ts_tablet_manager.cc:1403] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.001s
I20260505 20:13:40.185561 7406 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_12137e368ef9471291d6710d66495bdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:40.186308 7406 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12137e368ef9471291d6710d66495bdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:40.189553 8053 raft_consensus.cc:359] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.191887 8053 raft_consensus.cc:385] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.192258 8053 raft_consensus.cc:740] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.192683 8053 consensus_queue.cc:260] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:40.191304 9138 consensus_meta.cc:287] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.804s user 0.002s sys 0.001s
I20260505 20:13:40.193951 9138 raft_consensus.cc:515] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.194731 8053 ts_tablet_manager.cc:1434] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260505 20:13:40.194756 9138 leader_election.cc:290] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.196187 8053 tablet_bootstrap.cc:492] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:40.200987 8053 tablet_bootstrap.cc:654] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.210374 8054 raft_consensus.cc:359] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.210817 8054 raft_consensus.cc:385] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.210952 8054 raft_consensus.cc:740] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.211272 8054 consensus_queue.cc:260] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.199962 7925 raft_consensus.cc:2468] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:40.212177 7598 leader_election.cc:304] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:40.212638 9429 raft_consensus.cc:493] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.212831 9429 raft_consensus.cc:515] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.214481 9429 leader_election.cc:290] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.217687 9429 raft_consensus.cc:493] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.218103 9429 raft_consensus.cc:515] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.220026 9429 leader_election.cc:290] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:40.221494 7869 leader_election.cc:343] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:40.221822 7869 leader_election.cc:343] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.222613 8053 tablet_bootstrap.cc:492] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.223706 7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:40.223991 7925 raft_consensus.cc:3060] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.227221 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet c7085351ba8e4c78b684894460cec8e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:40.228022 8053 ts_tablet_manager.cc:1403] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.004s
I20260505 20:13:40.223181 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:40.222905 7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f27847d940e46778ad10a2f4cf40d27" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:40.231335 7869 leader_election.cc:343] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:40.231570 7869 leader_election.cc:343] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.232777 7736 leader_election.cc:304] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:40.233595 9138 raft_consensus.cc:2804] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:40.233672 9138 raft_consensus.cc:493] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:40.233736 9138 raft_consensus.cc:3060] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
W20260505 20:13:40.235904 7736 leader_election.cc:343] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.236881 7736 leader_election.cc:304] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:40.237109 9514 raft_consensus.cc:2749] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:40.231003 8053 raft_consensus.cc:359] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:40.237715 7736 leader_election.cc:343] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:40.243970 7736 leader_election.cc:343] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.245321 7923 raft_consensus.cc:2468] T 71bfd96314244e6cbbb4d5b48841e06f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.238453 8053 raft_consensus.cc:385] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.243499 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 94) took 2994 ms. Trace:
I20260505 20:13:40.245589 9271 rpcz_store.cc:276] 0505 20:13:37.249508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.251545 (+ 2037us) service_pool.cc:224] Handling call
0505 20:13:39.512731 (+2261186us) ts_tablet_manager.cc:1151] Deleting tablet 64a82a9d144746338b3fc6550aa35d3c
0505 20:13:39.512741 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:39.614036 (+101295us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:39.706605 (+ 92569us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.243476 (+536871us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261009}
I20260505 20:13:40.246097 9271 tablet_replica.cc:333] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:40.246284 9271 raft_consensus.cc:2243] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:40.246423 9271 raft_consensus.cc:2272] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:40.246918 9271 ts_tablet_manager.cc:1916] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:40.251806 9471 consensus_meta.cc:287] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.729s user 0.003s sys 0.001s
I20260505 20:13:40.251922 9471 raft_consensus.cc:515] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.252588 9471 leader_election.cc:290] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.253273 7737 leader_election.cc:304] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:40.253520 8053 raft_consensus.cc:740] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.253821 8053 consensus_queue.cc:260] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.254114 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1323c894d742909e2add9b8f7e2577" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:40.254293 7923 raft_consensus.cc:3060] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.254429 8053 ts_tablet_manager.cc:1434] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.024s user 0.001s sys 0.000s
I20260505 20:13:40.254590 9242 raft_consensus.cc:2804] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:40.254683 9242 raft_consensus.cc:697] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:40.254935 9242 consensus_queue.cc:237] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.255414 8053 tablet_bootstrap.cc:492] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:40.258915 7869 consensus_peers.cc:597] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64a82a9d144746338b3fc6550aa35d3c. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:40.260476 8053 tablet_bootstrap.cc:654] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.268129 8053 tablet_bootstrap.cc:492] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.268424 8053 ts_tablet_manager.cc:1403] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20260505 20:13:40.269472 8053 raft_consensus.cc:359] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.269811 8053 raft_consensus.cc:385] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.269928 8053 raft_consensus.cc:740] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.270241 8053 consensus_queue.cc:260] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.270895 8053 ts_tablet_manager.cc:1434] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:40.271273 8053 tablet_bootstrap.cc:492] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:40.273475 8053 tablet_bootstrap.cc:654] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:40.275132 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 63027.2us
I20260505 20:13:40.279698 9398 raft_consensus.cc:2804] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:40.279965 9398 raft_consensus.cc:697] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:40.280382 9398 consensus_queue.cc:237] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.284890 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bfd96314244e6cbbb4d5b48841e06f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.286334 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c720fc66db36402a83a7690d70a40353" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.286549 7661 raft_consensus.cc:3060] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:40.286911 7399 consensus_peers.cc:597] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d -> Peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Couldn't send request to peer 73028cd481e446daa9432a35522a7967. Status: Network error: Client connection negotiation failed: client connection to 127.7.33.254:38755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260505 20:13:40.288021 7585 kernel_stack_watchdog.cc:198] Thread 8058 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 299ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fd6a8771980 (unknown) at ??:0
@ 0x953547 __sanitizer::internal_sched_yield() at ??:?
@ 0x8b8bfd __interceptor_pthread_create at ??:?
@ 0x7fd6a5177221 kudu::Thread::StartThread() at ??:0
@ 0xa91737 kudu::Thread::Create() at ??:?
@ 0x7fd6a5196c0b kudu::ThreadPool::CreateThread() at ??:0
@ 0x7fd6a519262d kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7fd6a519795f kudu::ThreadPool::Submit() at ??:0
@ 0x7fd6b0938b0d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7fd6b0937aff kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7fd6b09376be kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7fd6b093f735 kudu::log::Log::Init() at ??:0
@ 0x7fd6b093ea91 kudu::log::Log::Open() at ??:0
@ 0x7fd6b23966d1 kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7fd6b2392a3c kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7fd6b23911bf kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260505 20:13:40.291132 8053 tablet_bootstrap.cc:492] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.291472 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.292575 8053 ts_tablet_manager.cc:1403] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.006s
I20260505 20:13:40.292779 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1323c894d742909e2add9b8f7e2577" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.292927 7660 raft_consensus.cc:3060] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.293017 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.293779 8053 raft_consensus.cc:359] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.294054 8053 raft_consensus.cc:385] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.294159 8053 raft_consensus.cc:740] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.294454 8053 consensus_queue.cc:260] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.295167 8053 ts_tablet_manager.cc:1434] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:40.295552 8053 tablet_bootstrap.cc:492] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:40.297827 8053 tablet_bootstrap.cc:654] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.307621 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:40.313822 8053 tablet_bootstrap.cc:492] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.314047 8053 ts_tablet_manager.cc:1403] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.009s
I20260505 20:13:40.314978 8053 raft_consensus.cc:359] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.315248 8053 raft_consensus.cc:385] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.315346 8053 raft_consensus.cc:740] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.315632 8053 consensus_queue.cc:260] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.316332 8053 ts_tablet_manager.cc:1434] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:40.316720 8053 tablet_bootstrap.cc:492] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:40.317337 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet f697fa87e7fe4da0b70bfa42a8818660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:40.318609 8053 tablet_bootstrap.cc:654] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.325116 7764 tablet_service.cc:1511] Processing CreateTablet for tablet 848160f5d68542ab98d2cc21353ddc62 (DEFAULT_TABLE table=default.Table_1d096597f5214bc6b4c42eb448e89612 [id=eb80243f4c6447c0baade0fa36686ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.325868 7778 tablet_service.cc:1511] Processing CreateTablet for tablet 1093b46e86064e61b836c6d878114892 (DEFAULT_TABLE table=default.Table_43987c8c0ed94d89ad7af5dbbd9f684f [id=f821a4215c59467c8e4b311a39475ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.326861 7772 tablet_service.cc:1511] Processing CreateTablet for tablet 7f344c87342e4b34bb0fc4126f84c7c6 (DEFAULT_TABLE table=default.Table_8c382c0a59964e009edd392fe01a4e6d [id=48dee0de60274816920a4254addeb0eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.327024 7777 tablet_service.cc:1511] Processing CreateTablet for tablet e295edfdcbfe489281dff1b86ab990f1 (DEFAULT_TABLE table=default.Table_3e1807415b834caa9172f7fb69a96f22 [id=0cd8c6ddaf0a4b15bb979b863a85abc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.327020 7781 tablet_service.cc:1511] Processing CreateTablet for tablet df4b4b2635a046338127062dd1bcf50b (DEFAULT_TABLE table=default.Table_f0554d77c3dd47b988956769f1598f28 [id=906780fc8acf4939a302f11f74b2485c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.327472 7767 tablet_service.cc:1511] Processing CreateTablet for tablet 328492294ae34fda957804e616755f4f (DEFAULT_TABLE table=default.Table_91806f12d20746a398c9250e524e24ee [id=e53fc6ea60bd4640a03cc408a5c5715b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.328227 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce1907f1bc54d6190db3e24f3113cc3 (DEFAULT_TABLE table=default.Table_a4bda75b1627411aa15f0542c6bee79d [id=4b50a9dade8e49e6b14c39efe7578fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.328384 7773 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c (DEFAULT_TABLE table=default.Table_6825628c592243e0996f4b1cd6f3d30c [id=801a4657329f44c7900ab019555c1af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.328681 7769 tablet_service.cc:1511] Processing CreateTablet for tablet 57cd3e4d3aff4045a8f720847a32f381 (DEFAULT_TABLE table=default.Table_119a805c79074b88a4c5e8fd03583d77 [id=426ea3db6c3543259c4f84e4b2c1370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.328936 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f344c87342e4b34bb0fc4126f84c7c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.329089 7782 tablet_service.cc:1511] Processing CreateTablet for tablet 051c258c37544e639000578b1b017abb (DEFAULT_TABLE table=default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.329393 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 848160f5d68542ab98d2cc21353ddc62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.329556 7770 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4ef586ac044dc9961dc9e465ca9153 (DEFAULT_TABLE table=default.Table_ceeb6434b7b447ddbffcb553beddcdd1 [id=b3c1cdd1f7624a76825f82ccd0d05038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.329761 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet e295edfdcbfe489281dff1b86ab990f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.330130 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 7766caea43904162a2c289b7b17405d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.330451 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.330804 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 944eaa335fcf49be975baee21c715642 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.331142 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet feef367085954816b312d4f1cdd80b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:40.331434 9469 consensus_meta.cc:287] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent flushing consensus metadata: real 0.630s user 0.004s sys 0.000s
I20260505 20:13:40.331532 9271 ts_tablet_manager.cc:1929] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:40.331570 7772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f344c87342e4b34bb0fc4126f84c7c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.331678 9271 log.cc:1199] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/d138d27f444f45d28acdc7d72a9649f5
I20260505 20:13:40.331764 9432 raft_consensus.cc:515] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.332027 9271 ts_tablet_manager.cc:1950] T d138d27f444f45d28acdc7d72a9649f5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:40.332132 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce1907f1bc54d6190db3e24f3113cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.332402 9432 leader_election.cc:290] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.332564 7769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57cd3e4d3aff4045a8f720847a32f381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.332594 9469 raft_consensus.cc:2749] T 982da795cf2c4e578f3392066b1cc1ea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:40.332958 7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 051c258c37544e639000578b1b017abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.333287 7770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4ef586ac044dc9961dc9e465ca9153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.335067 9138 raft_consensus.cc:515] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.335587 7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4b4b2635a046338127062dd1bcf50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.335731 9138 leader_election.cc:290] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:40.336140 7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e295edfdcbfe489281dff1b86ab990f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.336733 7773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.337172 7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 328492294ae34fda957804e616755f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.337559 7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1093b46e86064e61b836c6d878114892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.337939 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848160f5d68542ab98d2cc21353ddc62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.340540 7661 raft_consensus.cc:2468] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.343889 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 95) took 3094 ms. Trace:
I20260505 20:13:40.344018 9271 rpcz_store.cc:276] 0505 20:13:37.249635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.251752 (+ 2117us) service_pool.cc:224] Handling call
0505 20:13:40.246035 (+2994283us) ts_tablet_manager.cc:1151] Deleting tablet d138d27f444f45d28acdc7d72a9649f5
0505 20:13:40.246056 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:40.250876 (+ 4820us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.331465 (+ 80589us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.343816 (+ 12351us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2994139}
I20260505 20:13:40.344406 9271 tablet_replica.cc:333] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:40.344645 9271 raft_consensus.cc:2243] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:40.344843 9271 raft_consensus.cc:2272] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:40.345438 9271 ts_tablet_manager.cc:1916] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:40.348062 9469 consensus_queue.cc:1048] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.348572 9469 consensus_queue.cc:1048] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.351316 9469 consensus_queue.cc:1048] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:40.352155 7737 leader_election.cc:343] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:40.362948 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet 79ce82aca20d44819f28785322e935ae with delete_type TABLET_DATA_DELETED (replaced by tablet 168d9a40a69d4beab8e79a97e7723e69) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.364318 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet 4816f1ccb82e4641b2dcfe9ce9b55fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.365473 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet 4628e33d204c452ab12acf76f754f2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.366550 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet e041ebc882b14484a51fe3a6589cddd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.367800 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.366835 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:40.369344 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.369208 7936 raft_consensus.cc:3060] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:40.371176 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.372118 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet c7085351ba8e4c78b684894460cec8e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.372993 7772 tablet_service.cc:1558] Processing DeleteTablet for tablet f697fa87e7fe4da0b70bfa42a8818660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:39 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:40.373624 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 64a82a9d144746338b3fc6550aa35d3c (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]) successfully deleted
I20260505 20:13:40.374115 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet d138d27f444f45d28acdc7d72a9649f5 (table default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]) successfully deleted
W20260505 20:13:40.384644 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 83184.5us
I20260505 20:13:40.384992 9495 consensus_queue.cc:1048] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:40.419880 7736 leader_election.cc:343] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.422948 9190 consensus_queue.cc:1048] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.424594 9156 raft_consensus.cc:493] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.424746 9156 raft_consensus.cc:515] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.425376 9156 leader_election.cc:290] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:40.426216 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 1839e2f0dc15432fa49f75b817c19f82 (DEFAULT_TABLE table=default.Table_e24a5b3e210f404ebb7c5318dca671ae [id=145feabc9a9442d291da09eda7c05500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.426944 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 1378bc91ec4648a685dd522ddfe23194 (DEFAULT_TABLE table=default.Table_2cb44a73b96d4348b431b5858a965f3c [id=e23236bbe1284365b957fd8fa0247072]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:40.429651 7736 leader_election.cc:343] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.432004 8054 ts_tablet_manager.cc:1434] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.223s user 0.002s sys 0.000s
I20260505 20:13:40.432035 7772 tablet_service.cc:1511] Processing CreateTablet for tablet 1839e2f0dc15432fa49f75b817c19f82 (DEFAULT_TABLE table=default.Table_e24a5b3e210f404ebb7c5318dca671ae [id=145feabc9a9442d291da09eda7c05500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.432065 7629 tablet_service.cc:1511] Processing CreateTablet for tablet 1839e2f0dc15432fa49f75b817c19f82 (DEFAULT_TABLE table=default.Table_e24a5b3e210f404ebb7c5318dca671ae [id=145feabc9a9442d291da09eda7c05500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.432296 8054 tablet_bootstrap.cc:492] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:40.432753 7765 tablet_service.cc:1511] Processing CreateTablet for tablet 1378bc91ec4648a685dd522ddfe23194 (DEFAULT_TABLE table=default.Table_2cb44a73b96d4348b431b5858a965f3c [id=e23236bbe1284365b957fd8fa0247072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.432854 7633 tablet_service.cc:1511] Processing CreateTablet for tablet 1378bc91ec4648a685dd522ddfe23194 (DEFAULT_TABLE table=default.Table_2cb44a73b96d4348b431b5858a965f3c [id=e23236bbe1284365b957fd8fa0247072]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.433099 9511 consensus_queue.cc:1048] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.433627 7641 tablet_service.cc:1511] Processing CreateTablet for tablet c0ae5273f49e441eaa487c7682b3cc32 (DEFAULT_TABLE table=default.Table_715d14ca91c444228fa0c3d82b39a15b [id=fde4f73ef4744e88871a2a4606024cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.434441 7764 tablet_service.cc:1511] Processing CreateTablet for tablet c0ae5273f49e441eaa487c7682b3cc32 (DEFAULT_TABLE table=default.Table_715d14ca91c444228fa0c3d82b39a15b [id=fde4f73ef4744e88871a2a4606024cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.434501 7906 tablet_service.cc:1511] Processing CreateTablet for tablet c0ae5273f49e441eaa487c7682b3cc32 (DEFAULT_TABLE table=default.Table_715d14ca91c444228fa0c3d82b39a15b [id=fde4f73ef4744e88871a2a4606024cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.434535 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 5b95c186b6a84c19bebdc570651930fb (DEFAULT_TABLE table=default.Table_03f0e27f76de45acb9e0f5f39fdf8185 [id=48c46b0dc0564dd4ba440fadfa91eea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.434988 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0ae7669aef4465bb7135dd8a4c604f (DEFAULT_TABLE table=default.Table_ce966f7989d74488a1ee2deb24e99c67 [id=86f393208d674a0ea36afd3de11ad065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.435742 7775 tablet_service.cc:1511] Processing CreateTablet for tablet b739337a620c4dda847978d7da7241fc (DEFAULT_TABLE table=default.Table_acc159ccea854f3cb3316337e3034cf9 [id=73b8dbc714f7418da91f529471c41bc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.436275 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 5b95c186b6a84c19bebdc570651930fb (DEFAULT_TABLE table=default.Table_03f0e27f76de45acb9e0f5f39fdf8185 [id=48c46b0dc0564dd4ba440fadfa91eea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.436600 9469 consensus_queue.cc:1048] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.437502 7917 tablet_service.cc:1511] Processing CreateTablet for tablet b739337a620c4dda847978d7da7241fc (DEFAULT_TABLE table=default.Table_acc159ccea854f3cb3316337e3034cf9 [id=73b8dbc714f7418da91f529471c41bc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.437551 7768 tablet_service.cc:1511] Processing CreateTablet for tablet faacce71f7584d7a8a231a75ac21e1a3 (DEFAULT_TABLE table=default.Table_63b0ad358b5c4957b4c3a6e362396654 [id=46398138a8b44752b46ac62e976685f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.437906 7641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ae5273f49e441eaa487c7682b3cc32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.438293 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9a6ffbca32459b8fa2ccca2f84e5fd (DEFAULT_TABLE table=default.Table_f13be87025af439a91adf9854e37e2ea [id=a222063102274293868e7c3bf02216be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.438400 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1378bc91ec4648a685dd522ddfe23194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.439172 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2f040f785948c9b502ee7e5a370773 (DEFAULT_TABLE table=default.Table_071db5e448ef4e9a81bef912b563e4f1 [id=4ac4b9c0bc9c45e19185f3c901fcd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.439318 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0ae7669aef4465bb7135dd8a4c604f (DEFAULT_TABLE table=default.Table_ce966f7989d74488a1ee2deb24e99c67 [id=86f393208d674a0ea36afd3de11ad065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.440093 7736 leader_election.cc:304] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:40.440492 9138 raft_consensus.cc:2749] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:40.440860 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 9948b9c051c540f78315894a86f3443b (DEFAULT_TABLE table=default.Table_b722a262b8644d8aabebc34e3bcef77b [id=3357e76006504bb0affdb1cabf6d917a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:40.441996 8058 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.567s user 0.044s sys 0.063s
W20260505 20:13:40.442097 8058 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.567s user 0.044s sys 0.063s
I20260505 20:13:40.442740 7660 raft_consensus.cc:2468] T dc1323c894d742909e2add9b8f7e2577 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.443162 7924 raft_consensus.cc:2468] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.448987 7596 leader_election.cc:304] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:40.449249 9495 raft_consensus.cc:3060] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:40.452006 7596 leader_election.cc:343] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.452883 9304 consensus_queue.cc:1048] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.454258 9304 consensus_queue.cc:1048] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:40.454380 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1839e2f0dc15432fa49f75b817c19f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.456674 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1839e2f0dc15432fa49f75b817c19f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.456858 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0ae7669aef4465bb7135dd8a4c604f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.457212 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1378bc91ec4648a685dd522ddfe23194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.457574 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ae5273f49e441eaa487c7682b3cc32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.457858 7736 leader_election.cc:304] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:40.457965 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b95c186b6a84c19bebdc570651930fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.458213 9138 raft_consensus.cc:2804] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:40.458365 9138 raft_consensus.cc:697] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:40.458616 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.458660 9138 consensus_queue.cc:237] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.459334 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b739337a620c4dda847978d7da7241fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.466522 9156 raft_consensus.cc:493] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:40.466657 9156 raft_consensus.cc:515] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.467186 9156 leader_election.cc:290] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:40.467401 9524 raft_consensus.cc:493] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.467514 9524 raft_consensus.cc:515] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.468030 9524 leader_election.cc:290] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:40.468804 9156 raft_consensus.cc:493] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:40.468909 9156 raft_consensus.cc:515] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.469447 9156 leader_election.cc:290] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:40.472352 8054 tablet_bootstrap.cc:654] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.483062 7910 tablet_service.cc:1511] Processing CreateTablet for tablet faacce71f7584d7a8a231a75ac21e1a3 (DEFAULT_TABLE table=default.Table_63b0ad358b5c4957b4c3a6e362396654 [id=46398138a8b44752b46ac62e976685f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.483548 7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faacce71f7584d7a8a231a75ac21e1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.486133 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9a6ffbca32459b8fa2ccca2f84e5fd (DEFAULT_TABLE table=default.Table_f13be87025af439a91adf9854e37e2ea [id=a222063102274293868e7c3bf02216be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.486600 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9a6ffbca32459b8fa2ccca2f84e5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.486598 8058 tablet_bootstrap.cc:492] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:40.486832 8058 ts_tablet_manager.cc:1403] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.617s user 0.046s sys 0.063s
I20260505 20:13:40.487797 7907 tablet_service.cc:1511] Processing CreateTablet for tablet 9948b9c051c540f78315894a86f3443b (DEFAULT_TABLE table=default.Table_b722a262b8644d8aabebc34e3bcef77b [id=3357e76006504bb0affdb1cabf6d917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.487937 8058 raft_consensus.cc:359] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.488154 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948b9c051c540f78315894a86f3443b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.488216 8058 raft_consensus.cc:385] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.488301 8058 raft_consensus.cc:740] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.488545 8058 consensus_queue.cc:260] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.490108 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2f040f785948c9b502ee7e5a370773 (DEFAULT_TABLE table=default.Table_071db5e448ef4e9a81bef912b563e4f1 [id=4ac4b9c0bc9c45e19185f3c901fcd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.490468 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2f040f785948c9b502ee7e5a370773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.494535 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.494716 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112c04befa14c48bb5b2e7dfb60dac7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:40.494963 7663 raft_consensus.cc:3060] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:40.496196 8054 tablet_bootstrap.cc:492] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:40.496313 8054 ts_tablet_manager.cc:1403] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.001s
I20260505 20:13:40.497042 8054 raft_consensus.cc:359] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.497191 8054 raft_consensus.cc:385] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:40.497233 8054 raft_consensus.cc:740] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:40.497397 8054 consensus_queue.cc:260] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.499570 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:40.502934 9546 tablet.cc:1724] T 3aad2a9f37ac4cbfa127ecceb132c8bb P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:40.505877 7869 leader_election.cc:343] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:40.525286 9495 raft_consensus.cc:2749] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:40.529596 7923 raft_consensus.cc:2468] T dc1323c894d742909e2add9b8f7e2577 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.540089 8058 ts_tablet_manager.cc:1434] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.053s user 0.004s sys 0.000s
I20260505 20:13:40.543640 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0ae7669aef4465bb7135dd8a4c604f (DEFAULT_TABLE table=default.Table_ce966f7989d74488a1ee2deb24e99c67 [id=86f393208d674a0ea36afd3de11ad065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.544611 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 5b95c186b6a84c19bebdc570651930fb (DEFAULT_TABLE table=default.Table_03f0e27f76de45acb9e0f5f39fdf8185 [id=48c46b0dc0564dd4ba440fadfa91eea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.539001 9270 ts_tablet_manager.cc:1929] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:40.548426 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b95c186b6a84c19bebdc570651930fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.551157 9270 log.cc:1199] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/4939dab5a4d54a08a75424bcaabbb8dd
I20260505 20:13:40.551438 9121 ts_tablet_manager.cc:1929] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:40.556141 9121 log.cc:1199] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/cdda1cc266cd47c993b5d1a0a78c7df9
I20260505 20:13:40.562355 9524 raft_consensus.cc:493] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.562500 9524 raft_consensus.cc:515] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.563153 9524 leader_election.cc:290] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:40.563781 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0ae7669aef4465bb7135dd8a4c604f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.564491 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:40.567518 8940 thread.cc:641] rpc worker (service pool kudu.consensus.ConsensusService) Time spent creating pthread: real 0.730s user 0.128s sys 0.163s
W20260505 20:13:40.567869 8940 thread.cc:608] rpc worker (service pool kudu.consensus.ConsensusService) Time spent starting thread: real 0.731s user 0.128s sys 0.163s
I20260505 20:13:40.572256 9121 ts_tablet_manager.cc:1950] T cdda1cc266cd47c993b5d1a0a78c7df9 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:40.578979 7397 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e1e4b516283f441bb77f038816afa4ed consensus state has no leader
I20260505 20:13:40.582125 8058 tablet_bootstrap.cc:492] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:40.582227 7642 tablet_service.cc:1511] Processing CreateTablet for tablet b739337a620c4dda847978d7da7241fc (DEFAULT_TABLE table=default.Table_acc159ccea854f3cb3316337e3034cf9 [id=73b8dbc714f7418da91f529471c41bc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.585376 7929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:40.585584 7929 raft_consensus.cc:2468] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:40.575487 8054 ts_tablet_manager.cc:1434] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.079s user 0.001s sys 0.001s
I20260505 20:13:40.596043 9270 ts_tablet_manager.cc:1950] T 4939dab5a4d54a08a75424bcaabbb8dd P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:40.596477 7772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1839e2f0dc15432fa49f75b817c19f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.601358 7632 tablet_service.cc:1511] Processing CreateTablet for tablet faacce71f7584d7a8a231a75ac21e1a3 (DEFAULT_TABLE table=default.Table_63b0ad358b5c4957b4c3a6e362396654 [id=46398138a8b44752b46ac62e976685f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.602686 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.604857 9511 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:40.606654 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9a6ffbca32459b8fa2ccca2f84e5fd (DEFAULT_TABLE table=default.Table_f13be87025af439a91adf9854e37e2ea [id=a222063102274293868e7c3bf02216be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.608184 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2f040f785948c9b502ee7e5a370773 (DEFAULT_TABLE table=default.Table_071db5e448ef4e9a81bef912b563e4f1 [id=4ac4b9c0bc9c45e19185f3c901fcd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.609069 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 9948b9c051c540f78315894a86f3443b (DEFAULT_TABLE table=default.Table_b722a262b8644d8aabebc34e3bcef77b [id=3357e76006504bb0affdb1cabf6d917a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:40.611234 7737 leader_election.cc:304] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:40.613390 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b739337a620c4dda847978d7da7241fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.613637 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faacce71f7584d7a8a231a75ac21e1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.614384 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2f040f785948c9b502ee7e5a370773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.614648 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9a6ffbca32459b8fa2ccca2f84e5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.615552 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f27847d940e46778ad10a2f4cf40d27" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.615738 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948b9c051c540f78315894a86f3443b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.616341 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.618593 7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1378bc91ec4648a685dd522ddfe23194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:40.596578 9469 consensus_queue.cc:1048] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.086s
I20260505 20:13:40.623224 8054 tablet_bootstrap.cc:492] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:40.627990 7663 raft_consensus.cc:2468] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 2.
I20260505 20:13:40.628288 8058 tablet_bootstrap.cc:654] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.628399 7925 raft_consensus.cc:2468] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:40.628685 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 70668us
I20260505 20:13:40.633010 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 93) took 3369 ms. Trace:
I20260505 20:13:40.642984 9138 raft_consensus.cc:2804] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:41.213249 8940 rpc_server.cc:307] RPC server started. Bound to: 127.7.33.254:38755
I20260505 20:13:40.962683 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:41.412173 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:41.412374 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_18063423a686432f95c0ef71f46f5fff [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 2 got 0
I20260505 20:13:41.412560 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:41.412822 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:41.413081 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]). Expected version 2 got 0
I20260505 20:13:41.413329 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:41.413610 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:41.222637 7303 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskf21k8s/build/asan/bin/kudu as pid 8940
I20260505 20:13:41.413805 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:41.218132 9601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.33.254:38755 every 8 connection(s)
I20260505 20:13:41.414085 7404 catalog_manager.cc:5671] T 982da795cf2c4e578f3392066b1cc1ea P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:40.678530 8054 tablet_bootstrap.cc:654] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:40.633112 9270 rpcz_store.cc:276] 0505 20:13:37.263656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.264575 (+ 919us) service_pool.cc:224] Handling call
0505 20:13:39.828215 (+2563640us) ts_tablet_manager.cc:1151] Deleting tablet 4939dab5a4d54a08a75424bcaabbb8dd
0505 20:13:39.828229 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:40.437619 (+609390us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.536190 (+ 98571us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.632985 (+ 96795us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2563483}
I20260505 20:13:41.415174 9270 tablet_replica.cc:333] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:41.415381 9270 raft_consensus.cc:2243] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:41.415557 9270 pending_rounds.cc:70] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:41.415592 9270 pending_rounds.cc:77] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737194913308672 op_type: NO_OP noop_request { }
I20260505 20:13:41.415673 9270 raft_consensus.cc:2889] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:41.415742 9270 raft_consensus.cc:2272] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:41.416359 9270 ts_tablet_manager.cc:1916] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:41.416800 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:40.646891 7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ca8cc557674992b88f3379cc1db652" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:41.034149 9581 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4615fa5639440fc820498f897adf17d)
I20260505 20:13:41.417932 7404 catalog_manager.cc:5671] T 6bebda2a5c5a4c43a244504837cf0923 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:41.418193 9581 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:41.418496 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:41.419005 9581 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:41.419082 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:41.219902 8940 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/master-0/data/info.pb
I20260505 20:13:41.419438 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 4939dab5a4d54a08a75424bcaabbb8dd (table default.Table_08e74268c74d44938d75f8cdbfb18948 [id=37c852c9b0b446da97b614a5df0187f0]) successfully deleted
I20260505 20:13:41.419492 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:41.419797 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:41.419974 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:40.680675 9524 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.673683 9556 tablet.cc:1724] T 3aad2a9f37ac4cbfa127ecceb132c8bb P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:41.420239 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:41.420318 9524 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.420748 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:40.725687 7936 raft_consensus.cc:2468] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:40.717391 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:40.718685 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ca8cc557674992b88f3379cc1db652" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:41.421003 7936 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.7.33.194:59211 (request call id 337) took 1071 ms. Trace:
I20260505 20:13:41.421100 7936 rpcz_store.cc:276] 0505 20:13:40.349532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.365802 (+ 16270us) service_pool.cc:224] Handling call
0505 20:13:41.420975 (+1055173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:40.630152 9511 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:40.725881 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 89) took 4915 ms. Trace:
I20260505 20:13:40.854882 9566 raft_consensus.cc:493] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.421351 9121 rpcz_store.cc:276] 0505 20:13:35.810465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810540 (+ 75us) service_pool.cc:224] Handling call
0505 20:13:39.917157 (+4106617us) ts_tablet_manager.cc:1151] Deleting tablet cdda1cc266cd47c993b5d1a0a78c7df9
0505 20:13:39.917174 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:40.456692 (+539518us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.547932 (+ 91240us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.725859 (+177927us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4106310}
I20260505 20:13:41.421415 9566 raft_consensus.cc:515] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.421717 9121 tablet_replica.cc:333] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:41.421911 9511 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:41.421943 9121 raft_consensus.cc:2243] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:41.422000 9566 leader_election.cc:290] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:40.904666 9207 raft_consensus.cc:493] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:41.422101 9121 raft_consensus.cc:2272] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:41.422148 9207 raft_consensus.cc:515] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.422627 9207 leader_election.cc:290] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.422663 9121 ts_tablet_manager.cc:1916] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:40.970304 9429 raft_consensus.cc:493] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.422818 9429 raft_consensus.cc:515] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.423246 9429 leader_election.cc:290] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:40.846585 7870 leader_election.cc:343] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:41.423388 7870 leader_election.cc:304] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:41.423624 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 577293us
W20260505 20:13:41.423889 7870 leader_election.cc:343] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:41.423969 7870 leader_election.cc:304] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.149045 9591 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.424432 9591 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.424886 9591 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:41.425002 9591 raft_consensus.cc:2749] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:41.425274 9591 raft_consensus.cc:2749] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:41.181208 9587 raft_consensus.cc:493] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.425643 9587 raft_consensus.cc:515] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.426329 9587 leader_election.cc:290] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:41.267196 7858 kernel_stack_watchdog.cc:198] Thread 7870 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 134ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fb17ff5f980 (unknown) at ??:0
@ 0x7fb17ff599c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7fb179bcd904 google::LogMessage::Flush() at ??:0
@ 0x7fb179bcda11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fb1887e2953 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7fb1887e54ca kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7fb1887e528e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa4cad std::function<>::operator()() at ??:?
@ 0x7fb1838ad4ff kudu::rpc::Proxy::AsyncRequest()::$_1::operator()() at ??:0
@ 0x7fb1838ad0de std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa4cad std::function<>::operator()() at ??:?
@ 0x7fb183899130 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7fb183899680 kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7fb1838318fa kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7fb1838301e6 kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7fb183845605 ev::base<>::method_thunk<>() at ??:0
I20260505 20:13:41.353586 9525 raft_consensus.cc:493] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.764886 8058 tablet_bootstrap.cc:492] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:41.426875 9525 raft_consensus.cc:515] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:40.880234 9349 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:41.427172 8058 ts_tablet_manager.cc:1403] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.883s user 0.006s sys 0.006s
I20260505 20:13:41.427145 9349 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.427404 9525 leader_election.cc:290] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.427744 9349 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:40.708101 7598 leader_election.cc:304] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:41.427973 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 720291us
I20260505 20:13:41.428073 8058 raft_consensus.cc:359] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.914527 9156 raft_consensus.cc:493] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.428234 8058 raft_consensus.cc:385] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:41.018437 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:41.428321 8058 raft_consensus.cc:740] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:41.428531 8058 consensus_queue.cc:260] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.429108 8058 ts_tablet_manager.cc:1434] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:41.429410 8058 tablet_bootstrap.cc:492] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:40.648824 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faacce71f7584d7a8a231a75ac21e1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:41.428329 9156 raft_consensus.cc:515] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.430006 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2f040f785948c9b502ee7e5a370773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:41.430289 9156 leader_election.cc:290] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:41.430428 9156 raft_consensus.cc:2804] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:41.430482 9156 raft_consensus.cc:493] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:41.430547 9156 raft_consensus.cc:3060] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:41.433063 9156 raft_consensus.cc:515] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.433498 9156 leader_election.cc:290] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:41.433645 9156 consensus_queue.cc:1048] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:41.434182 7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ae5273f49e441eaa487c7682b3cc32. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:41.231463 7585 kernel_stack_watchdog.cc:198] Thread 7598 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 199ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fd6a8771980 (unknown) at ??:0
@ 0x7fd6a876b9c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7fd6a23df904 google::LogMessage::Flush() at ??:0
@ 0x7fd6a23dfa11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fd6b0ff375b kudu::consensus::LeaderElection::CheckForDecision() at ??:0
@ 0x7fd6b0ff4b02 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7fd6b0ff74ca kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7fd6b0ff728e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa4cad std::function<>::operator()() at ??:?
@ 0x7fd6ac0bf4ff kudu::rpc::Proxy::AsyncRequest()::$_1::operator()() at ??:0
@ 0x7fd6ac0bf0de std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa4cad std::function<>::operator()() at ??:?
@ 0x7fd6ac0ab130 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7fd6ac0ab680 kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7fd6ac0438fa kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7fd6ac0421e6 kudu::rpc::Connection::ReadHandler() at ??:0
I20260505 20:13:40.703658 9469 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.434862 9469 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.435408 9469 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.246074 9495 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.439087 9495 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.439677 9495 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:40.723340 9138 raft_consensus.cc:697] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:41.440027 9138 consensus_queue.cc:237] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.726100 9271 ts_tablet_manager.cc:1929] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:41.441324 9271 log.cc:1199] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/bd1f7a0fefa74f45a1cf3ffeac2c33fb
I20260505 20:13:41.441666 9271 ts_tablet_manager.cc:1950] T bd1f7a0fefa74f45a1cf3ffeac2c33fb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:41.442015 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 96) took 4192 ms. Trace:
I20260505 20:13:41.442062 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b739337a620c4dda847978d7da7241fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:41.442090 9271 rpcz_store.cc:276] 0505 20:13:37.249725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.251926 (+ 2201us) service_pool.cc:224] Handling call
0505 20:13:40.344304 (+3092378us) ts_tablet_manager.cc:1151] Deleting tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb
0505 20:13:40.344316 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:40.524402 (+180086us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:40.725973 (+201571us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.441997 (+716024us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3092243}
I20260505 20:13:41.442554 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 82) took 4194 ms. Trace:
I20260505 20:13:41.442637 9271 rpcz_store.cc:276] 0505 20:13:37.248446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.255931 (+ 7485us) service_pool.cc:224] Handling call
0505 20:13:41.442410 (+4186479us) ts_tablet_manager.cc:1151] Deleting tablet e32ff17c39f04bc2b1c9c37a1165399b
0505 20:13:41.442423 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.442531 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4186311}
I20260505 20:13:41.442883 9271 tablet_replica.cc:333] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:41.443051 9271 raft_consensus.cc:2243] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:41.443192 9271 raft_consensus.cc:2272] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:41.443706 9271 ts_tablet_manager.cc:1916] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:40.744977 7736 leader_election.cc:343] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:41.446365 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 764048us
I20260505 20:13:41.447190 9609 raft_consensus.cc:493] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:40.749858 8053 tablet_bootstrap.cc:492] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:40.774209 9432 raft_consensus.cc:493] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.447367 9609 raft_consensus.cc:515] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.447497 8053 ts_tablet_manager.cc:1403] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 1.131s user 0.010s sys 0.016s
I20260505 20:13:41.447474 9432 raft_consensus.cc:515] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.447925 9432 leader_election.cc:290] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.091231 8989 raft_consensus.cc:493] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.459465 8989 raft_consensus.cc:515] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.460237 8989 leader_election.cc:290] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.229858 9471 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:41.460453 9471 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.421000 9524 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:41.428246 7598 leader_election.cc:343] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 949fecb197084426b5a6adb959f5c886
I20260505 20:13:41.461041 9471 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:41.269032 9242 raft_consensus.cc:493] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:41.297694 7723 kernel_stack_watchdog.cc:198] Thread 7737 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/outbound_call.cc:307 for 228ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fdbe79ce980 (unknown) at ??:0
@ 0x7fdbe79c89c6 __GI___pthread_rwlock_wrlock at ??:0
@ 0x7fdbe163c904 google::LogMessage::Flush() at ??:0
@ 0x7fdbe163ca11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fdbf025075b kudu::consensus::LeaderElection::CheckForDecision() at ??:0
@ 0x7fdbf0251b02 kudu::consensus::LeaderElection::VoteResponseRpcCallback() at ??:0
@ 0x7fdbf02544ca kudu::consensus::LeaderElection::Run()::$_0::operator()() at ??:0
@ 0x7fdbf025428e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa4cad std::function<>::operator()() at ??:?
@ 0x7fdbeb31c4ff kudu::rpc::Proxy::AsyncRequest()::$_1::operator()() at ??:0
@ 0x7fdbeb31c0de std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa4cad std::function<>::operator()() at ??:?
@ 0x7fdbeb308130 kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7fdbeb308680 kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7fdbeb2a08fa kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7fdbeb29f1e6 kudu::rpc::Connection::ReadHandler() at ??:0
W20260505 20:13:41.461211 7598 leader_election.cc:343] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f62626fb4f8445e3a6e2822277181762
I20260505 20:13:41.461210 9242 raft_consensus.cc:515] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:40.685737 7737 leader_election.cc:304] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.461773 9242 leader_election.cc:290] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.461927 9242 raft_consensus.cc:2804] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:41.462038 9242 raft_consensus.cc:697] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:41.462317 9242 consensus_queue.cc:237] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.447973 8718 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.463438 8718 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.448239 8053 raft_consensus.cc:359] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.463851 8053 raft_consensus.cc:385] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:41.463924 8053 raft_consensus.cc:740] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:41.464032 8718 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.464123 8053 consensus_queue.cc:260] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.447926 9609 leader_election.cc:290] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.449914 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0ae7669aef4465bb7135dd8a4c604f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:41.464618 7597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260505 20:13:41.461781 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 815328us
W20260505 20:13:41.466629 7737 consensus_peers.cc:597] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 506b421a774c4929813205dba0fac32b. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:41.466806 7737 leader_election.cc:304] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.467053 8718 raft_consensus.cc:2804] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:41.467149 8718 raft_consensus.cc:697] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:41.467358 8718 consensus_queue.cc:237] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:41.468647 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9a6ffbca32459b8fa2ccca2f84e5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:41.469461 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b95c186b6a84c19bebdc570651930fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:41.472222 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948b9c051c540f78315894a86f3443b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:41.473307 8053 ts_tablet_manager.cc:1434] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260505 20:13:41.473584 8053 tablet_bootstrap.cc:492] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:41.473995 7758 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 134) took 1774 ms. Trace:
I20260505 20:13:41.474067 7758 rpcz_store.cc:276] 0505 20:13:39.699899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.699952 (+ 53us) service_pool.cc:224] Handling call
0505 20:13:40.258300 (+558348us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x6160001b5e54. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:40.366436 (+108136us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x6160001e2254. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:40.615822 (+249386us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x6160001f5754. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:41.473972 (+858150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009738624}
I20260505 20:13:41.475709 8053 tablet_bootstrap.cc:654] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:41.476935 7776 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 247) took 1038 ms. Trace:
I20260505 20:13:41.477020 7776 rpcz_store.cc:276] 0505 20:13:40.438890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.438953 (+ 63us) service_pool.cc:224] Handling call
0505 20:13:40.439360 (+ 407us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.439382 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.432842 (+993460us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.476773 (+ 43931us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.476916 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.478088 7765 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 240) took 1046 ms. Trace:
I20260505 20:13:41.478168 7765 rpcz_store.cc:276] 0505 20:13:40.431649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.432471 (+ 822us) service_pool.cc:224] Handling call
0505 20:13:40.432937 (+ 466us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.432962 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.448255 (+1015293us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.477923 (+ 29668us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.478070 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.479801 7764 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 241) took 1045 ms. Trace:
I20260505 20:13:41.479864 7764 rpcz_store.cc:276] 0505 20:13:40.433971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.434188 (+ 217us) service_pool.cc:224] Handling call
0505 20:13:40.434617 (+ 429us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.434636 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.436940 (+1002304us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.479685 (+ 42745us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.479787 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.481428 7775 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 244) took 1045 ms. Trace:
I20260505 20:13:41.481496 7775 rpcz_store.cc:276] 0505 20:13:40.435479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.435532 (+ 53us) service_pool.cc:224] Handling call
0505 20:13:40.435907 (+ 375us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.435930 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.444977 (+1009047us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.481306 (+ 36329us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.481415 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.420912 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:41.427647 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet cdda1cc266cd47c993b5d1a0a78c7df9 (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:41.449877 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb (table default.Table_9ee43863f3354d3fb8f0457fbdc6d5c7 [id=e51e3514b22840c391a0e2f929547557]) successfully deleted
I20260505 20:13:41.454205 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 760 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
W20260505 20:13:41.484354 7399 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 56678.4us
I20260505 20:13:41.484473 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
W20260505 20:13:41.484481 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e32ff17c39f04bc2b1c9c37a1165399b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e32ff17c39f04bc2b1c9c37a1165399b already in progress: creating tablet
I20260505 20:13:41.484750 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:41.484906 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:41.485074 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:41.485379 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:41.487232 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:41.487414 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:41.488286 8058 tablet_bootstrap.cc:654] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:41.489645 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:41.490370 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:41.491380 7404 catalog_manager.cc:5671] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
I20260505 20:13:41.494807 9566 raft_consensus.cc:493] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.494973 9566 raft_consensus.cc:515] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.491763 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:41.495729 9566 leader_election.cc:290] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.495757 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:41.496583 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:41.496928 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:41.503298 9121 ts_tablet_manager.cc:1929] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:41.503419 9121 log.cc:1199] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/3d74dbab83b840d9b2bd103e946d3032
I20260505 20:13:41.503775 9121 ts_tablet_manager.cc:1950] T 3d74dbab83b840d9b2bd103e946d3032 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:41.504542 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 88) took 5694 ms. Trace:
I20260505 20:13:41.504626 9121 rpcz_store.cc:276] 0505 20:13:35.810374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810754 (+ 380us) service_pool.cc:224] Handling call
0505 20:13:41.421660 (+5610906us) ts_tablet_manager.cc:1151] Deleting tablet 3d74dbab83b840d9b2bd103e946d3032
0505 20:13:41.421673 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.442651 (+ 20978us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.453682 (+ 11031us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.504516 (+ 50834us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5610751}
I20260505 20:13:41.505267 9121 tablet_replica.cc:333] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:41.505496 9121 raft_consensus.cc:2243] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:41.505635 9121 raft_consensus.cc:2272] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:41.509985 7771 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 243) took 1075 ms. Trace:
I20260505 20:13:41.510103 7771 rpcz_store.cc:276] 0505 20:13:40.434240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.434290 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:40.434710 (+ 420us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.434732 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.501896 (+1067164us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.504410 (+ 2514us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.509948 (+ 5538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.510973 7774 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 248) took 1070 ms. Trace:
I20260505 20:13:41.511061 7774 rpcz_store.cc:276] 0505 20:13:40.440514 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.440564 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:40.441072 (+ 508us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.441099 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.507097 (+1065998us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.510769 (+ 3672us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.510951 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.511657 7766 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 246) took 1073 ms. Trace:
I20260505 20:13:41.511739 7766 rpcz_store.cc:276] 0505 20:13:40.438076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.438129 (+ 53us) service_pool.cc:224] Handling call
0505 20:13:40.438474 (+ 345us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.438498 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.501898 (+1063400us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.511508 (+ 9610us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.511642 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7118}
I20260505 20:13:41.513193 8054 tablet_bootstrap.cc:492] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:41.514464 9609 raft_consensus.cc:493] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:41.514583 9609 raft_consensus.cc:515] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.515118 9609 leader_election.cc:290] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.515311 8054 ts_tablet_manager.cc:1403] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.916s user 0.006s sys 0.009s
I20260505 20:13:41.517593 7768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 245) took 1080 ms. Trace:
I20260505 20:13:41.517683 7768 rpcz_store.cc:276] 0505 20:13:40.437326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.437378 (+ 52us) service_pool.cc:224] Handling call
0505 20:13:40.437725 (+ 347us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.437776 (+ 51us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.432838 (+995062us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.517394 (+ 84556us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.517550 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:41.517632 8054 raft_consensus.cc:359] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.524616 8054 raft_consensus.cc:385] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:41.524696 8054 raft_consensus.cc:740] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:41.524935 8054 consensus_queue.cc:260] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.525550 8054 ts_tablet_manager.cc:1434] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260505 20:13:41.525882 8054 tablet_bootstrap.cc:492] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:41.528043 8054 tablet_bootstrap.cc:654] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:41.529798 9121 ts_tablet_manager.cc:1916] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:41.544214 9270 ts_tablet_manager.cc:1929] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:41.544344 9270 log.cc:1199] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/6cf77f6323af4263852853e10003faee
I20260505 20:13:41.544677 9270 ts_tablet_manager.cc:1950] T 6cf77f6323af4263852853e10003faee P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:41.547089 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 94) took 4283 ms. Trace:
I20260505 20:13:41.547196 9270 rpcz_store.cc:276] 0505 20:13:37.263724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.264756 (+ 1032us) service_pool.cc:224] Handling call
0505 20:13:41.415081 (+4150325us) ts_tablet_manager.cc:1151] Deleting tablet 6cf77f6323af4263852853e10003faee
0505 20:13:41.415100 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.492677 (+ 77577us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.544149 (+ 51472us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.547067 (+ 2918us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4150192}
I20260505 20:13:41.547710 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 6cf77f6323af4263852853e10003faee (table default.Table_813570fe84494402989524e1939f8ae7 [id=a5182c95fa7443dbb6f5eeea64a90764]) successfully deleted
I20260505 20:13:41.547919 9270 tablet_replica.cc:333] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:41.548108 9270 raft_consensus.cc:2243] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:41.548298 9270 raft_consensus.cc:2272] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:41.548847 9270 ts_tablet_manager.cc:1916] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:41.549806 7780 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40056 (request call id 242) took 1115 ms. Trace:
I20260505 20:13:41.549912 7780 rpcz_store.cc:276] 0505 20:13:40.434090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.438949 (+ 4859us) service_pool.cc:224] Handling call
0505 20:13:40.439450 (+ 501us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0505 20:13:40.439465 (+ 15us) ts_tablet_manager.cc:682] Creating new metadata...
0505 20:13:41.480751 (+1041286us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.549558 (+ 68807us) tablet_replica.cc:206] Creating consensus instance
0505 20:13:41.549778 (+ 220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260505 20:13:41.553247 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 129062us
W20260505 20:13:41.553953 7870 leader_election.cc:343] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:41.554065 7870 leader_election.cc:304] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.554273 9591 raft_consensus.cc:2749] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:41.555262 7761 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 137) took 1109 ms. Trace:
I20260505 20:13:41.704883 9617 sys_catalog.cc:263] Verifying existing consensus state
I20260505 20:13:41.784009 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Bootstrap starting.
I20260505 20:13:41.555361 7761 rpcz_store.cc:276] 0505 20:13:40.445412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.445467 (+ 55us) service_pool.cc:224] Handling call
0505 20:13:41.551556 (+1106089us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x6160000e2c54. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:41.555204 (+ 3648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191038848}
I20260505 20:13:41.601845 9270 ts_tablet_manager.cc:1929] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:41.821815 9270 log.cc:1199] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:41.822268 9270 ts_tablet_manager.cc:1950] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:41.823005 7848 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:41.823088 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 95) took 4559 ms. Trace:
I20260505 20:13:41.823172 9270 rpcz_store.cc:276] 0505 20:13:37.263821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.265025 (+ 1204us) service_pool.cc:224] Handling call
0505 20:13:41.547502 (+4282477us) ts_tablet_manager.cc:1151] Deleting tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a
0505 20:13:41.547513 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.559348 (+ 11835us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.597935 (+ 38587us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.823065 (+225130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4282331}
I20260505 20:13:41.823479 9270 tablet_replica.cc:333] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:41.823649 9270 raft_consensus.cc:2243] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:41.823797 9270 raft_consensus.cc:2272] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:41.824347 9270 ts_tablet_manager.cc:1916] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:41.554598 7870 leader_election.cc:343] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:41.825825 7870 leader_election.cc:304] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.826128 9591 raft_consensus.cc:2749] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:41.826167 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 271685us
W20260505 20:13:41.826372 7870 leader_election.cc:343] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:41.826458 7870 leader_election.cc:304] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.826653 9591 raft_consensus.cc:2749] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:41.569845 9609 consensus_queue.cc:1048] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:41.639187 8058 tablet_bootstrap.cc:492] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:41.828161 8058 ts_tablet_manager.cc:1403] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.399s user 0.005s sys 0.005s
I20260505 20:13:41.828961 8058 raft_consensus.cc:359] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.829133 8058 raft_consensus.cc:385] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:41.829181 8058 raft_consensus.cc:740] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:41.581142 7397 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e2c99f02ea514a2581f0697dc3ef6461 consensus state has no leader
I20260505 20:13:41.570554 7736 leader_election.cc:304] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
W20260505 20:13:41.909087 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 338690us
I20260505 20:13:41.909842 8989 raft_consensus.cc:2804] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:41.584059 7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:41.910023 8989 raft_consensus.cc:697] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:41.910305 8989 consensus_queue.cc:237] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.910396 9432 consensus_queue.cc:1048] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:41.910455 9609 consensus_queue.cc:1048] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:41.597605 9271 ts_tablet_manager.cc:1929] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:41.911274 9271 log.cc:1199] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1ed44127b4c848bf9ed4a49ad8b106fb
I20260505 20:13:41.911698 9271 ts_tablet_manager.cc:1950] T 1ed44127b4c848bf9ed4a49ad8b106fb P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:41.911980 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 83) took 4663 ms. Trace:
I20260505 20:13:41.769853 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:41.984709 7406 catalog_manager.cc:5671] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:41.985467 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_18063423a686432f95c0ef71f46f5fff [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 2 got 0
I20260505 20:13:41.985716 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:41.985960 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:41.986213 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
W20260505 20:13:41.568774 7869 leader_election.cc:343] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:41.986408 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 417825us
I20260505 20:13:41.986467 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:41.986876 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:41.987094 7406 catalog_manager.cc:5671] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:41.987614 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.987848 7919 raft_consensus.cc:2468] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:41.988004 7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.988159 7920 raft_consensus.cc:2468] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:41.987674 7406 catalog_manager.cc:5671] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:41.988608 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]). Expected version 2 got 0
I20260505 20:13:41.988734 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.989019 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.989120 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:41.989148 7923 raft_consensus.cc:2468] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:41.829352 8058 consensus_queue.cc:260] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:41.989400 7406 catalog_manager.cc:5671] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:41.657023 7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:41.989717 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 43a3e9d404f14b43ae99c4a905f50086 (table default.Table_7646d675edc848db9de3a71afeb0633d [id=88123d48cd234b2a8b5c68f4cc4cb788]). Expected version 1 got 0
I20260505 20:13:41.989936 8058 ts_tablet_manager.cc:1434] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.162s user 0.001s sys 0.001s
I20260505 20:13:41.990172 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 3 got 0
I20260505 20:13:41.990264 8058 tablet_bootstrap.cc:492] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:41.990267 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.990351 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d411638715f747469f9f3dc490c0257c (table default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef]). Expected version 1 got 0
I20260505 20:13:41.990406 7933 raft_consensus.cc:2468] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:41.990727 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:41.912057 9271 rpcz_store.cc:276] 0505 20:13:37.248541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.256132 (+ 7591us) service_pool.cc:224] Handling call
0505 20:13:41.442845 (+4186713us) ts_tablet_manager.cc:1151] Deleting tablet 1ed44127b4c848bf9ed4a49ad8b106fb
0505 20:13:41.442852 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.523043 (+ 80191us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.597529 (+ 74486us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.911966 (+314437us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4186580}
I20260505 20:13:41.991047 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.991170 7935 raft_consensus.cc:2468] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:41.991202 9271 tablet_replica.cc:333] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:41.598471 8054 tablet_bootstrap.cc:492] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:41.991451 8054 ts_tablet_manager.cc:1403] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.466s user 0.006s sys 0.000s
I20260505 20:13:41.991459 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.991560 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:41.991616 7919 raft_consensus.cc:2468] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:41.991796 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:41.992169 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:41.992357 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:41.992544 7930 raft_consensus.cc:2393] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:41.992614 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:41.992964 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:41.993194 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
W20260505 20:13:41.668314 7598 consensus_peers.cc:597] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d74dbab83b840d9b2bd103e946d3032. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:41.993491 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 325337us
I20260505 20:13:41.993553 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:41.993688 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:41.994234 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:41.994449 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:41.994619 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:41.994796 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:41.994992 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:41.995009 9156 consensus_queue.cc:1048] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:41.995137 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:41.995280 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:41.995560 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:41.996023 7406 catalog_manager.cc:5671] T 94fc0e6ac0fa4f8bbaef2fcf1ecbbd70 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:41.603317 8053 tablet_bootstrap.cc:492] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:41.623515 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:41.673020 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:41.997624 8053 ts_tablet_manager.cc:1403] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.524s user 0.005s sys 0.000s
I20260505 20:13:41.673488 7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:41.997813 7792 raft_consensus.cc:2468] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:41.673574 7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:41.998070 7797 raft_consensus.cc:3060] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:41.998462 8053 raft_consensus.cc:359] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.998612 8053 raft_consensus.cc:385] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:41.998665 8053 raft_consensus.cc:740] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:41.998842 8053 consensus_queue.cc:260] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:41.999253 8053 ts_tablet_manager.cc:1434] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:41.999512 8053 tablet_bootstrap.cc:492] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:42.000833 7797 raft_consensus.cc:2468] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:42.000927 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:41.673955 7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.001080 7791 raft_consensus.cc:2468] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:41.674445 7800 raft_consensus.cc:3060] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.001291 8053 tablet_bootstrap.cc:654] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.001853 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:41.622839 9121 ts_tablet_manager.cc:1929] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:41.650095 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:42.002063 9121 log.cc:1199] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
I20260505 20:13:42.002125 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:42.002120 7921 raft_consensus.cc:2468] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:41.650715 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:41.651211 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:42.002445 9121 ts_tablet_manager.cc:1950] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:42.002503 7931 raft_consensus.cc:2468] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:42.002539 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:41.808521 7983 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:42.002760 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
W20260505 20:13:41.790158 7597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:42.003844 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1ed44127b4c848bf9ed4a49ad8b106fb (table default.Table_c1015d9a8a7a49cba428a699afd14df2 [id=4137f9cb4fb646c4b7cd33fae3e93ebf]) successfully deleted
I20260505 20:13:41.712646 7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c5c661e8aa4962bb9922b9ead7d784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:41.830214 7870 leader_election.cc:343] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.004083 7870 leader_election.cc:304] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:41.656646 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.004336 7657 raft_consensus.cc:2468] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:42.004618 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:42.002444 7922 raft_consensus.cc:3060] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:42.005012 7411 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 010c399e14624550bf02ea248d653538 consensus state has no leader
I20260505 20:13:42.005231 7411 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 143) took 1919 ms. Trace:
I20260505 20:13:42.005323 7411 rpcz_store.cc:276] 0505 20:13:40.085506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.113942 (+ 28436us) service_pool.cc:224] Handling call
0505 20:13:40.123063 (+ 9121us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.123291 (+ 228us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:40.123442 (+ 151us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:40.123499 (+ 57us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:40.385435 (+261936us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:42.005164 (+1619729us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.131916 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.132050 (+ 134us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.132059 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:40.132063 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:40.132199 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.132215 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.132222 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:40.132301 (+ 79us) tablet.cc:701] Row locks acquired
0505 20:13:40.132306 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:40.132346 (+ 40us) write_op.cc:270] Start()
0505 20:13:40.132389 (+ 43us) write_op.cc:276] Timestamp: P: 1778012020132324 usec, L: 0
0505 20:13:40.132395 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.132630 (+ 235us) log.cc:844] Serialized 405 byte log entry
0505 20:13:40.384464 (+251834us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.384853 (+ 389us) write_op.cc:301] APPLY: starting
0505 20:13:40.384877 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.384932 (+ 55us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.384980 (+ 48us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.385064 (+ 84us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.385112 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:40.385124 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:40.385238 (+ 114us) log.cc:844] Serialized 23 byte log entry
0505 20:13:40.385316 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.385340 (+ 24us) write_op.cc:454] Released schema lock
0505 20:13:40.385348 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:40.385426 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.385429 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":320,"apply.run_cpu_time_us":571,"apply.run_wall_time_us":570,"mutex_wait_us":7798,"num_ops":1,"prepare.queue_time_us":7947,"prepare.run_cpu_time_us":835,"prepare.run_wall_time_us":921,"raft.queue_time_us":42,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":252025}]]}
I20260505 20:13:41.715353 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.007485 7922 raft_consensus.cc:2468] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:41.997684 7794 raft_consensus.cc:2468] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:41.997627 7793 raft_consensus.cc:2468] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:41.934223 9619 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:42.009914 9619 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.010687 9619 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:41.835191 9270 ts_tablet_manager.cc:1929] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260505 20:13:41.728209 7596 leader_election.cc:343] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: f62626fb4f8445e3a6e2822277181762
W20260505 20:13:41.963256 7599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:42.010864 9270 log.cc:1199] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/beb404fa927641f48f28c6bdaa297db3
I20260505 20:13:42.010876 7596 leader_election.cc:304] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:42.011300 9270 ts_tablet_manager.cc:1950] T beb404fa927641f48f28c6bdaa297db3 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:42.011533 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 283456us
I20260505 20:13:42.012108 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 97) took 4748 ms. Trace:
I20260505 20:13:42.012184 9270 rpcz_store.cc:276] 0505 20:13:37.264000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.265504 (+ 1504us) service_pool.cc:224] Handling call
0505 20:13:41.823432 (+4557928us) ts_tablet_manager.cc:1151] Deleting tablet beb404fa927641f48f28c6bdaa297db3
0505 20:13:41.823444 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.832161 (+ 8717us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.835139 (+ 2978us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.012087 (+176948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":4557787}
I20260505 20:13:42.012519 9270 tablet_replica.cc:333] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:42.012717 9270 raft_consensus.cc:2243] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.012848 9270 raft_consensus.cc:2272] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.012933 7926 raft_consensus.cc:2468] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:42.013371 9270 ts_tablet_manager.cc:1916] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.013944 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 26b143e4943343d5b151f2804cccecfb
I20260505 20:13:42.014616 7408 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 144) took 1922 ms. Trace:
I20260505 20:13:42.014750 7408 rpcz_store.cc:276] 0505 20:13:40.091956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.092022 (+ 66us) service_pool.cc:224] Handling call
0505 20:13:40.092620 (+ 598us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.092783 (+ 163us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:40.092856 (+ 73us) catalog_manager.cc:2824] Locking tablets
0505 20:13:40.422941 (+330085us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:40.498086 (+ 75145us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:40.793793 (+295707us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:42.013855 (+1220062us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:42.014562 (+ 707us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.423828 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.423905 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.423909 (+ 4us) write_op.cc:435] Acquired schema lock
0505 20:13:40.423911 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:40.424031 (+ 120us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.424045 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.424050 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:40.424155 (+ 105us) tablet.cc:701] Row locks acquired
0505 20:13:40.424158 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:40.424193 (+ 35us) write_op.cc:270] Start()
0505 20:13:40.424225 (+ 32us) write_op.cc:276] Timestamp: P: 1778012020424288 usec, L: 0
0505 20:13:40.424229 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.472378 (+ 48149us) log.cc:844] Serialized 728 byte log entry
0505 20:13:40.472590 (+ 212us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:40.496630 (+ 24040us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.496835 (+ 205us) write_op.cc:301] APPLY: starting
0505 20:13:40.496852 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.496902 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.496905 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.496989 (+ 84us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.497026 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:40.497034 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:40.497116 (+ 82us) log.cc:844] Serialized 29 byte log entry
0505 20:13:40.497934 (+ 818us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.497959 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:40.497968 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:40.498197 (+ 229us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.498204 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":149,"apply.run_cpu_time_us":520,"apply.run_wall_time_us":1314,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":1719,"prepare.run_wall_time_us":48821,"raft.queue_time_us":867,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":72358,"spinlock_wait_cycles":110318848}]]}
I20260505 20:13:42.015931 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_336bd702d04447f18b2f62bfa31d916e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.016697 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_336bd702d04447f18b2f62bfa31d916e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:41.715378 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.017889 7789 raft_consensus.cc:2468] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:42.018751 7409 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 148) took 1896 ms. Trace:
I20260505 20:13:41.715734 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.021864 7785 raft_consensus.cc:2468] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:41.716642 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:41.716969 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:41.742026 9138 consensus_queue.cc:1048] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:41.742448 9621 consensus_queue.cc:1048] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.026582 9349 raft_consensus.cc:2749] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:42.018838 7409 rpcz_store.cc:276] 0505 20:13:40.122391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.125080 (+ 2689us) service_pool.cc:224] Handling call
0505 20:13:40.125485 (+ 405us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.125670 (+ 185us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:40.125822 (+ 152us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:40.126465 (+ 643us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:40.386428 (+259963us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:42.018697 (+1632269us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.132857 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.132940 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.132947 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:40.132952 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:40.133057 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.133069 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.133076 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:40.133333 (+ 257us) tablet.cc:701] Row locks acquired
0505 20:13:40.133337 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:40.133378 (+ 41us) write_op.cc:270] Start()
0505 20:13:40.133414 (+ 36us) write_op.cc:276] Timestamp: P: 1778012020133355 usec, L: 0
0505 20:13:40.133420 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.133611 (+ 191us) log.cc:844] Serialized 405 byte log entry
0505 20:13:40.384553 (+250942us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.385490 (+ 937us) write_op.cc:301] APPLY: starting
0505 20:13:40.385505 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.385542 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.385581 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.385627 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.385664 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:40.385674 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:40.385761 (+ 87us) log.cc:844] Serialized 23 byte log entry
0505 20:13:40.385813 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.385831 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:40.385838 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:40.385914 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.385921 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":902,"apply.run_cpu_time_us":411,"apply.run_wall_time_us":410,"mutex_wait_us":4973,"num_ops":1,"prepare.queue_time_us":6017,"prepare.run_cpu_time_us":685,"prepare.run_wall_time_us":934,"raft.queue_time_us":43,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":251111}]]}
I20260505 20:13:42.043051 7409 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_7646d675edc848db9de3a71afeb0633d" } modify_external_catalogs: true
I20260505 20:13:42.043259 7409 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_7646d675edc848db9de3a71afeb0633d" } modify_external_catalogs: true
W20260505 20:13:42.019696 7410 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01ed3ee8c7a048979f5c620bc21f5b96 consensus state has no leader
I20260505 20:13:42.027390 7404 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_ea0f05ec98db400598340a9825b698ff [id=3505dd62d0f747cb93b233259fadc6ef] alter complete (version 1)
I20260505 20:13:42.043824 7410 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 147) took 1923 ms. Trace:
I20260505 20:13:42.043953 7410 rpcz_store.cc:276] 0505 20:13:40.120809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.120894 (+ 85us) service_pool.cc:224] Handling call
0505 20:13:40.121687 (+ 793us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.121938 (+ 251us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:40.122177 (+ 239us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:40.122269 (+ 92us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:40.376151 (+253882us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:42.043769 (+1667618us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.130039 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.130136 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.130142 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:40.130145 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:40.130256 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.130278 (+ 22us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.130283 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:40.130350 (+ 67us) tablet.cc:701] Row locks acquired
0505 20:13:40.130353 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:40.130393 (+ 40us) write_op.cc:270] Start()
0505 20:13:40.130429 (+ 36us) write_op.cc:276] Timestamp: P: 1778012020130369 usec, L: 0
0505 20:13:40.130433 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.130622 (+ 189us) log.cc:844] Serialized 405 byte log entry
0505 20:13:40.375128 (+244506us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.375315 (+ 187us) write_op.cc:301] APPLY: starting
0505 20:13:40.375336 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.375381 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.375407 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.375461 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.375498 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:40.375507 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:40.375599 (+ 92us) log.cc:844] Serialized 23 byte log entry
0505 20:13:40.375681 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.375703 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:40.375714 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:40.375807 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.375813 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":122,"apply.run_cpu_time_us":480,"apply.run_wall_time_us":480,"num_ops":1,"prepare.queue_time_us":7125,"prepare.run_cpu_time_us":715,"prepare.run_wall_time_us":1057,"raft.queue_time_us":383,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":261,"replication_time_us":244656}]]}
I20260505 20:13:42.044711 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_9c7e297fd6744f3e93ff2913562e202c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.045212 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c7e297fd6744f3e93ff2913562e202c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:41.600162 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.031911 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 151) took 1836 ms. Trace:
I20260505 20:13:42.045902 7795 raft_consensus.cc:2376] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1. Re-sending same reply.
I20260505 20:13:42.034552 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 26b143e4943343d5b151f2804cccecfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:40 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:42.045979 7408 rpcz_store.cc:276] 0505 20:13:40.195365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.015696 (+1820331us) service_pool.cc:224] Handling call
0505 20:13:42.016808 (+ 1112us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.017408 (+ 600us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.031618 (+ 14210us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.031753 (+ 135us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.031863 (+ 110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.020886 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.020989 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.020994 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:42.020997 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.021075 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.021090 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.021094 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.021190 (+ 96us) tablet.cc:701] Row locks acquired
0505 20:13:42.021193 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:42.021227 (+ 34us) write_op.cc:270] Start()
0505 20:13:42.021255 (+ 28us) write_op.cc:276] Timestamp: P: 1778012022021331 usec, L: 0
0505 20:13:42.021258 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.021442 (+ 184us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.026482 (+ 5040us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.031068 (+ 4586us) write_op.cc:301] APPLY: starting
0505 20:13:42.031085 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.031126 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.031162 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.031265 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.031296 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.031304 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:42.031374 (+ 70us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.031419 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.031437 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:42.031444 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.031520 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.031524 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4523,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":450,"num_ops":2,"prepare.queue_time_us":2916,"prepare.run_cpu_time_us":610,"prepare.run_wall_time_us":609,"replication_time_us":5194}]]}
I20260505 20:13:42.035296 9271 raft_consensus.cc:2243] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.046845 9271 raft_consensus.cc:2272] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.046934 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_7c8e6cbb25e64aa99b0470627ffebb7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:42.047477 9271 ts_tablet_manager.cc:1916] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:42.047519 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c8e6cbb25e64aa99b0470627ffebb7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:41.909852 7736 consensus_peers.cc:597] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:42.049787 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 140029us
I20260505 20:13:42.041595 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet beb404fa927641f48f28c6bdaa297db3 (table default.Table_c6fb56a940914efea745a3928384c125 [id=88907f7bed654b0a9e35b82d3667bc11]) successfully deleted
I20260505 20:13:42.027652 9349 consensus_queue.cc:1048] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.035876 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 26b143e4943343d5b151f2804cccecfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:40 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:42.067210 7599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:42.067327 8058 tablet_bootstrap.cc:654] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.082957 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
W20260505 20:13:42.086858 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 97490.6us
I20260505 20:13:42.087200 9524 raft_consensus.cc:493] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.087345 9524 raft_consensus.cc:515] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.088438 9524 leader_election.cc:290] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:42.089043 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 258942us
W20260505 20:13:42.089234 7870 leader_election.cc:343] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.089324 7870 leader_election.cc:304] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.090019 9429 raft_consensus.cc:2749] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.090184 9429 raft_consensus.cc:2749] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.090657 8054 raft_consensus.cc:359] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.090806 8054 raft_consensus.cc:385] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.090857 8054 raft_consensus.cc:740] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.091038 8054 consensus_queue.cc:260] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.091554 8054 ts_tablet_manager.cc:1434] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.100s user 0.002s sys 0.000s
I20260505 20:13:42.091837 8054 tablet_bootstrap.cc:492] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.093575 8054 tablet_bootstrap.cc:654] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.095443 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 92) took 6284 ms. Trace:
I20260505 20:13:42.095518 9121 rpcz_store.cc:276] 0505 20:13:35.810784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810858 (+ 74us) service_pool.cc:224] Handling call
0505 20:13:41.505216 (+5694358us) ts_tablet_manager.cc:1151] Deleting tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
0505 20:13:41.505227 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:41.532977 (+ 27750us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:41.622769 (+ 89792us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.095419 (+472650us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92172,"tablet-delete.queue_time_us":5694234}
I20260505 20:13:42.095858 9121 tablet_replica.cc:333] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:42.096045 9121 raft_consensus.cc:2243] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.096201 9121 raft_consensus.cc:2272] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.096692 9121 ts_tablet_manager.cc:1916] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:42.098146 7869 consensus_peers.cc:597] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:42.101215 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 154) took 1880 ms. Trace:
I20260505 20:13:42.101333 7404 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_e0642656a8e54729b28f94bc1f16502b [id=497ef8628c1c4dc8b2992736e49a2e3d] alter complete (version 3)
I20260505 20:13:42.101354 7408 rpcz_store.cc:276] 0505 20:13:40.220584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.046765 (+1826181us) service_pool.cc:224] Handling call
0505 20:13:42.047622 (+ 857us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.048108 (+ 486us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.100933 (+ 52825us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.101059 (+ 126us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.101162 (+ 103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.048760 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.048856 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.048862 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:42.048865 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.048945 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.048955 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.048959 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.049028 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:42.049031 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:42.049061 (+ 30us) write_op.cc:270] Start()
0505 20:13:42.049093 (+ 32us) write_op.cc:276] Timestamp: P: 1778012022048914 usec, L: 0
0505 20:13:42.049097 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.049260 (+ 163us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.099642 (+ 50382us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.100495 (+ 853us) write_op.cc:301] APPLY: starting
0505 20:13:42.100508 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.100542 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.100570 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.100662 (+ 92us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.100695 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.100706 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:42.100761 (+ 55us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.100806 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.100824 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:42.100831 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":820,"apply.run_cpu_time_us":396,"apply.run_wall_time_us":396,"num_ops":2,"prepare.queue_time_us":68,"prepare.run_cpu_time_us":562,"prepare.run_wall_time_us":562,"replication_time_us":50529,"threads_started":1}]]}
W20260505 20:13:42.105609 7869 leader_election.cc:343] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 4628e33d204c452ab12acf76f754f2ad
W20260505 20:13:42.105818 7869 leader_election.cc:343] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: d138d27f444f45d28acdc7d72a9649f5
W20260505 20:13:42.105978 7869 leader_election.cc:343] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:42.106107 7869 leader_election.cc:343] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.109370 7869 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.109869 7410 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 153) took 1902 ms. Trace:
I20260505 20:13:42.110069 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_395edb36b813456893ae9293c5e20b87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:42.110021 7410 rpcz_store.cc:276] 0505 20:13:40.207913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.044537 (+1836624us) service_pool.cc:224] Handling call
0505 20:13:42.045312 (+ 775us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.075888 (+ 30576us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.109587 (+ 33699us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.109710 (+ 123us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.109821 (+ 111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.076589 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.076711 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.076717 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:42.076720 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.076811 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.076823 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.076827 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.076906 (+ 79us) tablet.cc:701] Row locks acquired
0505 20:13:42.076908 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.076945 (+ 37us) write_op.cc:270] Start()
0505 20:13:42.076982 (+ 37us) write_op.cc:276] Timestamp: P: 1778012022076808 usec, L: 0
0505 20:13:42.076986 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.077171 (+ 185us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.109004 (+ 31833us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.109131 (+ 127us) write_op.cc:301] APPLY: starting
0505 20:13:42.109156 (+ 25us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.109202 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.109231 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.109328 (+ 97us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.109357 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.109364 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:42.109430 (+ 66us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.109498 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.109514 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:42.109519 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.109582 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.109585 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":444,"apply.run_wall_time_us":444,"num_ops":2,"prepare.queue_time_us":65,"prepare.run_cpu_time_us":665,"prepare.run_wall_time_us":666,"replication_time_us":31990}]]}
W20260505 20:13:42.110630 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_395edb36b813456893ae9293c5e20b87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:42.110765 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_644d5f5207de4cbb865d56cd25c942a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.111222 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_644d5f5207de4cbb865d56cd25c942a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:42.124195 9271 ts_tablet_manager.cc:1929] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260505 20:13:42.128331 7412 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 907b7dccd7a94115aca36915a558b103 consensus state has no leader
I20260505 20:13:42.128556 7412 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 146) took 2018 ms. Trace:
I20260505 20:13:42.128659 7412 rpcz_store.cc:276] 0505 20:13:40.110481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.113078 (+ 2597us) service_pool.cc:224] Handling call
0505 20:13:40.115780 (+ 2702us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.121689 (+ 5909us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:40.138598 (+ 16909us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:40.138707 (+ 109us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:40.422381 (+283674us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:42.128491 (+1706110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.152577 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.152770 (+ 193us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.152780 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:40.152785 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:40.152911 (+ 126us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.152923 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.152928 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:40.152996 (+ 68us) tablet.cc:701] Row locks acquired
0505 20:13:40.152999 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:40.153035 (+ 36us) write_op.cc:270] Start()
0505 20:13:40.153070 (+ 35us) write_op.cc:276] Timestamp: P: 1778012020153024 usec, L: 0
0505 20:13:40.153074 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.153280 (+ 206us) log.cc:844] Serialized 405 byte log entry
0505 20:13:40.420322 (+267042us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.420482 (+ 160us) write_op.cc:301] APPLY: starting
0505 20:13:40.420501 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.420547 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.420588 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.420665 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.420740 (+ 75us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:40.420753 (+ 13us) write_op.cc:312] APPLY: finished
0505 20:13:40.420875 (+ 122us) log.cc:844] Serialized 23 byte log entry
0505 20:13:40.420979 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.421006 (+ 27us) write_op.cc:454] Released schema lock
0505 20:13:40.421015 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:40.421112 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.421118 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":614,"apply.run_wall_time_us":613,"num_ops":1,"prepare.queue_time_us":13333,"prepare.run_cpu_time_us":833,"prepare.run_wall_time_us":1248,"raft.queue_time_us":36,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":267204}]]}
I20260505 20:13:42.129855 7413 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet f6eaa274f7ef4cd6b9752f14b143ab6c
I20260505 20:13:42.130411 7413 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 145) took 2029 ms. Trace:
I20260505 20:13:42.130496 7413 rpcz_store.cc:276] 0505 20:13:40.100646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.102014 (+ 1368us) service_pool.cc:224] Handling call
0505 20:13:40.103659 (+ 1645us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.103997 (+ 338us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:40.104138 (+ 141us) catalog_manager.cc:2824] Locking tablets
0505 20:13:40.430014 (+325876us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:40.497771 (+ 67757us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:40.784958 (+287187us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:42.129811 (+1344853us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:42.130357 (+ 546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.472699 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.472855 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.472860 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:40.472863 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:40.473004 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.473015 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.473020 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:40.473128 (+ 108us) tablet.cc:701] Row locks acquired
0505 20:13:40.473131 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:40.473169 (+ 38us) write_op.cc:270] Start()
0505 20:13:40.473205 (+ 36us) write_op.cc:276] Timestamp: P: 1778012020473283 usec, L: 0
0505 20:13:40.473209 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.473360 (+ 151us) log.cc:844] Serialized 728 byte log entry
0505 20:13:40.496722 (+ 23362us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.496892 (+ 170us) write_op.cc:301] APPLY: starting
0505 20:13:40.496901 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.496923 (+ 22us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.496957 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.496994 (+ 37us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.497026 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:40.497034 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:40.497116 (+ 82us) log.cc:844] Serialized 29 byte log entry
0505 20:13:40.497203 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.497221 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:40.497227 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:40.497337 (+ 110us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.497341 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":387,"apply.run_wall_time_us":394,"mutex_wait_us":19,"num_ops":2,"prepare.queue_time_us":41774,"prepare.run_cpu_time_us":765,"prepare.run_wall_time_us":763,"raft.queue_time_us":100,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":3,"replication_time_us":23494}]]}
I20260505 20:13:42.131148 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet f6eaa274f7ef4cd6b9752f14b143ab6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:40 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:42.131271 7413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_bb6f81b1a5e747caa2a65e88e760cb92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.131866 7413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb6f81b1a5e747caa2a65e88e760cb92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:42.133023 7407 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e9bd035b077474294d274a8f8cb38fd consensus state has no leader
I20260505 20:13:42.133421 7407 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 149) took 2006 ms. Trace:
I20260505 20:13:42.133526 7407 rpcz_store.cc:276] 0505 20:13:40.126364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.127595 (+ 1231us) service_pool.cc:224] Handling call
0505 20:13:40.127981 (+ 386us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:40.128167 (+ 186us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:40.128330 (+ 163us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:40.128394 (+ 64us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:40.386521 (+258127us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:42.133144 (+1746623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:40.133832 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:40.133965 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:40.133972 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:40.133976 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:40.134077 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:40.134087 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:40.134104 (+ 17us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:40.134165 (+ 61us) tablet.cc:701] Row locks acquired
0505 20:13:40.134169 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:40.134201 (+ 32us) write_op.cc:270] Start()
0505 20:13:40.134231 (+ 30us) write_op.cc:276] Timestamp: P: 1778012020134183 usec, L: 0
0505 20:13:40.134237 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:40.134399 (+ 162us) log.cc:844] Serialized 405 byte log entry
0505 20:13:40.384617 (+250218us) op_driver.cc:464] REPLICATION: finished
0505 20:13:40.386013 (+ 1396us) write_op.cc:301] APPLY: starting
0505 20:13:40.386026 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:40.386059 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:40.386086 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:40.386125 (+ 39us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:40.386158 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:40.386168 (+ 10us) write_op.cc:312] APPLY: finished
0505 20:13:40.386227 (+ 59us) log.cc:844] Serialized 23 byte log entry
0505 20:13:40.386272 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:40.386286 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:40.386293 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1344,"apply.run_cpu_time_us":343,"apply.run_wall_time_us":342,"mutex_wait_us":3138,"num_ops":1,"prepare.queue_time_us":5109,"prepare.run_cpu_time_us":671,"prepare.run_wall_time_us":1518,"raft.queue_time_us":832,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":8,"replication_time_us":250357,"thread_start_us":35457,"threads_started":1}]]}
I20260505 20:13:42.129685 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_4251423f803b4acfaecce4656a6e54a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:42.137133 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_a412611fdfad4801a55a136337ab2b3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.137633 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a412611fdfad4801a55a136337ab2b3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:42.148594 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4251423f803b4acfaecce4656a6e54a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:42.153736 8054 tablet_bootstrap.cc:492] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.153723 9619 raft_consensus.cc:2804] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.153940 9619 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.154011 8054 ts_tablet_manager.cc:1403] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.004s
I20260505 20:13:42.154079 9619 raft_consensus.cc:3060] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.154824 8054 raft_consensus.cc:359] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.155120 8054 raft_consensus.cc:385] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.155206 8054 raft_consensus.cc:740] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.155411 8054 consensus_queue.cc:260] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.155925 8054 ts_tablet_manager.cc:1434] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:42.156203 8054 tablet_bootstrap.cc:492] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.158152 9619 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.158605 9617 log.cc:826] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Log is configured to *not* fsync() on all Append() calls
I20260505 20:13:42.159322 9619 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:42.159934 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 50584.4us
I20260505 20:13:42.160274 7869 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
W20260505 20:13:42.161163 7869 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:42.161454 7869 leader_election.cc:343] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.163555 9524 raft_consensus.cc:2804] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.163656 9524 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.163740 9524 raft_consensus.cc:3060] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:42.164408 8261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.33.254:38755 timed out after 0.744s (SENT)
I20260505 20:13:42.165901 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 (table default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]) successfully deleted
I20260505 20:13:42.166518 9524 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.171648 9524 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:42.173722 8054 tablet_bootstrap.cc:654] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.191129 9270 ts_tablet_manager.cc:1929] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:42.191119 8054 tablet_bootstrap.cc:492] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.191506 9270 log.cc:1199] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/38bc883c8e98495882e4d8ef68c9da80
I20260505 20:13:42.192050 9270 ts_tablet_manager.cc:1950] T 38bc883c8e98495882e4d8ef68c9da80 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:42.192267 8054 ts_tablet_manager.cc:1403] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.004s
I20260505 20:13:42.130605 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet f6eaa274f7ef4cd6b9752f14b143ab6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:40 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:42.195582 9271 log.cc:1199] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/0d5ed062508b411eb0fa5a14637830ea
W20260505 20:13:42.161923 7737 leader_election.cc:343] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b8d50ceda0ff4bb6b49920c922dfee9e
I20260505 20:13:42.196494 7737 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.196825 7737 leader_election.cc:304] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.197336 8718 raft_consensus.cc:2804] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.197314 7737 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.197409 8718 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.197469 8718 raft_consensus.cc:3060] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.197575 9610 raft_consensus.cc:2804] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.197660 9610 raft_consensus.cc:493] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.197715 9610 raft_consensus.cc:3060] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.197979 7737 leader_election.cc:304] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.198222 7737 leader_election.cc:304] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.198470 9605 consensus_queue.cc:1048] T 2faf7c64c3c340ceb8c87e416a32a7ed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.198999 9605 raft_consensus.cc:2804] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.199064 9605 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.199123 9605 raft_consensus.cc:3060] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.200182 8718 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.200446 9610 raft_consensus.cc:515] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.200734 8718 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.200870 8718 consensus_queue.cc:1048] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.200956 9610 leader_election.cc:290] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.201097 9610 consensus_queue.cc:1048] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.201400 9610 raft_consensus.cc:2764] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260505 20:13:42.201473 8718 raft_consensus.cc:2804] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.201546 8718 raft_consensus.cc:493] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.201615 8718 raft_consensus.cc:3060] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.202067 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.202152 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:42.201735 9605 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.203495 7790 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.202345 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.203871 7795 raft_consensus.cc:2468] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:42.204384 9605 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.135018 7760 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:42662 (request call id 136) took 1689 ms. Trace:
I20260505 20:13:42.205080 7760 rpcz_store.cc:276] 0505 20:13:40.445281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.449803 (+ 4522us) service_pool.cc:224] Handling call
0505 20:13:41.638068 (+1188265us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x6160001b5e54. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:41.733913 (+ 95845us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x6160001b4654. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:42.018283 (+284370us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x616000261a54. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:42.069284 (+ 51001us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x616000205c54. stack: 00007fdbe43b0086 00007fdbe43afe40 00007fdbe33693ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fdbf02d08c0 00007fdbf418beaf 00007fdbee5a3c36 00007fdbee5a3965 00007fdbeb3adf2e 00007fdbeb3ace0e 00007fdbeb3b3048 00007fdbeb3b39af 00007fdbeb3b37d8 0000000000aa4cac
0505 20:13:42.134985 (+ 65701us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324530176}
I20260505 20:13:42.206270 8718 raft_consensus.cc:515] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.207348 8718 leader_election.cc:290] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.212579 9271 ts_tablet_manager.cc:1950] T 0d5ed062508b411eb0fa5a14637830ea P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:42.217239 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 105) took 4958 ms. Trace:
I20260505 20:13:42.217422 9271 rpcz_store.cc:276] 0505 20:13:37.258730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.258847 (+ 117us) service_pool.cc:224] Handling call
0505 20:13:41.991143 (+4732296us) ts_tablet_manager.cc:1151] Deleting tablet 0d5ed062508b411eb0fa5a14637830ea
0505 20:13:41.991156 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.115983 (+124827us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.124120 (+ 8137us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.217215 (+ 93095us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43863,"tablet-delete.queue_time_us":4732136}
I20260505 20:13:42.218191 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 0d5ed062508b411eb0fa5a14637830ea (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]) successfully deleted
I20260505 20:13:42.218662 9271 tablet_replica.cc:333] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:42.218935 9271 raft_consensus.cc:2243] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.219254 9271 raft_consensus.cc:2272] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.219921 9271 ts_tablet_manager.cc:1916] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.240001 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 26b143e4943343d5b151f2804cccecfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:40 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:42.240295 9121 ts_tablet_manager.cc:1929] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.242033 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 98) took 4977 ms. Trace:
I20260505 20:13:42.242218 9270 rpcz_store.cc:276] 0505 20:13:37.264142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.265971 (+ 1829us) service_pool.cc:224] Handling call
0505 20:13:42.012469 (+4746498us) ts_tablet_manager.cc:1151] Deleting tablet 38bc883c8e98495882e4d8ef68c9da80
0505 20:13:42.012480 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.080796 (+ 68316us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.191059 (+110263us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.242002 (+ 50943us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4746369}
I20260505 20:13:42.242928 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 38bc883c8e98495882e4d8ef68c9da80 (table default.Table_ee6f5cb164d1435ba5955ac615e2249b [id=d79f9a116fdb4912b39f530d6f5d43ff]) successfully deleted
I20260505 20:13:42.243551 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 99) took 4979 ms. Trace:
I20260505 20:13:42.243700 9270 rpcz_store.cc:276] 0505 20:13:37.264257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.266142 (+ 1885us) service_pool.cc:224] Handling call
0505 20:13:42.243395 (+4977253us) ts_tablet_manager.cc:1151] Deleting tablet b6ed7c0220d147c7853c7afc1ef09607
0505 20:13:42.243405 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.243534 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4977128}
W20260505 20:13:42.244318 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet b6ed7c0220d147c7853c7afc1ef09607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6ed7c0220d147c7853c7afc1ef09607 already in progress: creating tablet
I20260505 20:13:42.244701 9270 tablet_replica.cc:333] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
W20260505 20:13:42.237528 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 225406us
I20260505 20:13:42.245399 9270 raft_consensus.cc:2243] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:42.238541 8058 tablet_bootstrap.cc:492] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.246318 8058 ts_tablet_manager.cc:1403] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.256s user 0.004s sys 0.006s
I20260505 20:13:42.247032 9619 raft_consensus.cc:493] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.247253 8058 raft_consensus.cc:359] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.247422 8058 raft_consensus.cc:385] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.247483 8058 raft_consensus.cc:740] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:42.237027 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 242679us
I20260505 20:13:42.247673 9703 consensus_queue.cc:1048] T f697fa87e7fe4da0b70bfa42a8818660 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.250797 7596 leader_election.cc:304] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.251077 9156 raft_consensus.cc:2804] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.251161 9156 raft_consensus.cc:493] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.251233 9156 raft_consensus.cc:3060] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.253948 9156 raft_consensus.cc:515] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.254570 9156 leader_election.cc:290] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:42.254806 7596 leader_election.cc:304] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.255049 9156 raft_consensus.cc:2804] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:42.255249 9156 raft_consensus.cc:697] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:42.255503 9156 consensus_queue.cc:237] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.256843 9121 log.cc:1199] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/883ec65f15604346813e5f87d55802fc
I20260505 20:13:42.256880 8054 raft_consensus.cc:359] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.239125 8053 tablet_bootstrap.cc:492] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:42.257254 8053 ts_tablet_manager.cc:1403] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.258s user 0.004s sys 0.000s
I20260505 20:13:42.257629 9349 consensus_queue.cc:1048] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.258231 8053 raft_consensus.cc:359] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.258447 8053 raft_consensus.cc:385] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.258515 8053 raft_consensus.cc:740] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:42.258934 7598 consensus_peers.cc:597] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:42.258886 8053 consensus_queue.cc:260] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.259414 8053 ts_tablet_manager.cc:1434] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:42.247678 8058 consensus_queue.cc:260] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.259645 7596 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.259724 8053 tablet_bootstrap.cc:492] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:42.260499 8058 ts_tablet_manager.cc:1434] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260505 20:13:42.260807 8058 tablet_bootstrap.cc:492] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.261967 8053 tablet_bootstrap.cc:654] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.262966 9703 raft_consensus.cc:2804] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.263091 9703 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.263226 9703 raft_consensus.cc:3060] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.264895 9304 consensus_queue.cc:1048] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.266526 7596 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.265985 9619 raft_consensus.cc:515] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:42.267124 7598 leader_election.cc:343] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b8d50ceda0ff4bb6b49920c922dfee9e
W20260505 20:13:42.270234 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 72046us
I20260505 20:13:42.270560 7737 leader_election.cc:304] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
W20260505 20:13:42.270807 7737 raft_consensus.cc:2686] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:42.271471 7737 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.271864 8718 raft_consensus.cc:2804] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:42.271955 8718 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:42.272037 8718 raft_consensus.cc:3060] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.274843 8718 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.274827 9703 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.275547 9703 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:42.275923 8718 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.276043 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet f6eaa274f7ef4cd6b9752f14b143ab6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:40 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:42.276265 8054 raft_consensus.cc:385] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.276374 8054 raft_consensus.cc:740] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.276636 8054 consensus_queue.cc:260] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.276786 7596 leader_election.cc:304] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:42.277076 9304 raft_consensus.cc:2804] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:42.277168 9304 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.277204 8054 ts_tablet_manager.cc:1434] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.084s user 0.000s sys 0.001s
I20260505 20:13:42.277249 9304 raft_consensus.cc:3060] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.279007 8054 tablet_bootstrap.cc:492] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.279467 8058 tablet_bootstrap.cc:654] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.280264 9304 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.280398 9619 leader_election.cc:290] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.280517 9630 raft_consensus.cc:2804] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:42.280584 9630 raft_consensus.cc:493] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.280648 9630 raft_consensus.cc:3060] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.281455 9590 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.281575 9590 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.281765 8054 tablet_bootstrap.cc:654] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.282189 9590 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.283401 9630 raft_consensus.cc:515] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.283974 9630 leader_election.cc:290] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.286217 9349 consensus_queue.cc:1048] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.288803 9621 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.288952 9621 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.289512 9621 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:42.290045 7736 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.290326 7736 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:42.290704 9138 raft_consensus.cc:2804] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:42.290776 9138 raft_consensus.cc:493] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.290874 9138 raft_consensus.cc:3060] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.292541 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.292718 7934 raft_consensus.cc:3060] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.293463 9138 raft_consensus.cc:515] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.295256 9138 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.295327 7934 raft_consensus.cc:2468] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:42.296226 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.296464 7919 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
W20260505 20:13:42.298380 7869 leader_election.cc:343] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.298954 7869 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.299312 9707 raft_consensus.cc:2804] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:42.299386 9707 raft_consensus.cc:493] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:42.299459 9707 raft_consensus.cc:3060] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.301862 9304 leader_election.cc:290] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.306931 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd289ce979940ae96554d5756d140d7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.307644 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c278b516135b47ee96ed61b1ae595f9a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:42.310421 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 221240us
I20260505 20:13:42.312287 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.312485 7660 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:42.312824 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.313522 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c5c661e8aa4962bb9922b9ead7d784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.313979 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.314438 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d138d27f444f45d28acdc7d72a9649f5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.314610 7660 raft_consensus.cc:2468] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:42.315028 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.316545 8058 tablet_bootstrap.cc:492] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.316685 8058 ts_tablet_manager.cc:1403] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260505 20:13:42.317473 8058 raft_consensus.cc:359] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.317633 8058 raft_consensus.cc:385] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.317682 8058 raft_consensus.cc:740] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.317935 8058 consensus_queue.cc:260] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.318439 8058 ts_tablet_manager.cc:1434] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:42.318711 8058 tablet_bootstrap.cc:492] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.320169 9121 ts_tablet_manager.cc:1950] T 883ec65f15604346813e5f87d55802fc P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:42.320677 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 91) took 6509 ms. Trace:
I20260505 20:13:42.321018 8053 tablet_bootstrap.cc:492] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:42.321192 8053 ts_tablet_manager.cc:1403] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.001s
I20260505 20:13:42.321180 9121 rpcz_store.cc:276] 0505 20:13:35.810691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.810941 (+ 250us) service_pool.cc:224] Handling call
0505 20:13:42.095807 (+6284866us) ts_tablet_manager.cc:1151] Deleting tablet 883ec65f15604346813e5f87d55802fc
0505 20:13:42.095820 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.121705 (+ 25885us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.184948 (+ 63243us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.320607 (+135659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6284701}
I20260505 20:13:42.322866 9121 tablet_replica.cc:333] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:42.323575 9121 raft_consensus.cc:2243] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.325863 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.326617 8054 tablet_bootstrap.cc:492] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.326907 8054 ts_tablet_manager.cc:1403] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.006s
I20260505 20:13:42.326907 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.328071 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1218bd76239540be9a93ca455ba3eb47" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.328264 7657 raft_consensus.cc:2393] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:42.329049 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.329272 7934 raft_consensus.cc:2393] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:42.331952 9707 raft_consensus.cc:515] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.334170 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.334343 7934 raft_consensus.cc:3060] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.334472 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.334656 7657 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:42.336181 8058 tablet_bootstrap.cc:654] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.336776 7404 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_673d30b70e044e20b54300c4b5670ecb [id=43f99e8f61944d3f8527224eb22c5edd] alter complete (version 2)
I20260505 20:13:42.337062 7934 raft_consensus.cc:2468] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:42.337179 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.337664 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.338740 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.338933 7660 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:42.339437 7657 raft_consensus.cc:3060] T 71bfd96314244e6cbbb4d5b48841e06f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.341813 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.342025 7935 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:42.341362 9707 leader_election.cc:290] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.342947 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.343461 7935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.343619 7935 raft_consensus.cc:3060] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.343941 9270 pending_rounds.cc:70] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:42.344009 9270 pending_rounds.cc:77] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737231724908544 op_type: NO_OP noop_request { }
I20260505 20:13:42.344110 9270 raft_consensus.cc:2889] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:42.344203 9270 raft_consensus.cc:2272] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.344868 9270 ts_tablet_manager.cc:1916] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.346439 7935 raft_consensus.cc:2468] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:42.346958 9121 raft_consensus.cc:2272] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.347206 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.347622 9121 ts_tablet_manager.cc:1916] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.347855 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 883ec65f15604346813e5f87d55802fc (table default.Table_17eda505104c417ba34f71dbb19633f5 [id=373b40a3cc5a425f8e0609881bd0029f]) successfully deleted
I20260505 20:13:42.351138 7737 leader_election.cc:304] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:42.354008 8054 raft_consensus.cc:359] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.354308 8054 raft_consensus.cc:385] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.354408 8054 raft_consensus.cc:740] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.354628 8054 consensus_queue.cc:260] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.355237 8054 ts_tablet_manager.cc:1434] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.028s user 0.000s sys 0.001s
I20260505 20:13:42.355559 8054 tablet_bootstrap.cc:492] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.357577 8054 tablet_bootstrap.cc:654] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.366294 8053 raft_consensus.cc:359] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.371421 8053 raft_consensus.cc:385] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:42.373113 7870 leader_election.cc:343] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.373301 8053 raft_consensus.cc:740] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.372305 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:42.373874 7795 raft_consensus.cc:2393] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.367230 9715 raft_consensus.cc:2804] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:42.374310 9715 raft_consensus.cc:697] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:42.374610 9715 consensus_queue.cc:237] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.378955 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.379225 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.379410 7662 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:42.379382 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.380976 8053 consensus_queue.cc:260] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.382244 8053 ts_tablet_manager.cc:1434] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.061s user 0.002s sys 0.001s
I20260505 20:13:42.382606 8053 tablet_bootstrap.cc:492] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:42.383564 8058 tablet_bootstrap.cc:492] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.383705 8058 ts_tablet_manager.cc:1403] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.002s
I20260505 20:13:42.384698 8058 raft_consensus.cc:359] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.384925 8058 raft_consensus.cc:385] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.384986 8058 raft_consensus.cc:740] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.385200 8058 consensus_queue.cc:260] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.386530 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.388937 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.390046 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.390223 7661 raft_consensus.cc:2468] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:42.390676 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.390895 7661 raft_consensus.cc:2393] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 2: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:42.393505 7736 leader_election.cc:304] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.394093 7736 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:42.394367 7736 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:42.394546 9156 raft_consensus.cc:493] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.394678 9156 raft_consensus.cc:515] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:42.394919 7736 leader_election.cc:343] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.395376 9156 leader_election.cc:290] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:42.395531 7736 consensus_peers.cc:597] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:42.395931 9610 raft_consensus.cc:2749] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.396459 9610 consensus_queue.cc:1048] T 71bfd96314244e6cbbb4d5b48841e06f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.396857 9610 consensus_queue.cc:1048] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.404287 8058 ts_tablet_manager.cc:1434] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260505 20:13:42.404599 8058 tablet_bootstrap.cc:492] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.411391 7598 leader_election.cc:304] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.411998 9703 raft_consensus.cc:2804] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:42.412099 9703 raft_consensus.cc:697] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:42.412390 9703 consensus_queue.cc:237] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.420881 8058 tablet_bootstrap.cc:654] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:42.419708 7598 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd01314146a34257b444a622829b2fe4
W20260505 20:13:42.421950 7598 leader_election.cc:343] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 949fecb197084426b5a6adb959f5c886
W20260505 20:13:42.423646 7598 leader_election.cc:343] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b8d50ceda0ff4bb6b49920c922dfee9e
W20260505 20:13:42.423882 7598 consensus_peers.cc:597] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:42.427299 7598 consensus_peers.cc:597] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 883ec65f15604346813e5f87d55802fc. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:42.432528 8058 tablet_bootstrap.cc:492] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.432688 8058 ts_tablet_manager.cc:1403] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20260505 20:13:42.434880 7710 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:42.438611 8058 raft_consensus.cc:359] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.438788 8058 raft_consensus.cc:385] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.438848 8058 raft_consensus.cc:740] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.439033 8058 consensus_queue.cc:260] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
W20260505 20:13:42.414286 9717 log.cc:927] Time spent T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260505 20:13:42.443454 7870 leader_election.cc:304] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.419693 9723 log.cc:927] Time spent T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260505 20:13:42.444610 9707 raft_consensus.cc:2749] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.433168 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:42.446547 8058 ts_tablet_manager.cc:1434] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260505 20:13:42.446859 8058 tablet_bootstrap.cc:492] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.448515 8058 tablet_bootstrap.cc:654] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.453862 7413 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 158) took 2197 ms. Trace:
I20260505 20:13:42.454025 7413 rpcz_store.cc:276] 0505 20:13:40.256625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.131067 (+1874442us) service_pool.cc:224] Handling call
0505 20:13:42.131957 (+ 890us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.132443 (+ 486us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.405831 (+273388us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.453656 (+ 47825us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.453785 (+ 129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.150378 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.150489 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.150495 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:42.150497 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.150569 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.150578 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.150585 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.150642 (+ 57us) tablet.cc:701] Row locks acquired
0505 20:13:42.150646 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:42.150676 (+ 30us) write_op.cc:270] Start()
0505 20:13:42.150701 (+ 25us) write_op.cc:276] Timestamp: P: 1778012022150571 usec, L: 0
0505 20:13:42.150705 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.150852 (+ 147us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.400531 (+249679us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.401510 (+ 979us) write_op.cc:301] APPLY: starting
0505 20:13:42.401524 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.401564 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.401591 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.401725 (+ 134us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.401793 (+ 68us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.401804 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:42.401877 (+ 73us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.401917 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.401928 (+ 11us) write_op.cc:454] Released schema lock
0505 20:13:42.401933 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":905,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":17503,"prepare.run_cpu_time_us":526,"prepare.run_wall_time_us":525,"replication_time_us":249797}]]}
I20260505 20:13:42.456055 9271 ts_tablet_manager.cc:1929] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:42.456260 9271 log.cc:1199] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1218bd76239540be9a93ca455ba3eb47
I20260505 20:13:42.456638 9271 ts_tablet_manager.cc:1950] T 1218bd76239540be9a93ca455ba3eb47 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:42.457188 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 99) took 5199 ms. Trace:
I20260505 20:13:42.457213 7412 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 157) took 2209 ms. Trace:
I20260505 20:13:42.457368 9271 rpcz_store.cc:276] 0505 20:13:37.258194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.259032 (+ 838us) service_pool.cc:224] Handling call
0505 20:13:42.218604 (+4959572us) ts_tablet_manager.cc:1151] Deleting tablet 1218bd76239540be9a93ca455ba3eb47
0505 20:13:42.218616 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.268772 (+ 50156us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.455980 (+187208us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.457165 (+ 1185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4959399}
I20260505 20:13:42.457320 7412 rpcz_store.cc:276] 0505 20:13:40.244076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.129430 (+1885354us) service_pool.cc:224] Handling call
0505 20:13:42.148761 (+ 19331us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.149237 (+ 476us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.425961 (+276724us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.453632 (+ 27671us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.453785 (+ 153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.150937 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.151042 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.151047 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:42.151049 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.151115 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.151130 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.151135 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.151191 (+ 56us) tablet.cc:701] Row locks acquired
0505 20:13:42.151193 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.151222 (+ 29us) write_op.cc:270] Start()
0505 20:13:42.151244 (+ 22us) write_op.cc:276] Timestamp: P: 1778012022151118 usec, L: 0
0505 20:13:42.151247 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.151367 (+ 120us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.425047 (+273680us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.425372 (+ 325us) write_op.cc:301] APPLY: starting
0505 20:13:42.425390 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.425438 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.425482 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.425608 (+ 126us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.425643 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.425651 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:42.425736 (+ 85us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.425850 (+ 114us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.425870 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:42.425878 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.425957 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.425961 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":217,"apply.run_cpu_time_us":577,"apply.run_wall_time_us":577,"num_ops":2,"prepare.queue_time_us":1300,"prepare.run_cpu_time_us":474,"prepare.run_wall_time_us":472,"replication_time_us":273732}]]}
I20260505 20:13:42.458022 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1218bd76239540be9a93ca455ba3eb47 (table default.Table_cfbc6470d8d34b93a3d1434dfa9df8cf [id=813ff9cab8554a79a0b9b5a01f63127c]) successfully deleted
I20260505 20:13:42.458218 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_ca23c20fcbcc495cbd0e7c3c21341d3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.458843 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca23c20fcbcc495cbd0e7c3c21341d3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:42.459200 9703 raft_consensus.cc:493] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.459363 9703 raft_consensus.cc:515] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.460060 9703 leader_election.cc:290] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:42.460235 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 159) took 2153 ms. Trace:
I20260505 20:13:42.460358 7407 rpcz_store.cc:276] 0505 20:13:40.306901 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.134194 (+1827293us) service_pool.cc:224] Handling call
0505 20:13:42.137735 (+ 3541us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.149103 (+ 11368us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.426468 (+277365us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.460085 (+ 33617us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.460179 (+ 94us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.152219 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.152308 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.152313 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:42.152316 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.152381 (+ 65us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.152391 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.152395 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.152469 (+ 74us) tablet.cc:701] Row locks acquired
0505 20:13:42.152471 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.152496 (+ 25us) write_op.cc:270] Start()
0505 20:13:42.152519 (+ 23us) write_op.cc:276] Timestamp: P: 1778012022152392 usec, L: 0
0505 20:13:42.152523 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.152676 (+ 153us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.425241 (+272565us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.426027 (+ 786us) write_op.cc:301] APPLY: starting
0505 20:13:42.426038 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.426074 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.426105 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.426195 (+ 90us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.426223 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.426230 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:42.426289 (+ 59us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.426331 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.426343 (+ 12us) write_op.cc:454] Released schema lock
0505 20:13:42.426348 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":23936,"child_traces":[["op",{"apply.queue_time_us":752,"apply.run_cpu_time_us":376,"apply.run_wall_time_us":375,"mutex_wait_us":2520,"num_ops":2,"prepare.queue_time_us":2577,"prepare.run_cpu_time_us":516,"prepare.run_wall_time_us":515,"replication_time_us":272657}]]}
I20260505 20:13:42.461824 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_2a37262735b9408bb4498e2ad3758f5e" } modify_external_catalogs: true
I20260505 20:13:42.462077 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_2a37262735b9408bb4498e2ad3758f5e" } modify_external_catalogs: true
I20260505 20:13:42.463387 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 155) took 2242 ms. Trace:
I20260505 20:13:42.463539 7408 rpcz_store.cc:276] 0505 20:13:40.220738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.102040 (+1881302us) service_pool.cc:224] Handling call
0505 20:13:42.110002 (+ 7962us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9741b13 00007f70d01d57c6 00007f70d01d54f5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:42.110716 (+ 714us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.111133 (+ 417us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.337735 (+226602us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.453604 (+115869us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.463342 (+ 9738us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.112046 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.112165 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.112172 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:42.112176 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:42.112258 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.112266 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.112270 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.112333 (+ 63us) tablet.cc:701] Row locks acquired
0505 20:13:42.112335 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.112365 (+ 30us) write_op.cc:270] Start()
0505 20:13:42.112392 (+ 27us) write_op.cc:276] Timestamp: P: 1778012022112244 usec, L: 0
0505 20:13:42.112395 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.112540 (+ 145us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.334781 (+222241us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.335536 (+ 755us) write_op.cc:301] APPLY: starting
0505 20:13:42.335547 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.335580 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.335604 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.335712 (+ 108us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.335739 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.335746 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:42.335802 (+ 56us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.335856 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.335870 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:42.335875 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.335952 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.335956 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":17622784,"child_traces":[["op",{"apply.queue_time_us":716,"apply.run_cpu_time_us":408,"apply.run_wall_time_us":406,"num_ops":2,"prepare.queue_time_us":432,"prepare.run_cpu_time_us":538,"prepare.run_wall_time_us":536,"replication_time_us":222357}]]}
I20260505 20:13:42.465087 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_7600175864414daab21997f8f179690e" } modify_external_catalogs: true
I20260505 20:13:42.465301 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_7600175864414daab21997f8f179690e" } modify_external_catalogs: true
I20260505 20:13:42.465929 7410 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 156) took 2240 ms. Trace:
I20260505 20:13:42.466078 7410 rpcz_store.cc:276] 0505 20:13:40.225440 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.110563 (+1885123us) service_pool.cc:224] Handling call
0505 20:13:42.111317 (+ 754us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.111725 (+ 408us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.343010 (+231285us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.465812 (+122802us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.465892 (+ 80us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.112622 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.112728 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.112735 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:42.112738 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.112824 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.112834 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.112841 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.112916 (+ 75us) tablet.cc:701] Row locks acquired
0505 20:13:42.112921 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:42.112951 (+ 30us) write_op.cc:270] Start()
0505 20:13:42.112980 (+ 29us) write_op.cc:276] Timestamp: P: 1778012022112829 usec, L: 0
0505 20:13:42.112985 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.113154 (+ 169us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.334858 (+221704us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.336010 (+ 1152us) write_op.cc:301] APPLY: starting
0505 20:13:42.336020 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.336047 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.336078 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.336155 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.336181 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.336187 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:42.336235 (+ 48us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.336271 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.336284 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:42.336289 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1121,"apply.run_cpu_time_us":329,"apply.run_wall_time_us":328,"num_ops":2,"prepare.queue_time_us":488,"prepare.run_cpu_time_us":583,"prepare.run_wall_time_us":582,"replication_time_us":221854,"thread_start_us":64948,"threads_started":1}]]}
I20260505 20:13:42.467146 7410 master_service.cc:954] ReplaceTablet: received request to replace tablet bda4fd8b0f214da7a1e8b944e1820c0c from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:42.469022 9270 ts_tablet_manager.cc:1929] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260505 20:13:42.478428 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 82547.6us
W20260505 20:13:42.479385 7736 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.479650 7736 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.481778 7736 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.482143 9740 raft_consensus.cc:2749] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260505 20:13:42.482695 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 72269.7us
W20260505 20:13:42.486042 7736 leader_election.cc:343] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:42.489606 7736 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:42.490106 9271 tablet_replica.cc:333] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:42.490080 7736 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.490501 9138 raft_consensus.cc:2804] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:42.490579 9138 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.490646 9138 raft_consensus.cc:3060] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.493541 9138 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.494583 9138 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.495733 9271 raft_consensus.cc:2243] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:42.496173 9271 raft_consensus.cc:2272] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.496932 9271 ts_tablet_manager.cc:1916] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.500514 8053 tablet_bootstrap.cc:654] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.516297 9138 raft_consensus.cc:493] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.517021 9138 raft_consensus.cc:515] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.521504 9138 leader_election.cc:290] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.528806 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:42.529057 7789 raft_consensus.cc:2393] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.529991 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.530176 7789 raft_consensus.cc:2393] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 2: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.530747 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949fecb197084426b5a6adb959f5c886" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:42.530872 7789 raft_consensus.cc:3060] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.533510 7789 raft_consensus.cc:2468] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 2.
I20260505 20:13:42.546429 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d50ceda0ff4bb6b49920c922dfee9e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:42.546665 7793 raft_consensus.cc:2393] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 2: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.555984 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436489e0e72945f689ebd653804e7723" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.564670 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.592538 7922 raft_consensus.cc:2393] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.595479 9270 log.cc:1199] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/0ec5c094e2bb4a4481825df17becde52
W20260505 20:13:42.475944 7598 consensus_peers.cc:597] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b596f03adbea413b813c9037d4243fae. This is attempt 6: this message will repeat every 5th retry.
W20260505 20:13:42.595889 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 120042us
I20260505 20:13:42.596176 9270 ts_tablet_manager.cc:1950] T 0ec5c094e2bb4a4481825df17becde52 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:42.597802 7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.597072 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 102) took 5332 ms. Trace:
I20260505 20:13:42.598762 9270 rpcz_store.cc:276] 0505 20:13:37.264531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.266773 (+ 2242us) service_pool.cc:224] Handling call
0505 20:13:42.244648 (+4977875us) ts_tablet_manager.cc:1151] Deleting tablet 0ec5c094e2bb4a4481825df17becde52
0505 20:13:42.244659 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.465802 (+221143us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.468951 (+ 3149us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.597051 (+128100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1,"tablet-delete.queue_time_us":4977699}
I20260505 20:13:42.599350 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 0ec5c094e2bb4a4481825df17becde52 (table default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]) successfully deleted
I20260505 20:13:42.599725 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd01314146a34257b444a622829b2fe4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.599901 7662 raft_consensus.cc:3060] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:42.521214 8058 tablet_bootstrap.cc:492] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.600111 8058 ts_tablet_manager.cc:1403] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.153s user 0.016s sys 0.036s
I20260505 20:13:42.600836 8058 raft_consensus.cc:359] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.600977 8058 raft_consensus.cc:385] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.601020 8058 raft_consensus.cc:740] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.601189 8058 consensus_queue.cc:260] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.601606 8058 ts_tablet_manager.cc:1434] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260505 20:13:42.583657 7596 leader_election.cc:343] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 1218bd76239540be9a93ca455ba3eb47
I20260505 20:13:42.602289 7596 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:42.602591 7662 raft_consensus.cc:2468] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 2.
I20260505 20:13:42.603597 7596 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:42.603951 7596 leader_election.cc:304] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:42.604410 9495 raft_consensus.cc:2749] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.604463 7596 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:42.604671 9590 raft_consensus.cc:2749] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:42.604806 9590 raft_consensus.cc:2804] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:42.605127 9398 consensus_queue.cc:1048] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.605319 9349 raft_consensus.cc:2749] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260505 20:13:42.605872 8058 tablet_bootstrap.cc:492] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.609671 8058 tablet_bootstrap.cc:654] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:42.611728 7870 leader_election.cc:343] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 4628e33d204c452ab12acf76f754f2ad
W20260505 20:13:42.614013 7736 leader_election.cc:343] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.616055 7736 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.616358 9471 raft_consensus.cc:2804] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:42.616503 9471 raft_consensus.cc:697] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:42.616771 9471 consensus_queue.cc:237] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.593990 9707 raft_consensus.cc:493] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.634315 8058 tablet_bootstrap.cc:492] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.635141 8058 ts_tablet_manager.cc:1403] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.000s
I20260505 20:13:42.635998 8058 raft_consensus.cc:359] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.636220 8058 raft_consensus.cc:385] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.636315 8058 raft_consensus.cc:740] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.636579 8058 consensus_queue.cc:260] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.637215 8058 ts_tablet_manager.cc:1434] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:42.637530 8058 tablet_bootstrap.cc:492] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.639315 8058 tablet_bootstrap.cc:654] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.642803 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c582e419f746b28530c0971fede09f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:42.648371 7400 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01ed3ee8c7a048979f5c620bc21f5b96 consensus state has no leader
I20260505 20:13:42.653869 7870 leader_election.cc:304] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.654533 8058 tablet_bootstrap.cc:492] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.654706 8058 ts_tablet_manager.cc:1403] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260505 20:13:42.654907 9707 raft_consensus.cc:515] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.655673 8058 raft_consensus.cc:359] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.655884 8058 raft_consensus.cc:385] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.655975 8058 raft_consensus.cc:740] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.656229 8058 consensus_queue.cc:260] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.656533 9121 ts_tablet_manager.cc:1929] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.656767 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.657021 8058 ts_tablet_manager.cc:1434] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:42.657413 9524 raft_consensus.cc:2749] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:42.661810 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 171419us
I20260505 20:13:42.662282 9121 log.cc:1199] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e083f131eca54d98852e5685e08ef46b
I20260505 20:13:42.662408 9707 leader_election.cc:290] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.662598 7934 raft_consensus.cc:2393] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 2: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:42.664863 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:42.665093 7931 raft_consensus.cc:2468] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:42.665827 9566 raft_consensus.cc:493] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.666000 9566 raft_consensus.cc:515] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:42.665838 7869 leader_election.cc:343] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:42.667989 7870 leader_election.cc:343] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.668848 9566 leader_election.cc:290] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:42.669132 7870 leader_election.cc:304] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.669526 7870 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.669895 9566 raft_consensus.cc:2749] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.670135 7870 leader_election.cc:304] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:42.670480 7870 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.670585 7870 leader_election.cc:304] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.671031 7870 leader_election.cc:343] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.671137 7870 leader_election.cc:304] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.671459 7870 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:42.671860 9619 raft_consensus.cc:2804] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.671959 9619 raft_consensus.cc:493] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.672050 9619 raft_consensus.cc:3060] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.672544 9429 raft_consensus.cc:2749] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.672720 9429 raft_consensus.cc:2749] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.674742 9619 raft_consensus.cc:515] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.675338 9619 leader_election.cc:290] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:42.677424 7870 leader_election.cc:343] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.677582 7870 leader_election.cc:304] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.677781 9121 ts_tablet_manager.cc:1950] T e083f131eca54d98852e5685e08ef46b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:42.678718 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 93) took 6867 ms. Trace:
I20260505 20:13:42.678866 9121 rpcz_store.cc:276] 0505 20:13:35.810869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811006 (+ 137us) service_pool.cc:224] Handling call
0505 20:13:42.322662 (+6511656us) ts_tablet_manager.cc:1151] Deleting tablet e083f131eca54d98852e5685e08ef46b
0505 20:13:42.322714 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.364696 (+ 41982us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.620029 (+255333us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.678667 (+ 58638us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22944,"tablet-delete.queue_time_us":6511496}
I20260505 20:13:42.679366 9121 tablet_replica.cc:333] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:42.679631 9121 raft_consensus.cc:2243] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.679841 9121 raft_consensus.cc:2272] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.680539 9121 ts_tablet_manager.cc:1916] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.681813 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e083f131eca54d98852e5685e08ef46b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:42.682155 7870 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:42.682628 7870 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.682832 9429 raft_consensus.cc:2749] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.683038 9429 raft_consensus.cc:2749] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.683214 7870 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.683485 9429 raft_consensus.cc:2749] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260505 20:13:42.684279 7870 leader_election.cc:343] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.684465 7870 leader_election.cc:304] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.684722 9429 raft_consensus.cc:2749] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:42.684837 9735 log.cc:927] Time spent T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
W20260505 20:13:42.685153 7870 leader_election.cc:343] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:42.696725 9566 raft_consensus.cc:493] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.696914 9566 raft_consensus.cc:515] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.697284 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d138d27f444f45d28acdc7d72a9649f5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.697463 7659 raft_consensus.cc:3060] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.697575 9566 leader_election.cc:290] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.697803 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.697861 7656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.698788 9566 raft_consensus.cc:493] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.698935 9566 raft_consensus.cc:515] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.699471 9566 leader_election.cc:290] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.700210 7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed62f9b81e48459c6d55664ddf1cc6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.700306 7659 raft_consensus.cc:2468] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:42.700446 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:42.701586 7870 leader_election.cc:343] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:42.701946 7870 leader_election.cc:343] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.703873 7596 leader_election.cc:304] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:42.704265 9703 raft_consensus.cc:3060] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:42.704880 7870 leader_election.cc:343] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.705056 7870 leader_election.cc:304] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.707274 9703 raft_consensus.cc:2749] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.708825 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet bda4fd8b0f214da7a1e8b944e1820c0c
I20260505 20:13:42.657368 8058 tablet_bootstrap.cc:492] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.709386 7596 leader_election.cc:304] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:42.709786 7410 catalog_manager.cc:6741] ReplaceTablet: tablet bda4fd8b0f214da7a1e8b944e1820c0c deleted and replaced by tablet 0de6ef4b456148ed8cc6e8237801ed11
I20260505 20:13:42.709966 7410 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 163) took 2160 ms. Trace:
I20260505 20:13:42.710029 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet bda4fd8b0f214da7a1e8b944e1820c0c with delete_type TABLET_DATA_DELETED (replaced by tablet 0de6ef4b456148ed8cc6e8237801ed11) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:42.710026 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet bda4fd8b0f214da7a1e8b944e1820c0c with delete_type TABLET_DATA_DELETED (replaced by tablet 0de6ef4b456148ed8cc6e8237801ed11) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:42.710079 7410 rpcz_store.cc:276] 0505 20:13:40.549429 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.467083 (+1917654us) service_pool.cc:224] Handling call
0505 20:13:42.709906 (+242823us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.502613 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.502821 (+ 208us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.502828 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:42.502832 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:42.503016 (+ 184us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.503026 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.503033 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.504333 (+ 1300us) tablet.cc:701] Row locks acquired
0505 20:13:42.504336 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:42.505235 (+ 899us) write_op.cc:270] Start()
0505 20:13:42.505869 (+ 634us) write_op.cc:276] Timestamp: P: 1778012022504919 usec, L: 0
0505 20:13:42.505877 (+ 8us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.511078 (+ 5201us) log.cc:844] Serialized 659 byte log entry
0505 20:13:42.540925 (+ 29847us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.542064 (+ 1139us) write_op.cc:301] APPLY: starting
0505 20:13:42.542073 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.542100 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.542126 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.542199 (+ 73us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.542242 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:42.542249 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:42.542301 (+ 52us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.542340 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.542352 (+ 12us) write_op.cc:454] Released schema lock
0505 20:13:42.542359 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.542422 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.542425 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1112,"apply.run_cpu_time_us":348,"apply.run_wall_time_us":346,"num_ops":2,"prepare.queue_time_us":34341,"prepare.run_cpu_time_us":1366,"prepare.run_wall_time_us":9523,"replication_time_us":35032}]]}
I20260505 20:13:42.710618 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet bda4fd8b0f214da7a1e8b944e1820c0c with delete_type TABLET_DATA_DELETED (replaced by tablet 0de6ef4b456148ed8cc6e8237801ed11) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:42.711217 9703 raft_consensus.cc:2749] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.713972 7408 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 8d9ec7f6b82c48bd9c27382c5b9a5f6e
I20260505 20:13:42.713953 9566 raft_consensus.cc:2804] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:42.714125 9566 raft_consensus.cc:697] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:42.714123 7408 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 162) took 2385 ms. Trace:
I20260505 20:13:42.714409 9566 consensus_queue.cc:237] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.714208 7408 rpcz_store.cc:276] 0505 20:13:40.328187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.464940 (+2136753us) service_pool.cc:224] Handling call
0505 20:13:42.465424 (+ 484us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:42.465573 (+ 149us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:42.465632 (+ 59us) catalog_manager.cc:2824] Locking tablets
0505 20:13:42.473913 (+ 8281us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:42.564579 (+ 90666us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:42.713862 (+149283us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:42.713918 (+ 56us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:42.714073 (+ 155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.513880 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.519938 (+ 6058us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.520225 (+ 287us) write_op.cc:435] Acquired schema lock
0505 20:13:42.520231 (+ 6us) tablet.cc:662] Decoding operations
0505 20:13:42.523498 (+ 3267us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.523705 (+ 207us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.523713 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.525166 (+ 1453us) tablet.cc:701] Row locks acquired
0505 20:13:42.525172 (+ 6us) write_op.cc:260] PREPARE: finished
0505 20:13:42.525815 (+ 643us) write_op.cc:270] Start()
0505 20:13:42.544391 (+ 18576us) write_op.cc:276] Timestamp: P: 1778012022525644 usec, L: 0
0505 20:13:42.544404 (+ 13us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.556363 (+ 11959us) log.cc:844] Serialized 533 byte log entry
0505 20:13:42.563496 (+ 7133us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.563679 (+ 183us) write_op.cc:301] APPLY: starting
0505 20:13:42.563701 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.563770 (+ 69us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.563838 (+ 68us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.563953 (+ 115us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.563993 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:42.564000 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:42.564084 (+ 84us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.564331 (+ 247us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.564353 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:42.564359 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.564435 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.564439 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":91,"apply.run_cpu_time_us":593,"apply.run_wall_time_us":765,"num_ops":2,"prepare.queue_time_us":38633,"prepare.run_cpu_time_us":2623,"prepare.run_wall_time_us":47791,"raft.queue_time_us":718,"raft.run_cpu_time_us":654,"raft.run_wall_time_us":1227,"replication_time_us":19057}]]}
I20260505 20:13:42.714816 9749 tablet.cc:1724] T 3aad2a9f37ac4cbfa127ecceb132c8bb P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:42.715659 7870 leader_election.cc:343] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.715739 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_095ae1e51561487880dc7e039bc823b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:42.716672 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_095ae1e51561487880dc7e039bc823b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:42.718096 7412 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 160) took 2399 ms. Trace:
I20260505 20:13:42.718205 7412 rpcz_store.cc:276] 0505 20:13:40.318389 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.457981 (+2139592us) service_pool.cc:224] Handling call
0505 20:13:42.458941 (+ 960us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.459430 (+ 489us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.542913 (+ 83483us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.717928 (+175015us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.718029 (+ 101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.489080 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.499222 (+ 10142us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.499229 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:42.499232 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.499435 (+ 203us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.499451 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.499456 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.499679 (+ 223us) tablet.cc:701] Row locks acquired
0505 20:13:42.499682 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:42.499846 (+ 164us) write_op.cc:270] Start()
0505 20:13:42.499912 (+ 66us) write_op.cc:276] Timestamp: P: 1778012022499850 usec, L: 0
0505 20:13:42.499916 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.500240 (+ 324us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.540812 (+ 40572us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.541011 (+ 199us) write_op.cc:301] APPLY: starting
0505 20:13:42.541027 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.541074 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.541114 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.541235 (+ 121us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.541273 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.541279 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:42.541356 (+ 77us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.541428 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.541445 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:42.541451 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.541530 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.541537 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":147,"apply.run_cpu_time_us":506,"apply.run_wall_time_us":505,"num_ops":2,"prepare.queue_time_us":29007,"prepare.run_cpu_time_us":1173,"prepare.run_wall_time_us":11647,"replication_time_us":40861}]]}
I20260505 20:13:42.719770 7412 master_service.cc:954] ReplaceTablet: received request to replace tablet 2c12a95b0ed445c7b598db136f6ac05c from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:42.720216 7412 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 165) took 1892 ms. Trace:
I20260505 20:13:42.720351 7412 rpcz_store.cc:276] 0505 20:13:40.827972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.719497 (+1891525us) service_pool.cc:224] Handling call
0505 20:13:42.720181 (+ 684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:42.720956 7412 master_service.cc:954] ReplaceTablet: received request to replace tablet 6d805583f5c64ea7a9fe2f658079b5c5 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:42.721989 8058 tablet_bootstrap.cc:654] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.728155 9121 ts_tablet_manager.cc:1929] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.729254 7661 raft_consensus.cc:3060] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.733649 9138 consensus_queue.cc:1048] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.743590 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 164) took 2066 ms. Trace:
I20260505 20:13:42.744451 7408 rpcz_store.cc:276] 0505 20:13:40.676959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.715510 (+2038551us) service_pool.cc:224] Handling call
0505 20:13:42.716829 (+ 1319us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:42.717321 (+ 492us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:42.743201 (+ 25880us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:42.743367 (+ 166us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:42.743498 (+ 131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.729842 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.729962 (+ 120us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.729969 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:42.729971 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.730062 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.730076 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.730081 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.730158 (+ 77us) tablet.cc:701] Row locks acquired
0505 20:13:42.730160 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.730194 (+ 34us) write_op.cc:270] Start()
0505 20:13:42.730229 (+ 35us) write_op.cc:276] Timestamp: P: 1778012022730243 usec, L: 0
0505 20:13:42.730233 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.730416 (+ 183us) log.cc:844] Serialized 433 byte log entry
0505 20:13:42.735242 (+ 4826us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.735372 (+ 130us) write_op.cc:301] APPLY: starting
0505 20:13:42.735388 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.735434 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.735473 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.735598 (+ 125us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.735649 (+ 51us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:42.735657 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:42.735730 (+ 73us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.735816 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.735836 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:42.735842 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.735921 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.735927 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":75,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":538,"num_ops":2,"prepare.queue_time_us":11949,"prepare.run_cpu_time_us":703,"prepare.run_wall_time_us":703,"raft.queue_time_us":549,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":230,"replication_time_us":4977}]]}
I20260505 20:13:42.746146 9703 raft_consensus.cc:493] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.746299 9703 raft_consensus.cc:515] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:42.746984 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet 3d74dbab83b840d9b2bd103e946d3032 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:42.747241 9703 leader_election.cc:290] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:42.749581 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet 0112c04befa14c48bb5b2e7dfb60dac7 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:42.750365 8058 tablet_bootstrap.cc:492] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.750497 8058 ts_tablet_manager.cc:1403] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.093s user 0.003s sys 0.000s
I20260505 20:13:42.751025 9138 consensus_queue.cc:1048] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.751237 8058 raft_consensus.cc:359] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.751407 8058 raft_consensus.cc:385] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.751469 8058 raft_consensus.cc:740] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.751932 7408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_74794425f97a418ab4f09ff2f3600476" } new_table_name: "default.Table_96790cf9e7a04a219203c4bbefd569b4" modify_external_catalogs: true
I20260505 20:13:42.753968 9270 tablet_replica.cc:333] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:42.754873 7737 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.755574 9740 raft_consensus.cc:2749] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:42.756352 9270 raft_consensus.cc:2243] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:42.756779 9270 raft_consensus.cc:2272] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.757470 9270 ts_tablet_manager.cc:1916] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.747380 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:42.757953 7921 raft_consensus.cc:2393] T 7e5497df41ba46cc9228c0debd18551b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.749697 9566 raft_consensus.cc:493] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.758661 9566 raft_consensus.cc:515] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.759433 9566 leader_election.cc:290] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.752692 8054 tablet_bootstrap.cc:492] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.759902 8054 ts_tablet_manager.cc:1403] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.404s user 0.000s sys 0.010s
I20260505 20:13:42.760068 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.760772 8058 consensus_queue.cc:260] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.763857 8058 ts_tablet_manager.cc:1434] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:42.764154 8058 tablet_bootstrap.cc:492] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.772675 8058 tablet_bootstrap.cc:654] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.774187 8054 raft_consensus.cc:359] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:42.774436 7870 leader_election.cc:343] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.774533 9121 log.cc:1199] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f3b3c646af9843048382e77b138aea44
I20260505 20:13:42.775362 9773 tablet.cc:1724] T 3679480e55444d0d935f262217e44485 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:42.779313 8054 raft_consensus.cc:385] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.779597 8054 raft_consensus.cc:740] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.779915 8054 consensus_queue.cc:260] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.781358 8054 ts_tablet_manager.cc:1434] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260505 20:13:42.781728 9121 ts_tablet_manager.cc:1950] T f3b3c646af9843048382e77b138aea44 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:42.785969 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 95) took 6974 ms. Trace:
I20260505 20:13:42.786129 9121 rpcz_store.cc:276] 0505 20:13:35.811065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811138 (+ 73us) service_pool.cc:224] Handling call
0505 20:13:42.679282 (+6868144us) ts_tablet_manager.cc:1151] Deleting tablet f3b3c646af9843048382e77b138aea44
0505 20:13:42.679295 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.705936 (+ 26641us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.728055 (+ 22119us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.785927 (+ 57872us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6867960}
I20260505 20:13:42.786794 9121 tablet_replica.cc:333] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:42.786799 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f3b3c646af9843048382e77b138aea44 (table default.Table_74b14c0104de480d8de826c45ff1cf37 [id=7d374a42eb6149a183cce40f5c81326f]) successfully deleted
I20260505 20:13:42.787076 9121 raft_consensus.cc:2243] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.787273 9121 raft_consensus.cc:2272] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.787918 9121 ts_tablet_manager.cc:1916] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.795984 9566 raft_consensus.cc:493] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.796182 9566 raft_consensus.cc:515] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.797171 9566 leader_election.cc:290] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.797941 7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:42.802907 7870 leader_election.cc:343] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.803396 8054 tablet_bootstrap.cc:492] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.805161 8054 tablet_bootstrap.cc:654] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.811620 7659 raft_consensus.cc:1275] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260505 20:13:42.812294 9242 consensus_queue.cc:1048] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260505 20:13:42.764731 9590 raft_consensus.cc:697] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
W20260505 20:13:42.823552 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 68747us
I20260505 20:13:42.823938 7737 leader_election.cc:304] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.824666 9138 raft_consensus.cc:2804] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:42.824846 9138 raft_consensus.cc:697] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:42.825151 9138 consensus_queue.cc:237] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.827889 8058 tablet_bootstrap.cc:492] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.828032 8058 ts_tablet_manager.cc:1403] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.000s
I20260505 20:13:42.828763 8058 raft_consensus.cc:359] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.828948 8058 raft_consensus.cc:385] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.829018 8058 raft_consensus.cc:740] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.831960 9121 ts_tablet_manager.cc:1929] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.832206 8058 consensus_queue.cc:260] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.833374 8058 ts_tablet_manager.cc:1434] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:42.833699 8058 tablet_bootstrap.cc:492] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.836779 9590 consensus_queue.cc:237] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.837620 8058 tablet_bootstrap.cc:654] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.838419 9121 log.cc:1199] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/56bd0f4254424c979f90da0400e0ec70
I20260505 20:13:42.838266 9429 raft_consensus.cc:493] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.838614 9429 raft_consensus.cc:515] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.839231 9429 leader_election.cc:290] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.835434 8054 tablet_bootstrap.cc:492] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.840098 8054 ts_tablet_manager.cc:1403] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260505 20:13:42.840926 8054 raft_consensus.cc:359] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.841159 8054 raft_consensus.cc:385] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.841274 8054 raft_consensus.cc:740] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.841542 8054 consensus_queue.cc:260] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.842223 8054 ts_tablet_manager.cc:1434] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:42.842468 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.843032 9121 ts_tablet_manager.cc:1950] T 56bd0f4254424c979f90da0400e0ec70 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:42.843519 7870 leader_election.cc:343] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.847405 8054 tablet_bootstrap.cc:492] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.849431 8054 tablet_bootstrap.cc:654] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.850318 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 94) took 7039 ms. Trace:
I20260505 20:13:42.856891 9121 rpcz_store.cc:276] 0505 20:13:35.810973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811239 (+ 266us) service_pool.cc:224] Handling call
0505 20:13:42.786727 (+6975488us) ts_tablet_manager.cc:1151] Deleting tablet 56bd0f4254424c979f90da0400e0ec70
0505 20:13:42.786736 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.793427 (+ 6691us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.831874 (+ 38447us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.850271 (+ 18397us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6975334}
I20260505 20:13:42.857533 9121 tablet_replica.cc:333] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:42.857510 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 56bd0f4254424c979f90da0400e0ec70 (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
I20260505 20:13:42.857656 9429 raft_consensus.cc:493] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.857856 9429 raft_consensus.cc:515] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.858490 9429 leader_election.cc:290] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.859730 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a30738cb354b2c839f76b5d3b3be96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:42.860406 7870 leader_election.cc:343] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.860826 9121 raft_consensus.cc:2243] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.861405 9121 raft_consensus.cc:2272] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.863711 9429 raft_consensus.cc:493] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.863852 9429 raft_consensus.cc:515] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.864404 9429 leader_election.cc:290] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.865221 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:42.865716 7870 leader_election.cc:343] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.866534 9121 ts_tablet_manager.cc:1916] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:42.870136 7737 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd01314146a34257b444a622829b2fe4
I20260505 20:13:42.870607 7737 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.870894 9242 raft_consensus.cc:2749] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260505 20:13:42.873070 9429 raft_consensus.cc:493] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.873219 9429 raft_consensus.cc:515] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.873858 9429 leader_election.cc:290] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.874692 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:42.875255 7870 leader_election.cc:343] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.883757 8058 tablet_bootstrap.cc:492] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.883992 8058 ts_tablet_manager.cc:1403] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260505 20:13:42.884836 8058 raft_consensus.cc:359] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.885104 8058 raft_consensus.cc:385] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.885206 8058 raft_consensus.cc:740] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.885553 8058 consensus_queue.cc:260] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.753340 9774 tablet.cc:1724] T 3679480e55444d0d935f262217e44485 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:42.886255 8058 ts_tablet_manager.cc:1434] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:42.886595 8058 tablet_bootstrap.cc:492] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:42.887607 8054 tablet_bootstrap.cc:492] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.888901 8054 ts_tablet_manager.cc:1403] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.001s
I20260505 20:13:42.890488 8058 tablet_bootstrap.cc:654] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:42.894089 7737 leader_election.cc:343] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b8d50ceda0ff4bb6b49920c922dfee9e
I20260505 20:13:42.894245 7737 leader_election.cc:304] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.896003 9605 raft_consensus.cc:2749] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260505 20:13:42.897274 9758 raft_consensus.cc:493] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.898293 9758 raft_consensus.cc:515] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.899863 9758 leader_election.cc:290] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.899796 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0dd5d7870453bb1b771405daeb22f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:42.900316 7926 raft_consensus.cc:2468] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:42.900976 7598 leader_election.cc:304] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.901353 9758 raft_consensus.cc:2804] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.901491 9758 raft_consensus.cc:493] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.901620 9758 raft_consensus.cc:3060] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.899621 8054 raft_consensus.cc:359] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.902560 8054 raft_consensus.cc:385] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.903144 8054 raft_consensus.cc:740] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.904950 9121 ts_tablet_manager.cc:1929] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.906884 9121 log.cc:1199] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/608bffbbc10141e8bd19f475b95bdc65
I20260505 20:13:42.905731 8054 consensus_queue.cc:260] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.907378 9121 ts_tablet_manager.cc:1950] T 608bffbbc10141e8bd19f475b95bdc65 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:42.908412 9270 ts_tablet_manager.cc:1929] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.908443 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 96) took 7097 ms. Trace:
I20260505 20:13:42.908550 9121 rpcz_store.cc:276] 0505 20:13:35.811150 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811343 (+ 193us) service_pool.cc:224] Handling call
0505 20:13:42.857454 (+7046111us) ts_tablet_manager.cc:1151] Deleting tablet 608bffbbc10141e8bd19f475b95bdc65
0505 20:13:42.857464 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.888235 (+ 30771us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.904874 (+ 16639us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.908403 (+ 3529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7045970}
I20260505 20:13:42.912354 8054 ts_tablet_manager.cc:1434] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260505 20:13:42.912467 9121 tablet_replica.cc:333] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:42.913189 9121 raft_consensus.cc:2243] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:42.913395 9121 pending_rounds.cc:70] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:42.913628 9271 ts_tablet_manager.cc:1929] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.913853 9271 log.cc:1199] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:42.913944 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 608bffbbc10141e8bd19f475b95bdc65 (table default.Table_1612c41337614a9c9edcd92892fd1c68 [id=79032ad4a3c549559bc0ec51b54172d5]) successfully deleted
I20260505 20:13:42.914269 9121 pending_rounds.cc:77] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737231724908544 op_type: NO_OP noop_request { }
I20260505 20:13:42.914348 9271 ts_tablet_manager.cc:1950] T 944aad58d3c14577a0c66edd95fdf5e0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:42.914994 9121 raft_consensus.cc:2889] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:42.915171 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 100) took 5656 ms. Trace:
I20260505 20:13:42.915365 9121 raft_consensus.cc:2272] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.915270 9271 rpcz_store.cc:276] 0505 20:13:37.258275 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.259245 (+ 970us) service_pool.cc:224] Handling call
0505 20:13:42.490050 (+5230805us) ts_tablet_manager.cc:1151] Deleting tablet 944aad58d3c14577a0c66edd95fdf5e0
0505 20:13:42.490062 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.766992 (+276930us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.913570 (+146578us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.915151 (+ 1581us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5230642}
I20260505 20:13:42.915584 9271 tablet_replica.cc:333] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:42.915797 9271 raft_consensus.cc:2243] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:42.916095 9271 raft_consensus.cc:2272] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:42.916471 9121 ts_tablet_manager.cc:1916] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.918700 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 944aad58d3c14577a0c66edd95fdf5e0 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:42.915171 8054 tablet_bootstrap.cc:492] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:42.922413 8261 leader_election.cc:336] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Timed out: RequestConsensusVote RPC to 127.7.33.254:38755 timed out after 0.744s (SENT)
I20260505 20:13:42.922569 8261 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98; no voters: 73028cd481e446daa9432a35522a7967, f4615fa5639440fc820498f897adf17d
W20260505 20:13:42.924351 7737 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd01314146a34257b444a622829b2fe4
I20260505 20:13:42.946393 7737 leader_election.cc:304] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:42.947316 9242 raft_consensus.cc:2804] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:42.947403 9242 raft_consensus.cc:493] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:42.947484 9242 raft_consensus.cc:3060] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.949859 8054 tablet_bootstrap.cc:654] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.950657 9242 raft_consensus.cc:515] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.950204 9791 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260505 20:13:42.951332 9242 leader_election.cc:290] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.951560 9242 consensus_queue.cc:1048] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.924680 9715 consensus_queue.cc:1048] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:42.925908 9749 tablet.cc:1724] T 67c582e419f746b28530c0971fede09f P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:42.943272 9138 raft_consensus.cc:493] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:42.955432 9138 raft_consensus.cc:515] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.956328 9138 leader_election.cc:290] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.958283 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2554ecdcfd64ca6ba75e6b4077a5ab3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:42.958483 7787 raft_consensus.cc:2393] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 2: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:42.964193 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.964392 8054 tablet_bootstrap.cc:492] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:42.964586 8054 ts_tablet_manager.cc:1403] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260505 20:13:42.965484 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.965514 8054 raft_consensus.cc:359] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.965688 8054 raft_consensus.cc:385] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.965771 8054 raft_consensus.cc:740] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.966967 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed62f9b81e48459c6d55664ddf1cc6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.967550 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.968755 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.967643 8054 consensus_queue.cc:260] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.970285 9271 ts_tablet_manager.cc:1916] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:42.974507 8054 ts_tablet_manager.cc:1434] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260505 20:13:42.978600 8054 tablet_bootstrap.cc:492] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:42.970501 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.971041 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.971472 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a30738cb354b2c839f76b5d3b3be96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.977989 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.984872 8054 tablet_bootstrap.cc:654] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:42.985164 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:42.986536 9566 raft_consensus.cc:493] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:42.911392 9758 raft_consensus.cc:515] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:42.986711 9566 raft_consensus.cc:515] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.987371 9566 leader_election.cc:290] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:42.987833 9758 leader_election.cc:290] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:42.988108 9270 log.cc:1199] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:42.989300 9270 ts_tablet_manager.cc:1950] T 84fb3dcea55d4b348cbf92c3c4581dda P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:42.990789 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0dd5d7870453bb1b771405daeb22f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:42.990957 7926 raft_consensus.cc:3060] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:42.940327 9790 tablet.cc:1724] T 67c582e419f746b28530c0971fede09f P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:42.956976 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34883b630a87480f953facb44615ef65" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.963869 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:42.914144 8058 tablet_bootstrap.cc:492] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:42.992594 9121 ts_tablet_manager.cc:1929] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:42.992650 8058 ts_tablet_manager.cc:1403] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.002s
I20260505 20:13:42.992723 9121 log.cc:1199] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/0ec5c094e2bb4a4481825df17becde52
I20260505 20:13:42.993100 9121 ts_tablet_manager.cc:1950] T 0ec5c094e2bb4a4481825df17becde52 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:42.993440 8058 raft_consensus.cc:359] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.993597 8058 raft_consensus.cc:385] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:42.993655 8058 raft_consensus.cc:740] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:42.993693 7926 raft_consensus.cc:2468] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:42.993933 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 97) took 7182 ms. Trace:
I20260505 20:13:42.993896 8058 consensus_queue.cc:260] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:42.994042 9121 rpcz_store.cc:276] 0505 20:13:35.811242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811418 (+ 176us) service_pool.cc:224] Handling call
0505 20:13:42.912403 (+7100985us) ts_tablet_manager.cc:1151] Deleting tablet 0ec5c094e2bb4a4481825df17becde52
0505 20:13:42.912414 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.919503 (+ 7089us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.992518 (+ 73015us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.993894 (+ 1376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7100845}
I20260505 20:13:42.994357 8058 ts_tablet_manager.cc:1434] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:42.994606 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 0ec5c094e2bb4a4481825df17becde52 (table default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]) successfully deleted
W20260505 20:13:42.995042 7736 leader_election.cc:343] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:42.995106 7598 leader_election.cc:304] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:42.990321 7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:42.995402 9704 raft_consensus.cc:2804] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:42.995625 9704 raft_consensus.cc:697] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:42.995955 9704 consensus_queue.cc:237] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:42.997246 7870 leader_election.cc:343] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.002327 9121 tablet_replica.cc:333] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.002904 9121 raft_consensus.cc:2243] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.017077 9121 raft_consensus.cc:2272] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.018252 9121 ts_tablet_manager.cc:1916] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.022681 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 103) took 5755 ms. Trace:
I20260505 20:13:43.031363 7412 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 6d805583f5c64ea7a9fe2f658079b5c5
I20260505 20:13:43.032114 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d805583f5c64ea7a9fe2f658079b5c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8da300a3c6a743829936ecbfcd9439b5) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:43.033313 7412 catalog_manager.cc:6741] ReplaceTablet: tablet 6d805583f5c64ea7a9fe2f658079b5c5 deleted and replaced by tablet 8da300a3c6a743829936ecbfcd9439b5
I20260505 20:13:43.033500 7412 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 166) took 1516 ms. Trace:
I20260505 20:13:43.033723 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d805583f5c64ea7a9fe2f658079b5c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8da300a3c6a743829936ecbfcd9439b5) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:43.033599 7412 rpcz_store.cc:276] 0505 20:13:41.517416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.720904 (+1203488us) service_pool.cc:224] Handling call
0505 20:13:43.033418 (+312514us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.795721 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.795865 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.795871 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:42.795874 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.795990 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.796002 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.796007 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.796079 (+ 72us) tablet.cc:701] Row locks acquired
0505 20:13:42.796081 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.796145 (+ 64us) write_op.cc:270] Start()
0505 20:13:42.796177 (+ 32us) write_op.cc:276] Timestamp: P: 1778012022796191 usec, L: 0
0505 20:13:42.796181 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.796369 (+ 188us) log.cc:844] Serialized 625 byte log entry
0505 20:13:42.800058 (+ 3689us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.800255 (+ 197us) write_op.cc:301] APPLY: starting
0505 20:13:42.800276 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.800350 (+ 74us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.800398 (+ 48us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.800533 (+ 135us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.800621 (+ 88us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:42.800634 (+ 13us) write_op.cc:312] APPLY: finished
0505 20:13:42.800737 (+ 103us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.800813 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.800839 (+ 26us) write_op.cc:454] Released schema lock
0505 20:13:42.800848 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.800920 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.800924 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":136,"apply.run_cpu_time_us":662,"apply.run_wall_time_us":661,"num_ops":2,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":748,"prepare.run_wall_time_us":749,"raft.queue_time_us":481,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":262,"replication_time_us":3838}]]}
I20260505 20:13:43.035274 7412 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3a4483646c944eeea474544647e55eb5" } modify_external_catalogs: true
I20260505 20:13:43.035470 7412 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_3a4483646c944eeea474544647e55eb5" } modify_external_catalogs: true
I20260505 20:13:43.035785 8054 tablet_bootstrap.cc:492] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.035940 8054 ts_tablet_manager.cc:1403] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.003s
I20260505 20:13:43.036356 9270 rpcz_store.cc:276] 0505 20:13:37.267059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.267296 (+ 237us) service_pool.cc:224] Handling call
0505 20:13:42.599321 (+5332025us) ts_tablet_manager.cc:1151] Deleting tablet 84fb3dcea55d4b348cbf92c3c4581dda
0505 20:13:42.599334 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.904759 (+305425us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:42.908357 (+ 3598us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.022654 (+114297us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5331887}
I20260505 20:13:43.036922 9270 tablet_replica.cc:333] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:43.036854 8054 raft_consensus.cc:359] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.037032 8054 raft_consensus.cc:385] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.037107 8054 raft_consensus.cc:740] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.037338 8054 consensus_queue.cc:260] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.037421 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 84fb3dcea55d4b348cbf92c3c4581dda (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
I20260505 20:13:43.038033 8054 ts_tablet_manager.cc:1434] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:43.038628 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5497df41ba46cc9228c0debd18551b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.041687 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0dd5d7870453bb1b771405daeb22f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.041893 7793 raft_consensus.cc:2468] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:43.043128 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0dd5d7870453bb1b771405daeb22f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:43.043262 7793 raft_consensus.cc:3060] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.044435 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1a3de8c5bc489e8cdc236478557da1 (DEFAULT_TABLE table=default.Table_12137e368ef9471291d6710d66495bdc [id=864e56c5add6465a9dac17a26747e86c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.044778 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1a3de8c5bc489e8cdc236478557da1 (DEFAULT_TABLE table=default.Table_12137e368ef9471291d6710d66495bdc [id=864e56c5add6465a9dac17a26747e86c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.045763 7768 tablet_service.cc:1511] Processing CreateTablet for tablet b041346eb89b4739b575ebb25cee0eab (DEFAULT_TABLE table=default.Table_32ed2f79e9ac4de79eab05b72aeb3afb [id=6a1c384b128b4a79bdca1f28b75d4aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.045948 7916 tablet_service.cc:1511] Processing CreateTablet for tablet b041346eb89b4739b575ebb25cee0eab (DEFAULT_TABLE table=default.Table_32ed2f79e9ac4de79eab05b72aeb3afb [id=6a1c384b128b4a79bdca1f28b75d4aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.050213 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 266d53c82e3f45abb6e50d2e21948336 (DEFAULT_TABLE table=default.Table_e93051733d2d4ef6aa1fb89a96110372 [id=794ebe252f2e4c748b5ea330de57525b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.051929 7774 tablet_service.cc:1511] Processing CreateTablet for tablet d4d86c278a354e26a5a1579cefe8490b (DEFAULT_TABLE table=default.Table_7bf454b705824f97ae876a407740a0e0 [id=280c8e08d7a14499a05cc4691975be50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.052311 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b041346eb89b4739b575ebb25cee0eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.052554 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1a3de8c5bc489e8cdc236478557da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.052877 7913 tablet_service.cc:1511] Processing CreateTablet for tablet 266d53c82e3f45abb6e50d2e21948336 (DEFAULT_TABLE table=default.Table_e93051733d2d4ef6aa1fb89a96110372 [id=794ebe252f2e4c748b5ea330de57525b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.053206 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266d53c82e3f45abb6e50d2e21948336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.054095 7917 tablet_service.cc:1511] Processing CreateTablet for tablet d4d86c278a354e26a5a1579cefe8490b (DEFAULT_TABLE table=default.Table_7bf454b705824f97ae876a407740a0e0 [id=280c8e08d7a14499a05cc4691975be50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.054405 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d86c278a354e26a5a1579cefe8490b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.054639 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5c26991e29474c85d064bb8abc15eb (DEFAULT_TABLE table=default.Table_fa08808641b84eb9a54f9a5a39e9b97a [id=a0f5022a06bc436086bce90a13f2f958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.060038 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5c26991e29474c85d064bb8abc15eb (DEFAULT_TABLE table=default.Table_fa08808641b84eb9a54f9a5a39e9b97a [id=a0f5022a06bc436086bce90a13f2f958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.060443 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5c26991e29474c85d064bb8abc15eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.060999 8054 tablet_bootstrap.cc:492] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.061499 9566 raft_consensus.cc:493] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.061689 9566 raft_consensus.cc:515] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.061792 7793 raft_consensus.cc:2468] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:43.062551 9566 leader_election.cc:290] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.065671 7412 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet bba762ac77504aab98770a6a34274d3e
I20260505 20:13:43.066192 8054 tablet_bootstrap.cc:654] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.067204 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet bba762ac77504aab98770a6a34274d3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:43 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:43.067852 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet bba762ac77504aab98770a6a34274d3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:43 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:43.068989 7412 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_bc0ac75d0a8d46caa8026d33f784689d" } new_table_name: "default.Table_0ef8400118a94669bd053c6bfd79b180" modify_external_catalogs: true
I20260505 20:13:43.034341 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d805583f5c64ea7a9fe2f658079b5c5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8da300a3c6a743829936ecbfcd9439b5) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:43.036208 7598 consensus_peers.cc:597] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:43.036181 9704 raft_consensus.cc:493] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.023103 8058 tablet_bootstrap.cc:492] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:43.043874 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1a3de8c5bc489e8cdc236478557da1 (DEFAULT_TABLE table=default.Table_12137e368ef9471291d6710d66495bdc [id=864e56c5add6465a9dac17a26747e86c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.076141 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1a3de8c5bc489e8cdc236478557da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.077207 8058 tablet_bootstrap.cc:654] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.045259 7627 tablet_service.cc:1511] Processing CreateTablet for tablet b041346eb89b4739b575ebb25cee0eab (DEFAULT_TABLE table=default.Table_32ed2f79e9ac4de79eab05b72aeb3afb [id=6a1c384b128b4a79bdca1f28b75d4aaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.078068 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b041346eb89b4739b575ebb25cee0eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.051062 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 266d53c82e3f45abb6e50d2e21948336 (DEFAULT_TABLE table=default.Table_e93051733d2d4ef6aa1fb89a96110372 [id=794ebe252f2e4c748b5ea330de57525b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.082054 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266d53c82e3f45abb6e50d2e21948336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.082726 9704 raft_consensus.cc:515] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.051370 7635 tablet_service.cc:1511] Processing CreateTablet for tablet d4d86c278a354e26a5a1579cefe8490b (DEFAULT_TABLE table=default.Table_7bf454b705824f97ae876a407740a0e0 [id=280c8e08d7a14499a05cc4691975be50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.055474 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5c26991e29474c85d064bb8abc15eb (DEFAULT_TABLE table=default.Table_fa08808641b84eb9a54f9a5a39e9b97a [id=a0f5022a06bc436086bce90a13f2f958]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.086006 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5c26991e29474c85d064bb8abc15eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.055781 7629 tablet_service.cc:1511] Processing CreateTablet for tablet 84299e359f0f4693ac2886ad41679cda (DEFAULT_TABLE table=default.Table_9a5dd3a6512a4416839b43746ab27ca1 [id=424549302451400ca8b108cac4d74349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.089627 9121 ts_tablet_manager.cc:1929] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.089888 9121 log.cc:1199] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/17acb52d6cde4ced988506cee48eb040
I20260505 20:13:43.090032 7629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84299e359f0f4693ac2886ad41679cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.090278 9121 ts_tablet_manager.cc:1950] T 17acb52d6cde4ced988506cee48eb040 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.091094 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 98) took 7279 ms. Trace:
I20260505 20:13:43.091182 9121 rpcz_store.cc:276] 0505 20:13:35.811355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811503 (+ 148us) service_pool.cc:224] Handling call
0505 20:13:43.002255 (+7190752us) ts_tablet_manager.cc:1151] Deleting tablet 17acb52d6cde4ced988506cee48eb040
0505 20:13:43.002266 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.071803 (+ 69537us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.074600 (+ 2797us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.091071 (+ 16471us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7190626}
I20260505 20:13:43.091691 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 17acb52d6cde4ced988506cee48eb040 (table default.Table_e11454be890e45bc9d2ba2cd319f2c93 [id=8dc245508fd34445bb94f647505e20d9]) successfully deleted
I20260505 20:13:43.092494 8054 tablet_bootstrap.cc:492] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.092621 8054 ts_tablet_manager.cc:1403] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260505 20:13:43.093365 8054 raft_consensus.cc:359] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.093534 8054 raft_consensus.cc:385] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.093581 8054 raft_consensus.cc:740] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.093797 8054 consensus_queue.cc:260] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.093997 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d86c278a354e26a5a1579cefe8490b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.094254 8054 ts_tablet_manager.cc:1434] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:43.098104 8054 tablet_bootstrap.cc:492] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.099574 8054 tablet_bootstrap.cc:654] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.100096 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1a3de8c5bc489e8cdc236478557da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.100274 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d86c278a354e26a5a1579cefe8490b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.101915 9121 tablet_replica.cc:333] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.102109 9121 raft_consensus.cc:2243] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.102380 9121 raft_consensus.cc:2272] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.103636 9121 ts_tablet_manager.cc:1916] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.103920 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b041346eb89b4739b575ebb25cee0eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.109246 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266d53c82e3f45abb6e50d2e21948336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.114210 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5c26991e29474c85d064bb8abc15eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.114518 9704 leader_election.cc:290] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.116261 8058 tablet_bootstrap.cc:492] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:43.116536 8058 ts_tablet_manager.cc:1403] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.005s
I20260505 20:13:43.117954 8058 raft_consensus.cc:359] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.118360 8058 raft_consensus.cc:385] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.118503 8058 raft_consensus.cc:740] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.118885 8058 consensus_queue.cc:260] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.121604 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 84299e359f0f4693ac2886ad41679cda (DEFAULT_TABLE table=default.Table_9a5dd3a6512a4416839b43746ab27ca1 [id=424549302451400ca8b108cac4d74349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.122033 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84299e359f0f4693ac2886ad41679cda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:43.122340 7598 consensus_peers.cc:597] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3b3c646af9843048382e77b138aea44. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:43.122712 8054 tablet_bootstrap.cc:492] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.122830 8054 ts_tablet_manager.cc:1403] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260505 20:13:43.123420 8054 raft_consensus.cc:359] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.123565 8054 raft_consensus.cc:385] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.123610 8054 raft_consensus.cc:740] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.123793 8054 consensus_queue.cc:260] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.124217 8054 ts_tablet_manager.cc:1434] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:43.124450 8054 tablet_bootstrap.cc:492] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.125859 8054 tablet_bootstrap.cc:654] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.126679 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.126837 7921 raft_consensus.cc:2468] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:43.131546 9121 ts_tablet_manager.cc:1929] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.132602 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab5b85e6d24e14a8e7507003eed5d2 (DEFAULT_TABLE table=default.Table_9d55ccc940bc44609d7d09a1528c18e2 [id=43a33ce1fbae477aab804232815b6260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.133030 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab5b85e6d24e14a8e7507003eed5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.132843 8058 ts_tablet_manager.cc:1434] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260505 20:13:43.133105 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab5b85e6d24e14a8e7507003eed5d2 (DEFAULT_TABLE table=default.Table_9d55ccc940bc44609d7d09a1528c18e2 [id=43a33ce1fbae477aab804232815b6260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.133457 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab5b85e6d24e14a8e7507003eed5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.136145 8058 tablet_bootstrap.cc:492] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:43.137830 9121 log.cc:1199] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e98c0e648c98488e8c5509b296824bea
I20260505 20:13:43.138082 9138 raft_consensus.cc:493] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.138240 9121 ts_tablet_manager.cc:1950] T e98c0e648c98488e8c5509b296824bea P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.138209 9138 raft_consensus.cc:515] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.138520 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 99) took 7327 ms. Trace:
I20260505 20:13:43.138557 7598 leader_election.cc:304] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.138585 9121 rpcz_store.cc:276] 0505 20:13:35.811441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811579 (+ 138us) service_pool.cc:224] Handling call
0505 20:13:43.101867 (+7290288us) ts_tablet_manager.cc:1151] Deleting tablet e98c0e648c98488e8c5509b296824bea
0505 20:13:43.101877 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.119591 (+ 17714us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.131499 (+ 11908us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.138504 (+ 7005us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7290168}
I20260505 20:13:43.138782 9138 leader_election.cc:290] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.138897 9121 tablet_replica.cc:333] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.136945 9429 raft_consensus.cc:493] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.139075 9121 raft_consensus.cc:2243] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.139087 9429 raft_consensus.cc:515] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.139303 9121 raft_consensus.cc:2272] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.139669 9429 leader_election.cc:290] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.139810 9121 ts_tablet_manager.cc:1916] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.140897 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e98c0e648c98488e8c5509b296824bea (table default.Table_2fea05446c6145fc9065f0db527efe94 [id=a812e64a033a470eaf1861fb213b4ceb]) successfully deleted
I20260505 20:13:43.141940 9156 raft_consensus.cc:2804] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:43.142019 9156 raft_consensus.cc:493] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:43.142088 9156 raft_consensus.cc:3060] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.144616 9156 raft_consensus.cc:515] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.145192 9156 leader_election.cc:290] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.147555 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:43.147748 7924 raft_consensus.cc:3060] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.150573 8054 tablet_bootstrap.cc:492] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.150694 8054 ts_tablet_manager.cc:1403] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20260505 20:13:43.151417 8054 raft_consensus.cc:359] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.151927 7924 raft_consensus.cc:2468] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:43.152014 8054 raft_consensus.cc:385] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.152077 8054 raft_consensus.cc:740] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.152303 8054 consensus_queue.cc:260] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.152717 7598 leader_election.cc:304] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.063902 7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:43.066656 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet bba762ac77504aab98770a6a34274d3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:43 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:43.153070 9156 raft_consensus.cc:2804] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:43.153173 9156 raft_consensus.cc:697] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:43.153187 8054 ts_tablet_manager.cc:1434] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:43.069097 9590 raft_consensus.cc:493] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.153465 8054 tablet_bootstrap.cc:492] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:43.153487 7870 leader_election.cc:343] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.153487 9590 raft_consensus.cc:515] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:43.153697 9156 consensus_queue.cc:237] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.154284 9590 leader_election.cc:290] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.155114 8054 tablet_bootstrap.cc:654] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.155155 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.156299 8058 tablet_bootstrap.cc:654] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.159546 7768 tablet_service.cc:1511] Processing CreateTablet for tablet 84299e359f0f4693ac2886ad41679cda (DEFAULT_TABLE table=default.Table_9a5dd3a6512a4416839b43746ab27ca1 [id=424549302451400ca8b108cac4d74349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.160032 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84299e359f0f4693ac2886ad41679cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.163497 7914 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab5b85e6d24e14a8e7507003eed5d2 (DEFAULT_TABLE table=default.Table_9d55ccc940bc44609d7d09a1528c18e2 [id=43a33ce1fbae477aab804232815b6260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.163924 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab5b85e6d24e14a8e7507003eed5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.164584 7638 tablet_service.cc:1511] Processing CreateTablet for tablet 1205ac0117464cff99a742ac112a2178 (DEFAULT_TABLE table=default.Table_aa48f9a5f71b4a5ca3661a5a822ce5c7 [id=f6b57ed30eb544e194c52687afdc0a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.166898 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 1205ac0117464cff99a742ac112a2178 (DEFAULT_TABLE table=default.Table_aa48f9a5f71b4a5ca3661a5a822ce5c7 [id=f6b57ed30eb544e194c52687afdc0a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.167270 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1205ac0117464cff99a742ac112a2178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.168597 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:43.169039 7659 raft_consensus.cc:3060] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.172178 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:43.172786 7870 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.173319 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1205ac0117464cff99a742ac112a2178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.173660 9270 raft_consensus.cc:2243] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.176040 9270 raft_consensus.cc:2272] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.184041 9758 raft_consensus.cc:493] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.184387 9758 raft_consensus.cc:515] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.185907 9758 leader_election.cc:290] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.186337 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.186537 7924 raft_consensus.cc:2468] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
W20260505 20:13:43.186965 7736 leader_election.cc:343] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.187075 7598 leader_election.cc:304] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.188263 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 1205ac0117464cff99a742ac112a2178 (DEFAULT_TABLE table=default.Table_aa48f9a5f71b4a5ca3661a5a822ce5c7 [id=f6b57ed30eb544e194c52687afdc0a8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.188683 9758 raft_consensus.cc:2804] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:43.188755 9758 raft_consensus.cc:493] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:43.188817 9758 raft_consensus.cc:3060] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.191550 9270 ts_tablet_manager.cc:1916] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.193848 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 7b74b20192cd4fa4816b9eeb36d57d7a (DEFAULT_TABLE table=default.Table_8aa3142c5bb74a9e95ac8f8efd637552 [id=0c47bf111a1549cc92c0fe9ea49f0173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.194859 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b74b20192cd4fa4816b9eeb36d57d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.197044 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 7b74b20192cd4fa4816b9eeb36d57d7a (DEFAULT_TABLE table=default.Table_8aa3142c5bb74a9e95ac8f8efd637552 [id=0c47bf111a1549cc92c0fe9ea49f0173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.197395 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 7b74b20192cd4fa4816b9eeb36d57d7a (DEFAULT_TABLE table=default.Table_8aa3142c5bb74a9e95ac8f8efd637552 [id=0c47bf111a1549cc92c0fe9ea49f0173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.197808 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b74b20192cd4fa4816b9eeb36d57d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.200212 8054 tablet_bootstrap.cc:492] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.200353 8054 ts_tablet_manager.cc:1403] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.001s
I20260505 20:13:43.201131 8054 raft_consensus.cc:359] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.201292 8054 raft_consensus.cc:385] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.201347 8054 raft_consensus.cc:740] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.201547 8054 consensus_queue.cc:260] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.202085 8054 ts_tablet_manager.cc:1434] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:43.202359 8054 tablet_bootstrap.cc:492] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.202845 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1205ac0117464cff99a742ac112a2178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.203239 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b74b20192cd4fa4816b9eeb36d57d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.204268 9121 ts_tablet_manager.cc:1929] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.204371 9121 log.cc:1199] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:43.204650 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:43.204782 9121 ts_tablet_manager.cc:1950] T 4e91e29eb2e6462a975adcf9a379c421 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.215939 9156 consensus_queue.cc:1048] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:43.218073 7642 tablet_service.cc:1511] Processing CreateTablet for tablet bba762ac77504aab98770a6a34274d3e (DEFAULT_TABLE table=default.Table_3a4483646c944eeea474544647e55eb5 [id=7cc3798dd14f4c4b94e7d2dd2786d08a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.218513 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba762ac77504aab98770a6a34274d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.220356 8054 tablet_bootstrap.cc:654] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.229305 7914 tablet_service.cc:1511] Processing CreateTablet for tablet bba762ac77504aab98770a6a34274d3e (DEFAULT_TABLE table=default.Table_3a4483646c944eeea474544647e55eb5 [id=7cc3798dd14f4c4b94e7d2dd2786d08a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.229873 7780 tablet_service.cc:1511] Processing CreateTablet for tablet bba762ac77504aab98770a6a34274d3e (DEFAULT_TABLE table=default.Table_3a4483646c944eeea474544647e55eb5 [id=7cc3798dd14f4c4b94e7d2dd2786d08a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.231752 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:43.232162 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:43.232345 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:43.232545 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:43.232931 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:43.233084 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:43.233415 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]). Expected version 2 got 0
I20260505 20:13:43.237881 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba762ac77504aab98770a6a34274d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.240427 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 101) took 7428 ms. Trace:
I20260505 20:13:43.240581 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba762ac77504aab98770a6a34274d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.241773 9758 raft_consensus.cc:515] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.242869 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:43.243037 7921 raft_consensus.cc:3060] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.246426 7921 raft_consensus.cc:2468] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:43.248225 7598 leader_election.cc:304] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.248662 9121 rpcz_store.cc:276] 0505 20:13:35.811620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811698 (+ 78us) service_pool.cc:224] Handling call
0505 20:13:43.138858 (+7327160us) ts_tablet_manager.cc:1151] Deleting tablet 4e91e29eb2e6462a975adcf9a379c421
0505 20:13:43.138866 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.158403 (+ 19537us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.204213 (+ 45810us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.240400 (+ 36187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7327033}
I20260505 20:13:43.249965 9590 raft_consensus.cc:2804] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:43.250524 9590 raft_consensus.cc:697] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:43.251092 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 100) took 7439 ms. Trace:
I20260505 20:13:43.251377 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 4e91e29eb2e6462a975adcf9a379c421 (table default.Table_0f5f9bf433a14811882fb1e5a2f93aba [id=6cdd177b6b79450ea461ad6a2ae78aa4]) successfully deleted
I20260505 20:13:43.251324 9590 consensus_queue.cc:237] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.251322 9121 rpcz_store.cc:276] 0505 20:13:35.811530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.811870 (+ 340us) service_pool.cc:224] Handling call
0505 20:13:43.250661 (+7438791us) ts_tablet_manager.cc:1151] Deleting tablet f4d78ebf153640e4b2f518fb215f1bf1
0505 20:13:43.250711 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.251051 (+ 340us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7438619}
I20260505 20:13:43.252826 9121 tablet_replica.cc:333] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
W20260505 20:13:43.254467 7399 catalog_manager.cc:4982] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet f4d78ebf153640e4b2f518fb215f1bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d78ebf153640e4b2f518fb215f1bf1 already in progress: creating tablet
I20260505 20:13:43.262164 9121 raft_consensus.cc:2243] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.262920 9121 raft_consensus.cc:2272] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.264029 9121 ts_tablet_manager.cc:1916] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.269332 9704 raft_consensus.cc:493] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.269483 9704 raft_consensus.cc:515] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.270659 9704 leader_election.cc:290] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.271224 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.271469 7921 raft_consensus.cc:2393] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:43.272336 9271 ts_tablet_manager.cc:1929] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.276765 9429 raft_consensus.cc:493] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.276903 9429 raft_consensus.cc:515] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.277514 9429 leader_election.cc:290] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.278122 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:43.278290 7662 raft_consensus.cc:2468] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:43.278674 7870 leader_election.cc:304] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.278928 9429 raft_consensus.cc:2804] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:43.279008 9429 raft_consensus.cc:493] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:43.279085 9429 raft_consensus.cc:3060] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.282281 9429 raft_consensus.cc:515] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.283187 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:43.283337 7662 raft_consensus.cc:3060] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.288098 9429 leader_election.cc:290] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.288923 9121 ts_tablet_manager.cc:1929] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:43.289713 7411 catalog_manager.cc:5671] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:43.288775 7662 raft_consensus.cc:2468] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:43.291630 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:43.286561 9270 ts_tablet_manager.cc:1929] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.289065 9156 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.293231 9270 log.cc:1199] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b9f684cd880b4a748cab49795de11503
I20260505 20:13:43.293295 9156 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:43.296756 9758 leader_election.cc:290] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.298646 9270 ts_tablet_manager.cc:1950] T b9f684cd880b4a748cab49795de11503 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:43.304212 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:43.306723 8058 tablet_bootstrap.cc:492] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:43.306854 8058 ts_tablet_manager.cc:1403] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.172s user 0.003s sys 0.016s
I20260505 20:13:43.304651 9156 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.308161 8058 raft_consensus.cc:359] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.309973 8058 raft_consensus.cc:385] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.310046 8058 raft_consensus.cc:740] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.310254 8058 consensus_queue.cc:260] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.310755 8058 ts_tablet_manager.cc:1434] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:43.309305 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 92) took 6045 ms. Trace:
I20260505 20:13:43.311769 9270 rpcz_store.cc:276] 0505 20:13:37.263584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.268298 (+ 4714us) service_pool.cc:224] Handling call
0505 20:13:43.036866 (+5768568us) ts_tablet_manager.cc:1151] Deleting tablet b9f684cd880b4a748cab49795de11503
0505 20:13:43.036878 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.238690 (+201812us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.285548 (+ 46858us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.308982 (+ 23434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7752,"tablet-delete.queue_time_us":5768435}
I20260505 20:13:43.292038 7870 leader_election.cc:304] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.295642 8054 tablet_bootstrap.cc:492] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.303213 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.312387 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b9f684cd880b4a748cab49795de11503 (table default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]) successfully deleted
I20260505 20:13:43.312384 7921 raft_consensus.cc:2393] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:43.312381 8054 ts_tablet_manager.cc:1403] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.004s
I20260505 20:13:43.312832 9429 raft_consensus.cc:2804] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:43.313040 9429 raft_consensus.cc:697] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:43.313315 9429 consensus_queue.cc:237] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.313817 8054 raft_consensus.cc:359] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.314082 8054 raft_consensus.cc:385] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.314162 8054 raft_consensus.cc:740] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.315747 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:43.315187 8054 consensus_queue.cc:260] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.320173 8054 ts_tablet_manager.cc:1434] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260505 20:13:43.321938 9121 log.cc:1199] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/41fdaa9781ef4331bf3f0a7f8db4c1a0
I20260505 20:13:43.321938 8054 tablet_bootstrap.cc:492] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.325489 9121 ts_tablet_manager.cc:1950] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.328882 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:43.329001 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 104) took 7516 ms. Trace:
I20260505 20:13:43.330855 9121 rpcz_store.cc:276] 0505 20:13:35.811909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812021 (+ 112us) service_pool.cc:224] Handling call
0505 20:13:43.252736 (+7440715us) ts_tablet_manager.cc:1151] Deleting tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0
0505 20:13:43.252769 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.273599 (+ 20830us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.288872 (+ 15273us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.328757 (+ 39885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7439973}
I20260505 20:13:43.333227 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 (table default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]) successfully deleted
I20260505 20:13:43.334146 9121 tablet_replica.cc:333] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.335642 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:43.336308 9758 consensus_queue.cc:1048] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:43.335975 9121 raft_consensus.cc:2243] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.337080 9121 raft_consensus.cc:2272] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.337276 9566 raft_consensus.cc:493] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.337350 8054 tablet_bootstrap.cc:654] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.338428 9566 raft_consensus.cc:515] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.339020 9566 leader_election.cc:290] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.339771 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:43.340391 7870 leader_election.cc:343] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.342059 9121 ts_tablet_manager.cc:1916] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.342585 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:43.344841 9156 raft_consensus.cc:493] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.344995 9156 raft_consensus.cc:515] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.347204 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.347404 7926 raft_consensus.cc:2468] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:43.346871 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:43.347946 7598 leader_election.cc:304] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.348277 9704 raft_consensus.cc:2804] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:43.348384 9704 raft_consensus.cc:493] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:43.348464 9704 raft_consensus.cc:3060] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.349607 9156 leader_election.cc:290] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.351832 9704 raft_consensus.cc:515] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.352546 9704 leader_election.cc:290] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.353432 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:43.353621 7926 raft_consensus.cc:3060] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.356266 7926 raft_consensus.cc:2468] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:43.295811 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.296177 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:43.353102 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2faf7c64c3c340ceb8c87e416a32a7ed" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.356931 7598 leader_election.cc:304] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.357245 9704 raft_consensus.cc:2804] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:43.357391 9704 raft_consensus.cc:697] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:43.357720 9704 consensus_queue.cc:237] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.348101 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:43.363692 9271 log.cc:1199] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/22a98da176254eeb896c680fbcb98caa
I20260505 20:13:43.364205 9271 ts_tablet_manager.cc:1950] T 22a98da176254eeb896c680fbcb98caa P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:43.367286 7598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:43.366993 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:43.369491 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:43.371137 8054 tablet_bootstrap.cc:492] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.371412 8054 ts_tablet_manager.cc:1403] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.002s
I20260505 20:13:43.372961 8054 raft_consensus.cc:359] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.373243 8054 raft_consensus.cc:385] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.373323 8054 raft_consensus.cc:740] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.373705 8054 consensus_queue.cc:260] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.375918 8054 ts_tablet_manager.cc:1434] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260505 20:13:43.377562 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:43.379181 8054 tablet_bootstrap.cc:492] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.378799 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:43.364431 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.385994 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 103) took 6127 ms. Trace:
I20260505 20:13:43.367002 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:43.367316 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.386502 7790 raft_consensus.cc:2393] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:43.368263 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.368644 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:43.366335 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ed7c0220d147c7853c7afc1ef09607" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.386457 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:43.387636 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:43.388554 9271 rpcz_store.cc:276] 0505 20:13:37.258544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.259757 (+ 1213us) service_pool.cc:224] Handling call
0505 20:13:42.915540 (+5655783us) ts_tablet_manager.cc:1151] Deleting tablet 22a98da176254eeb896c680fbcb98caa
0505 20:13:42.915548 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:42.984062 (+ 68514us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.272269 (+288207us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.385973 (+113704us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5655633}
I20260505 20:13:43.389072 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 22a98da176254eeb896c680fbcb98caa (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]) successfully deleted
I20260505 20:13:43.389400 9271 tablet_replica.cc:333] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:43.389642 9271 raft_consensus.cc:2243] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.389868 9271 raft_consensus.cc:2272] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.390038 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:43.390501 9271 ts_tablet_manager.cc:1916] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.393981 8058 tablet_bootstrap.cc:492] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:43.395767 8058 tablet_bootstrap.cc:654] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.397202 9270 tablet_replica.cc:333] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:43.397408 9270 raft_consensus.cc:2243] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.397790 9270 raft_consensus.cc:2272] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.398350 9270 ts_tablet_manager.cc:1916] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.398622 8054 tablet_bootstrap.cc:654] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.399169 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:43.400220 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:43.401136 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:43.402230 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
W20260505 20:13:43.403709 7598 consensus_peers.cc:597] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2676078f47c4bc19391227d9643c15f. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:43.404223 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:43.405051 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:43.405898 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:43.407109 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:43.409039 9429 raft_consensus.cc:493] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.409171 9429 raft_consensus.cc:515] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.409911 9429 leader_election.cc:290] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.410637 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:43.411110 7870 leader_election.cc:343] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.421890 9270 ts_tablet_manager.cc:1929] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.422015 9270 log.cc:1199] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/3d74dbab83b840d9b2bd103e946d3032
I20260505 20:13:43.422410 9270 ts_tablet_manager.cc:1950] T 3d74dbab83b840d9b2bd103e946d3032 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:43.422720 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 105) took 6154 ms. Trace:
I20260505 20:13:43.422802 9270 rpcz_store.cc:276] 0505 20:13:37.267797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.268453 (+ 656us) service_pool.cc:224] Handling call
0505 20:13:43.312111 (+6043658us) ts_tablet_manager.cc:1151] Deleting tablet 3d74dbab83b840d9b2bd103e946d3032
0505 20:13:43.397153 (+ 85042us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.401433 (+ 4280us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.421823 (+ 20390us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.422705 (+ 882us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6043497}
I20260505 20:13:43.423105 9270 tablet_replica.cc:333] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:43.429628 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3679480e55444d0d935f262217e44485 (table default.Table_fa95c378428d48efba91d72f220584de [id=5579cbeef0624d4a8cb8beeac55362e9]). Expected version 1 got 0
I20260505 20:13:43.432860 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:43.433911 9270 raft_consensus.cc:2243] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.434092 9270 raft_consensus.cc:2272] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.434682 9270 ts_tablet_manager.cc:1916] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.442782 8058 tablet_bootstrap.cc:492] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:43.442943 8058 ts_tablet_manager.cc:1403] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.002s
I20260505 20:13:43.443751 8058 raft_consensus.cc:359] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.443924 8058 raft_consensus.cc:385] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.443975 8058 raft_consensus.cc:740] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.444579 8058 consensus_queue.cc:260] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.445549 8058 ts_tablet_manager.cc:1434] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:43.446066 8058 tablet_bootstrap.cc:492] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:43.450122 8058 tablet_bootstrap.cc:654] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.450012 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
W20260505 20:13:43.454681 7598 consensus_peers.cc:597] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:43.454665 9121 ts_tablet_manager.cc:1929] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.456235 8053 tablet_bootstrap.cc:492] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:43.456419 8053 ts_tablet_manager.cc:1403] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 1.074s user 0.022s sys 0.001s
I20260505 20:13:43.456423 9121 log.cc:1199] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b91ccd9761ee4386b9e80cb9c9cfa975
I20260505 20:13:43.457213 9429 raft_consensus.cc:493] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.457347 9429 raft_consensus.cc:515] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.458041 9429 leader_election.cc:290] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.458655 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:43.458683 8053 raft_consensus.cc:359] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.458825 8053 raft_consensus.cc:385] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.458871 8053 raft_consensus.cc:740] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
W20260505 20:13:43.459089 7870 leader_election.cc:343] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.459430 8054 tablet_bootstrap.cc:492] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.459344 8053 consensus_queue.cc:260] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.459647 8054 ts_tablet_manager.cc:1403] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.002s
I20260505 20:13:43.459406 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:43.461063 8054 raft_consensus.cc:359] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.461346 8054 raft_consensus.cc:385] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.461469 8054 raft_consensus.cc:740] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.461855 8054 consensus_queue.cc:260] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.463609 8054 ts_tablet_manager.cc:1434] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:43.464702 8053 ts_tablet_manager.cc:1434] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260505 20:13:43.465024 8053 tablet_bootstrap.cc:492] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:43.466815 9121 ts_tablet_manager.cc:1950] T b91ccd9761ee4386b9e80cb9c9cfa975 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.467423 8054 tablet_bootstrap.cc:492] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.469009 9156 raft_consensus.cc:493] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.463539 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:43.469178 9156 raft_consensus.cc:515] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.469882 7411 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:43.471581 9156 leader_election.cc:290] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.471835 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.472083 7926 raft_consensus.cc:2393] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:43.473109 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:43.473258 7934 raft_consensus.cc:3060] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.475960 7934 raft_consensus.cc:2468] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:43.476346 9270 ts_tablet_manager.cc:1929] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.476446 9270 log.cc:1199] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c6acad22190b402d892d06ff97bd9476
I20260505 20:13:43.476830 9270 ts_tablet_manager.cc:1950] T c6acad22190b402d892d06ff97bd9476 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:43.477131 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 91) took 6213 ms. Trace:
I20260505 20:13:43.477226 9270 rpcz_store.cc:276] 0505 20:13:37.263468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.268640 (+ 5172us) service_pool.cc:224] Handling call
0505 20:13:43.423063 (+6154423us) ts_tablet_manager.cc:1151] Deleting tablet c6acad22190b402d892d06ff97bd9476
0505 20:13:43.423072 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.462213 (+ 39141us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.476280 (+ 14067us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.477116 (+ 836us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10559,"tablet-delete.queue_time_us":6154309}
I20260505 20:13:43.477800 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c6acad22190b402d892d06ff97bd9476 (table default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]) successfully deleted
I20260505 20:13:43.478405 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 76) took 7669 ms. Trace:
I20260505 20:13:43.478989 9121 rpcz_store.cc:276] 0505 20:13:35.809309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812174 (+ 2865us) service_pool.cc:224] Handling call
0505 20:13:43.333860 (+7521686us) ts_tablet_manager.cc:1151] Deleting tablet b91ccd9761ee4386b9e80cb9c9cfa975
0505 20:13:43.333874 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.385852 (+ 51978us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.454107 (+ 68255us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.478387 (+ 24280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7521269}
I20260505 20:13:43.480643 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b91ccd9761ee4386b9e80cb9c9cfa975 (table default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]) successfully deleted
I20260505 20:13:43.481459 9121 tablet_replica.cc:333] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.481809 9270 tablet_replica.cc:333] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:43.482060 9270 raft_consensus.cc:2243] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.482393 9270 raft_consensus.cc:2272] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.482880 9121 raft_consensus.cc:2243] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.483716 9121 raft_consensus.cc:2272] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.483278 9270 ts_tablet_manager.cc:1916] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.484591 8054 tablet_bootstrap.cc:654] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.490331 8058 tablet_bootstrap.cc:492] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:43.490578 8058 ts_tablet_manager.cc:1403] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
I20260505 20:13:43.492300 8053 tablet_bootstrap.cc:654] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.492194 8058 raft_consensus.cc:359] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.492532 8058 raft_consensus.cc:385] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.492663 8058 raft_consensus.cc:740] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.493077 8058 consensus_queue.cc:260] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.488723 9121 ts_tablet_manager.cc:1916] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.494092 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34883b630a87480f953facb44615ef65" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.496093 7869 leader_election.cc:304] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.497260 9429 raft_consensus.cc:2749] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260505 20:13:43.496243 8058 ts_tablet_manager.cc:1434] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:43.510689 8058 tablet_bootstrap.cc:492] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:43.512099 7869 leader_election.cc:343] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.512331 7869 leader_election.cc:304] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.512821 9429 raft_consensus.cc:2749] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.522593 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:43.522706 8054 tablet_bootstrap.cc:492] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.522970 8054 ts_tablet_manager.cc:1403] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.000s
I20260505 20:13:43.523825 9156 raft_consensus.cc:493] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.523970 9156 raft_consensus.cc:515] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.524621 9156 leader_election.cc:290] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:43.525230 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.525475 7926 raft_consensus.cc:2468] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:43.525893 7598 leader_election.cc:304] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.526178 9758 raft_consensus.cc:2804] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:43.526253 9758 raft_consensus.cc:493] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:43.526319 9758 raft_consensus.cc:3060] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.530910 9429 raft_consensus.cc:493] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.531520 9429 raft_consensus.cc:515] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.532411 9429 leader_election.cc:290] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:43.534000 7869 leader_election.cc:343] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.534158 7869 leader_election.cc:304] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.534574 9619 raft_consensus.cc:2749] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.536273 7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:43.536347 9758 raft_consensus.cc:515] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.536985 9758 leader_election.cc:290] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:43.537528 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:43.537703 7934 raft_consensus.cc:3060] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.538789 7655 raft_consensus.cc:1275] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260505 20:13:43.539225 7870 leader_election.cc:343] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.539604 9469 consensus_queue.cc:1048] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260505 20:13:43.525321 8054 raft_consensus.cc:359] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.544975 8054 raft_consensus.cc:385] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.546077 8054 raft_consensus.cc:740] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.550181 7934 raft_consensus.cc:2468] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:43.550704 7598 leader_election.cc:304] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.551030 9758 raft_consensus.cc:2804] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:43.551208 9758 raft_consensus.cc:697] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:43.551123 8058 tablet_bootstrap.cc:654] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.552053 9758 consensus_queue.cc:237] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.549113 8054 consensus_queue.cc:260] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:43.554114 7869 leader_election.cc:343] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: d138d27f444f45d28acdc7d72a9649f5
W20260505 20:13:43.557081 7869 leader_election.cc:343] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.557231 7869 leader_election.cc:304] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.557623 9429 raft_consensus.cc:2749] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.558301 7869 leader_election.cc:343] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.558434 7869 leader_election.cc:304] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.558795 9429 raft_consensus.cc:2749] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.560973 7869 leader_election.cc:343] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.561115 7869 leader_election.cc:304] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.561512 9619 raft_consensus.cc:2749] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.561973 7869 leader_election.cc:343] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.562100 7869 leader_election.cc:304] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.562330 9619 raft_consensus.cc:2749] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.562671 7869 leader_election.cc:343] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.564864 9270 ts_tablet_manager.cc:1929] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.566620 8054 ts_tablet_manager.cc:1434] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.043s user 0.002s sys 0.002s
I20260505 20:13:43.567888 7869 leader_election.cc:304] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.568162 9429 raft_consensus.cc:2749] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.568533 7869 leader_election.cc:343] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.568667 7869 leader_election.cc:304] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.568885 9429 raft_consensus.cc:2749] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.569294 7869 leader_election.cc:343] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.569420 7869 leader_election.cc:304] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.569650 9429 raft_consensus.cc:2749] T 9f91a58d306e4dd7ab515498aa6ab32b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:43.570024 7869 leader_election.cc:343] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.570145 7869 leader_election.cc:304] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:43.572925 9429 raft_consensus.cc:2749] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.567816 9270 log.cc:1199] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/1218bd76239540be9a93ca455ba3eb47
I20260505 20:13:43.578509 8054 tablet_bootstrap.cc:492] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.580202 8054 tablet_bootstrap.cc:654] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.582609 9270 ts_tablet_manager.cc:1950] T 1218bd76239540be9a93ca455ba3eb47 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:43.585175 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 90) took 6321 ms. Trace:
I20260505 20:13:43.586014 9270 rpcz_store.cc:276] 0505 20:13:37.263352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.268870 (+ 5518us) service_pool.cc:224] Handling call
0505 20:13:43.477538 (+6208668us) ts_tablet_manager.cc:1151] Deleting tablet 1218bd76239540be9a93ca455ba3eb47
0505 20:13:43.477547 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.512313 (+ 34766us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.563889 (+ 51576us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.584985 (+ 21096us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6208534}
I20260505 20:13:43.588326 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 1218bd76239540be9a93ca455ba3eb47 (table default.Table_cfbc6470d8d34b93a3d1434dfa9df8cf [id=813ff9cab8554a79a0b9b5a01f63127c]) successfully deleted
I20260505 20:13:43.589488 9270 tablet_replica.cc:333] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:43.590202 8058 tablet_bootstrap.cc:492] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:43.590342 8058 ts_tablet_manager.cc:1403] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.000s
I20260505 20:13:43.595433 8053 tablet_bootstrap.cc:492] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:43.599334 8053 ts_tablet_manager.cc:1403] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.134s user 0.003s sys 0.000s
I20260505 20:13:43.591200 8058 raft_consensus.cc:359] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.602304 8058 raft_consensus.cc:385] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.602389 8058 raft_consensus.cc:740] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.602640 8058 consensus_queue.cc:260] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:43.603431 7598 consensus_peers.cc:597] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56bd0f4254424c979f90da0400e0ec70. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:43.603536 8058 ts_tablet_manager.cc:1434] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260505 20:13:43.604578 8058 tablet_bootstrap.cc:492] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:43.605608 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.605856 7921 raft_consensus.cc:2468] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:43.611552 8054 tablet_bootstrap.cc:492] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.611720 8054 ts_tablet_manager.cc:1403] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.001s
I20260505 20:13:43.612543 8054 raft_consensus.cc:359] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.612752 8054 raft_consensus.cc:385] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.612818 8054 raft_consensus.cc:740] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.613022 8054 consensus_queue.cc:260] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:43.613546 8054 ts_tablet_manager.cc:1434] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:43.617133 9271 ts_tablet_manager.cc:1929] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.620297 7662 raft_consensus.cc:3060] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.626360 9121 ts_tablet_manager.cc:1929] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:43.627962 7659 raft_consensus.cc:3060] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.629119 9121 log.cc:1199] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:43.632845 8058 tablet_bootstrap.cc:654] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.634605 9271 log.cc:1199] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/249cad23ecfe4b9dbbd34f2a1fa899e3
I20260505 20:13:43.635042 9271 ts_tablet_manager.cc:1950] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:43.635428 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 106) took 6376 ms. Trace:
I20260505 20:13:43.635519 9271 rpcz_store.cc:276] 0505 20:13:37.258804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.259947 (+ 1143us) service_pool.cc:224] Handling call
0505 20:13:43.389353 (+6129406us) ts_tablet_manager.cc:1151] Deleting tablet 249cad23ecfe4b9dbbd34f2a1fa899e3
0505 20:13:43.389363 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.550540 (+161177us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.617064 (+ 66524us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.635413 (+ 18349us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6129247}
I20260505 20:13:43.636070 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 (table default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]) successfully deleted
I20260505 20:13:43.636430 9271 tablet_replica.cc:333] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:43.636694 9271 raft_consensus.cc:2243] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.626583 8053 raft_consensus.cc:359] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.631893 9138 consensus_queue.cc:1048] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:43.636924 9121 ts_tablet_manager.cc:1950] T 2540ed5144664ec0bfe0b548a5386176 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.634207 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.592159 9270 raft_consensus.cc:2243] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.600525 7596 leader_election.cc:304] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:43.637996 9270 raft_consensus.cc:2272] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.638109 9758 raft_consensus.cc:2749] T 7e5497df41ba46cc9228c0debd18551b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.638617 9270 ts_tablet_manager.cc:1916] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:43.640319 7596 consensus_peers.cc:597] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d5ed062508b411eb0fa5a14637830ea. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:43.640717 7596 leader_election.cc:343] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:43.640996 7596 leader_election.cc:343] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.641279 7596 leader_election.cc:304] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:43.641618 9398 raft_consensus.cc:2749] T 2faf7c64c3c340ceb8c87e416a32a7ed P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.638338 8053 raft_consensus.cc:385] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.642769 8053 raft_consensus.cc:740] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.643018 8053 consensus_queue.cc:260] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.643720 8053 ts_tablet_manager.cc:1434] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.040s user 0.001s sys 0.000s
I20260505 20:13:43.643781 9704 consensus_queue.cc:1048] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:43.644351 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 06ad0e52c8b346cd920b35701fb23328 (DEFAULT_TABLE table=default.Table_095ae1e51561487880dc7e039bc823b2 [id=0c2a5400bd6e4ace87172b06b922cec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.644790 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06ad0e52c8b346cd920b35701fb23328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.647464 9270 ts_tablet_manager.cc:1929] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.647562 9270 log.cc:1199] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b8d50ceda0ff4bb6b49920c922dfee9e
I20260505 20:13:43.647941 9270 ts_tablet_manager.cc:1950] T b8d50ceda0ff4bb6b49920c922dfee9e P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:43.650072 7632 tablet_service.cc:1511] Processing CreateTablet for tablet dbd23fcf8a2b423ba77086aa4e01c50f (DEFAULT_TABLE table=default.Table_395edb36b813456893ae9293c5e20b87 [id=6118f49b291140a39d0a0ff0db05a18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.650485 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd23fcf8a2b423ba77086aa4e01c50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.651080 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 77) took 7841 ms. Trace:
I20260505 20:13:43.654235 9707 consensus_queue.cc:1048] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:43.652263 9121 rpcz_store.cc:276] 0505 20:13:35.809402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812361 (+ 2959us) service_pool.cc:224] Handling call
0505 20:13:43.480152 (+7667791us) ts_tablet_manager.cc:1151] Deleting tablet 2540ed5144664ec0bfe0b548a5386176
0505 20:13:43.481253 (+ 1101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.562383 (+ 81130us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.625096 (+ 62713us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.650808 (+ 25712us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7667680}
I20260505 20:13:43.655802 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 62df88ab79664dfe8a912d00ab9a945f (DEFAULT_TABLE table=default.Table_a412611fdfad4801a55a136337ab2b3f [id=035fa286b2214f56b11c07eb3146f44c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.656193 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62df88ab79664dfe8a912d00ab9a945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.657352 9121 tablet_replica.cc:333] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.660796 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 75db7e7cc87a46d4aacdffd16ae9095a (DEFAULT_TABLE table=default.Table_644d5f5207de4cbb865d56cd25c942a7 [id=50ea6047f97a4c6face2018c425c45fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.661201 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75db7e7cc87a46d4aacdffd16ae9095a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.660696 9121 raft_consensus.cc:2243] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:43.662628 8054 tablet_bootstrap.cc:492] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.664719 9138 consensus_queue.cc:1048] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:43.666222 8054 tablet_bootstrap.cc:654] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.666693 7768 tablet_service.cc:1511] Processing CreateTablet for tablet dbd23fcf8a2b423ba77086aa4e01c50f (DEFAULT_TABLE table=default.Table_395edb36b813456893ae9293c5e20b87 [id=6118f49b291140a39d0a0ff0db05a18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.663040 9121 raft_consensus.cc:2272] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.667101 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd23fcf8a2b423ba77086aa4e01c50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.669541 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 106) took 6401 ms. Trace:
I20260505 20:13:43.671123 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 75db7e7cc87a46d4aacdffd16ae9095a (DEFAULT_TABLE table=default.Table_644d5f5207de4cbb865d56cd25c942a7 [id=50ea6047f97a4c6face2018c425c45fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.671123 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 62df88ab79664dfe8a912d00ab9a945f (DEFAULT_TABLE table=default.Table_a412611fdfad4801a55a136337ab2b3f [id=035fa286b2214f56b11c07eb3146f44c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.671515 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75db7e7cc87a46d4aacdffd16ae9095a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.671684 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62df88ab79664dfe8a912d00ab9a945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.672722 9121 ts_tablet_manager.cc:1916] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.674014 7771 tablet_service.cc:1511] Processing CreateTablet for tablet a642697189ca4248b344e3d7065d9934 (DEFAULT_TABLE table=default.Table_ca23c20fcbcc495cbd0e7c3c21341d3d [id=daf1155e57cc4da0b5dc6c30031d84f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.674336 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a642697189ca4248b344e3d7065d9934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.674352 7627 tablet_service.cc:1511] Processing CreateTablet for tablet f0ec748584d04ceaa72de74e9e8c1acf (DEFAULT_TABLE table=default.Table_7c8e6cbb25e64aa99b0470627ffebb7b [id=f565c46f82dc43a88f164099f721a7fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.675011 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ec748584d04ceaa72de74e9e8c1acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.676097 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 06ad0e52c8b346cd920b35701fb23328 (DEFAULT_TABLE table=default.Table_095ae1e51561487880dc7e039bc823b2 [id=0c2a5400bd6e4ace87172b06b922cec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.676422 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06ad0e52c8b346cd920b35701fb23328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.694612 7766 tablet_service.cc:1511] Processing CreateTablet for tablet f0ec748584d04ceaa72de74e9e8c1acf (DEFAULT_TABLE table=default.Table_7c8e6cbb25e64aa99b0470627ffebb7b [id=f565c46f82dc43a88f164099f721a7fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.694612 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 8da300a3c6a743829936ecbfcd9439b5 (DEFAULT_TABLE table=default.Table_74794425f97a418ab4f09ff2f3600476 [id=573a8468a590436f90382cb8cccbfc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.695437 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 2540ed5144664ec0bfe0b548a5386176 (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]) successfully deleted
I20260505 20:13:43.695475 9429 raft_consensus.cc:493] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.695601 9429 raft_consensus.cc:515] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.696631 9429 leader_election.cc:290] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.697165 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da300a3c6a743829936ecbfcd9439b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.698546 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8bd19470294a1db91855afe49be6a5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:43.699038 7870 leader_election.cc:343] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.703444 9704 raft_consensus.cc:493] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.703637 9704 raft_consensus.cc:515] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.703670 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 8da300a3c6a743829936ecbfcd9439b5 (DEFAULT_TABLE table=default.Table_74794425f97a418ab4f09ff2f3600476 [id=573a8468a590436f90382cb8cccbfc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.704120 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da300a3c6a743829936ecbfcd9439b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.704443 9704 leader_election.cc:290] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:43.705729 7598 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:43.707085 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ec748584d04ceaa72de74e9e8c1acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.707127 9270 rpcz_store.cc:276] 0505 20:13:37.267894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.269363 (+ 1469us) service_pool.cc:224] Handling call
0505 20:13:43.588897 (+6319534us) ts_tablet_manager.cc:1151] Deleting tablet b8d50ceda0ff4bb6b49920c922dfee9e
0505 20:13:43.588907 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.644167 (+ 55260us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.647414 (+ 3247us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.669523 (+ 22109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6319127}
I20260505 20:13:43.698160 7636 tablet_service.cc:1511] Processing CreateTablet for tablet a642697189ca4248b344e3d7065d9934 (DEFAULT_TABLE table=default.Table_ca23c20fcbcc495cbd0e7c3c21341d3d [id=daf1155e57cc4da0b5dc6c30031d84f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.714329 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a642697189ca4248b344e3d7065d9934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.714633 7916 tablet_service.cc:1511] Processing CreateTablet for tablet 06ad0e52c8b346cd920b35701fb23328 (DEFAULT_TABLE table=default.Table_095ae1e51561487880dc7e039bc823b2 [id=0c2a5400bd6e4ace87172b06b922cec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.715020 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06ad0e52c8b346cd920b35701fb23328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.715325 8054 tablet_bootstrap.cc:492] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.715467 8054 ts_tablet_manager.cc:1403] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.053s user 0.012s sys 0.006s
I20260505 20:13:43.716393 8054 raft_consensus.cc:359] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.716578 8054 raft_consensus.cc:385] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.716636 8054 raft_consensus.cc:740] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.716854 8054 consensus_queue.cc:260] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.718793 8054 ts_tablet_manager.cc:1434] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:43.719168 8054 tablet_bootstrap.cc:492] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.723280 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b8d50ceda0ff4bb6b49920c922dfee9e (table default.Table_4236c5f7709145e588050eb7b3d4ae44 [id=4073d8bcda1046afb42e5be3af1a9acf]) successfully deleted
I20260505 20:13:43.725769 8054 tablet_bootstrap.cc:654] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.734980 7916 tablet_service.cc:1511] Processing CreateTablet for tablet dbd23fcf8a2b423ba77086aa4e01c50f (DEFAULT_TABLE table=default.Table_395edb36b813456893ae9293c5e20b87 [id=6118f49b291140a39d0a0ff0db05a18a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.735518 7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd23fcf8a2b423ba77086aa4e01c50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.738590 7632 tablet_service.cc:1511] Processing CreateTablet for tablet d74cb1499c624d5c964ff063bae4bfd7 (DEFAULT_TABLE table=default.Table_4251423f803b4acfaecce4656a6e54a7 [id=56c48703464540d7b16ddab713d0eace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.739045 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74cb1499c624d5c964ff063bae4bfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.739512 7768 tablet_service.cc:1511] Processing CreateTablet for tablet d74cb1499c624d5c964ff063bae4bfd7 (DEFAULT_TABLE table=default.Table_4251423f803b4acfaecce4656a6e54a7 [id=56c48703464540d7b16ddab713d0eace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.739988 7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74cb1499c624d5c964ff063bae4bfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.743355 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 65bb89bfde584ab8afebac7ad3a3f576 (DEFAULT_TABLE table=default.Table_9c7e297fd6744f3e93ff2913562e202c [id=73cb06ffd1c6426e89454f5ff50c9b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.744114 8053 tablet_bootstrap.cc:492] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:43.746026 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 62df88ab79664dfe8a912d00ab9a945f (DEFAULT_TABLE table=default.Table_a412611fdfad4801a55a136337ab2b3f [id=035fa286b2214f56b11c07eb3146f44c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.746613 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62df88ab79664dfe8a912d00ab9a945f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.748368 9270 tablet_replica.cc:333] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:43.748641 9270 raft_consensus.cc:2243] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.748991 9270 raft_consensus.cc:2272] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.749617 9270 ts_tablet_manager.cc:1916] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.751631 7631 tablet_service.cc:1511] Processing CreateTablet for tablet 0de6ef4b456148ed8cc6e8237801ed11 (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.752269 8054 tablet_bootstrap.cc:492] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.752429 8054 ts_tablet_manager.cc:1403] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20260505 20:13:43.752573 7631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de6ef4b456148ed8cc6e8237801ed11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.753311 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bb89bfde584ab8afebac7ad3a3f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.754331 8054 raft_consensus.cc:359] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.754515 8054 raft_consensus.cc:385] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.754573 8054 raft_consensus.cc:740] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.754781 8054 consensus_queue.cc:260] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.755292 8054 ts_tablet_manager.cc:1434] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260505 20:13:43.755575 8054 tablet_bootstrap.cc:492] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.757591 8054 tablet_bootstrap.cc:654] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.760936 9429 raft_consensus.cc:493] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.760934 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 547609fc45594f7cb0ce9e80397a47f7 (DEFAULT_TABLE table=default.Table_336bd702d04447f18b2f62bfa31d916e [id=821d2341264941569aeb519dd2e29774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.761127 9429 raft_consensus.cc:515] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.761320 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547609fc45594f7cb0ce9e80397a47f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.762215 9429 leader_election.cc:290] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.765944 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:43.766599 7870 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.768245 7917 tablet_service.cc:1511] Processing CreateTablet for tablet 75db7e7cc87a46d4aacdffd16ae9095a (DEFAULT_TABLE table=default.Table_644d5f5207de4cbb865d56cd25c942a7 [id=50ea6047f97a4c6face2018c425c45fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.768718 7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75db7e7cc87a46d4aacdffd16ae9095a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.769811 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 874a6887ce9a4126a7a7621230c467ac (DEFAULT_TABLE table=default.Table_bb6f81b1a5e747caa2a65e88e760cb92 [id=200201c9069a442196e7ac653f3f841b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.772944 8054 tablet_bootstrap.cc:492] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.773103 8054 ts_tablet_manager.cc:1403] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260505 20:13:43.774030 8054 raft_consensus.cc:359] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.774230 8054 raft_consensus.cc:385] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.774300 8054 raft_consensus.cc:740] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.774521 8054 consensus_queue.cc:260] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.763581 7774 tablet_service.cc:1511] Processing CreateTablet for tablet 547609fc45594f7cb0ce9e80397a47f7 (DEFAULT_TABLE table=default.Table_336bd702d04447f18b2f62bfa31d916e [id=821d2341264941569aeb519dd2e29774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.775230 8054 ts_tablet_manager.cc:1434] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:43.775390 7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547609fc45594f7cb0ce9e80397a47f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.775604 8054 tablet_bootstrap.cc:492] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.777487 8054 tablet_bootstrap.cc:654] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.780378 8053 tablet_bootstrap.cc:654] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.781018 7914 tablet_service.cc:1511] Processing CreateTablet for tablet a642697189ca4248b344e3d7065d9934 (DEFAULT_TABLE table=default.Table_ca23c20fcbcc495cbd0e7c3c21341d3d [id=daf1155e57cc4da0b5dc6c30031d84f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.781777 7913 tablet_service.cc:1511] Processing CreateTablet for tablet f0ec748584d04ceaa72de74e9e8c1acf (DEFAULT_TABLE table=default.Table_7c8e6cbb25e64aa99b0470627ffebb7b [id=f565c46f82dc43a88f164099f721a7fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.790086 8054 tablet_bootstrap.cc:492] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.790253 8054 ts_tablet_manager.cc:1403] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260505 20:13:43.791134 8054 raft_consensus.cc:359] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.791312 8054 raft_consensus.cc:385] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.791388 8054 raft_consensus.cc:740] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.791597 8054 consensus_queue.cc:260] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.792529 8054 ts_tablet_manager.cc:1434] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:43.793408 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:43.796154 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:43.798045 7906 tablet_service.cc:1511] Processing CreateTablet for tablet 8da300a3c6a743829936ecbfcd9439b5 (DEFAULT_TABLE table=default.Table_74794425f97a418ab4f09ff2f3600476 [id=573a8468a590436f90382cb8cccbfc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.798519 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:43.799760 7907 tablet_service.cc:1511] Processing CreateTablet for tablet d74cb1499c624d5c964ff063bae4bfd7 (DEFAULT_TABLE table=default.Table_4251423f803b4acfaecce4656a6e54a7 [id=56c48703464540d7b16ddab713d0eace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.799583 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:43.800210 7901 tablet_service.cc:1511] Processing CreateTablet for tablet 65bb89bfde584ab8afebac7ad3a3f576 (DEFAULT_TABLE table=default.Table_9c7e297fd6744f3e93ff2913562e202c [id=73cb06ffd1c6426e89454f5ff50c9b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.800539 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 0de6ef4b456148ed8cc6e8237801ed11 (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.800839 7909 tablet_service.cc:1511] Processing CreateTablet for tablet 547609fc45594f7cb0ce9e80397a47f7 (DEFAULT_TABLE table=default.Table_336bd702d04447f18b2f62bfa31d916e [id=821d2341264941569aeb519dd2e29774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.801230 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:43.802721 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:43.804709 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:43.805384 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
W20260505 20:13:43.806075 7596 leader_election.cc:343] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:43.806759 7596 leader_election.cc:343] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.806943 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]). Expected version 2 got 0
I20260505 20:13:43.807248 7596 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:43.807499 9757 raft_consensus.cc:3060] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.808451 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:43.810321 7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a642697189ca4248b344e3d7065d9934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.810465 8054 tablet_bootstrap.cc:492] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.811380 7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ec748584d04ceaa72de74e9e8c1acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.811264 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:43.813198 8054 tablet_bootstrap.cc:654] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.813880 7906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da300a3c6a743829936ecbfcd9439b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.815034 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:43.815928 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:43.816455 7901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bb89bfde584ab8afebac7ad3a3f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.818135 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:43.818804 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:43.821890 7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547609fc45594f7cb0ce9e80397a47f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.824445 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:43.825100 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:43.825917 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de6ef4b456148ed8cc6e8237801ed11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.826133 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:43.827422 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:43.828037 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:43.828589 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:43.829277 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:43.829891 7907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74cb1499c624d5c964ff063bae4bfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.830385 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:43.831169 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:43.832322 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:43.832998 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:43.833853 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:43.834510 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:43.837461 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:43.841634 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:43.844074 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:43.845213 8058 tablet_bootstrap.cc:492] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:43.845377 8058 ts_tablet_manager.cc:1403] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.241s user 0.003s sys 0.000s
I20260505 20:13:43.846875 8058 raft_consensus.cc:359] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.847280 8058 raft_consensus.cc:385] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.847373 8058 raft_consensus.cc:740] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.847448 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3679480e55444d0d935f262217e44485 (table default.Table_fa95c378428d48efba91d72f220584de [id=5579cbeef0624d4a8cb8beeac55362e9]). Expected version 1 got 0
I20260505 20:13:43.847671 8058 consensus_queue.cc:260] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.848960 9757 raft_consensus.cc:2749] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.848848 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:43.849952 7912 tablet_service.cc:1511] Processing CreateTablet for tablet 874a6887ce9a4126a7a7621230c467ac (DEFAULT_TABLE table=default.Table_bb6f81b1a5e747caa2a65e88e760cb92 [id=200201c9069a442196e7ac653f3f841b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.850378 7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 874a6887ce9a4126a7a7621230c467ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.850165 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:43.853219 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:43.853669 8054 tablet_bootstrap.cc:492] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.853873 8054 ts_tablet_manager.cc:1403] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.008s
I20260505 20:13:43.854741 8054 raft_consensus.cc:359] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.854936 8054 raft_consensus.cc:385] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.855015 8054 raft_consensus.cc:740] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.855225 8054 consensus_queue.cc:260] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.855751 8054 ts_tablet_manager.cc:1434] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:43.856030 8054 tablet_bootstrap.cc:492] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.856559 7413 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:43.771423 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 874a6887ce9a4126a7a7621230c467ac (DEFAULT_TABLE table=default.Table_bb6f81b1a5e747caa2a65e88e760cb92 [id=200201c9069a442196e7ac653f3f841b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.861558 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 874a6887ce9a4126a7a7621230c467ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.863131 8054 tablet_bootstrap.cc:654] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.774477 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.764113 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 0de6ef4b456148ed8cc6e8237801ed11 (DEFAULT_TABLE table=default.Table_4a3093344fce42508208b7b460168409 [id=7aedeb24030a4babb71b5b273f166143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.800731 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.803556 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.867231 7790 raft_consensus.cc:2468] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:43.867888 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de6ef4b456148ed8cc6e8237801ed11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.867367 8058 ts_tablet_manager.cc:1434] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s
I20260505 20:13:43.803920 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:43.804251 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.804563 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.805218 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.805406 7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:43.860698 9847 tablet.cc:1724] T 3679480e55444d0d935f262217e44485 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:43.872797 7787 raft_consensus.cc:3060] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.873467 9271 raft_consensus.cc:2272] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.885208 8054 tablet_bootstrap.cc:492] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.885397 8054 ts_tablet_manager.cc:1403] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260505 20:13:43.885936 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 874a6887ce9a4126a7a7621230c467ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.886330 8054 raft_consensus.cc:359] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.886576 8054 raft_consensus.cc:385] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.886659 8054 raft_consensus.cc:740] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.886873 8054 consensus_queue.cc:260] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.887367 8054 ts_tablet_manager.cc:1434] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:43.887658 8054 tablet_bootstrap.cc:492] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.889230 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 65bb89bfde584ab8afebac7ad3a3f576 (DEFAULT_TABLE table=default.Table_9c7e297fd6744f3e93ff2913562e202c [id=73cb06ffd1c6426e89454f5ff50c9b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:43.889470 8054 tablet_bootstrap.cc:654] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.889887 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65bb89bfde584ab8afebac7ad3a3f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:43.891577 9271 ts_tablet_manager.cc:1916] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:43.893009 7598 consensus_peers.cc:597] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 949fecb197084426b5a6adb959f5c886. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:43.896999 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 168525us
I20260505 20:13:43.901149 9429 raft_consensus.cc:493] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.901338 9429 raft_consensus.cc:515] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.902792 9429 leader_election.cc:290] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:43.902889 9121 ts_tablet_manager.cc:1929] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.903020 9121 log.cc:1199] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:43.903438 9121 ts_tablet_manager.cc:1950] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:43.903448 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4860b4f80ef34a799fa9f9607aac844a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:43.904199 7870 leader_election.cc:343] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.916397 8053 tablet_bootstrap.cc:492] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:43.916668 8053 ts_tablet_manager.cc:1403] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.173s user 0.002s sys 0.002s
I20260505 20:13:43.917534 8053 raft_consensus.cc:359] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.917816 8053 raft_consensus.cc:385] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.917933 8053 raft_consensus.cc:740] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.918257 8053 consensus_queue.cc:260] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.918087 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 78) took 8108 ms. Trace:
I20260505 20:13:43.919085 8053 ts_tablet_manager.cc:1434] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:43.918890 9121 rpcz_store.cc:276] 0505 20:13:35.809490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812491 (+ 3001us) service_pool.cc:224] Handling call
0505 20:13:43.656541 (+7844050us) ts_tablet_manager.cc:1151] Deleting tablet e2554ecdcfd64ca6ba75e6b4077a5ab3
0505 20:13:43.656816 (+ 275us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.791055 (+134239us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.902829 (+111774us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.917804 (+ 14975us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7843684}
I20260505 20:13:43.922330 9121 tablet_replica.cc:333] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:43.923040 8054 tablet_bootstrap.cc:492] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:43.923172 8054 ts_tablet_manager.cc:1403] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
I20260505 20:13:43.923945 8054 raft_consensus.cc:359] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.924118 8054 raft_consensus.cc:385] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:43.924182 8054 raft_consensus.cc:740] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:43.924443 8054 consensus_queue.cc:260] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.924369 9121 raft_consensus.cc:2243] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:43.925127 8054 ts_tablet_manager.cc:1434] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:43.925410 8054 tablet_bootstrap.cc:492] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:43.926800 9121 raft_consensus.cc:2272] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:43.930986 9270 ts_tablet_manager.cc:1929] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.931535 9121 ts_tablet_manager.cc:1916] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:43.932268 9270 log.cc:1199] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f3b3c646af9843048382e77b138aea44
I20260505 20:13:43.937158 9270 ts_tablet_manager.cc:1950] T f3b3c646af9843048382e77b138aea44 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:43.938195 7596 leader_election.cc:343] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:43.938849 7596 leader_election.cc:343] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.939430 7596 leader_election.cc:304] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:43.939709 9398 raft_consensus.cc:2749] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:43.947438 8058 tablet_bootstrap.cc:492] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:43.949254 8058 tablet_bootstrap.cc:654] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.954071 9429 raft_consensus.cc:493] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.954241 9429 raft_consensus.cc:515] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.975952 9398 raft_consensus.cc:493] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:43.976148 9398 raft_consensus.cc:515] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.976799 9398 leader_election.cc:290] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.977136 9121 ts_tablet_manager.cc:1929] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:43.979372 9121 log.cc:1199] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1e453fdf9a424fe8974076fac3ad74bf
I20260505 20:13:43.980609 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:43.980846 7924 raft_consensus.cc:2468] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:43.981715 8054 tablet_bootstrap.cc:654] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:43.985806 7598 leader_election.cc:304] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.986658 9758 raft_consensus.cc:2804] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:43.986742 9758 raft_consensus.cc:493] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:43.986804 9758 raft_consensus.cc:3060] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:43.987984 8053 tablet_bootstrap.cc:492] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:43.989426 9758 raft_consensus.cc:515] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.991950 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:43.992138 7924 raft_consensus.cc:3060] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:43.920970 7736 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:43.994745 7924 raft_consensus.cc:2468] T b53f88d2e8b34b69bd12f53b046ed4de P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:43.995558 7598 leader_election.cc:304] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:43.995940 9758 leader_election.cc:290] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:43.996148 9758 raft_consensus.cc:2804] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:43.996349 9758 raft_consensus.cc:697] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:43.996650 9758 consensus_queue.cc:237] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:43.998757 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:43.980485 9429 leader_election.cc:290] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:44.000715 7870 leader_election.cc:343] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:43.934284 7787 raft_consensus.cc:2468] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
W20260505 20:13:43.973349 7397 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a114db19f63346d9a67e9e3a8225caa4 consensus state has no leader
I20260505 20:13:43.971788 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:44.012044 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:44.012789 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:44.013446 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:44.014098 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:44.015978 9429 raft_consensus.cc:493] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.016191 9429 raft_consensus.cc:515] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.017200 9429 leader_election.cc:290] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.017798 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3535f0c31ad5451ea5bceeb50f756eef" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:44.018468 7870 leader_election.cc:343] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.018884 7737 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 54152.2us
I20260505 20:13:44.019335 9138 consensus_queue.cc:1048] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.020952 8053 tablet_bootstrap.cc:654] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:44.022063 7737 consensus_peers.cc:597] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 608bffbbc10141e8bd19f475b95bdc65. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:44.021942 9121 ts_tablet_manager.cc:1950] T 1e453fdf9a424fe8974076fac3ad74bf P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.033775 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 80) took 8223 ms. Trace:
I20260505 20:13:44.038137 7710 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:44.038071 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
W20260505 20:13:44.039388 7737 consensus_peers.cc:597] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0112c04befa14c48bb5b2e7dfb60dac7. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:44.040391 7737 leader_election.cc:304] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.040916 9138 raft_consensus.cc:2804] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:44.041035 9138 raft_consensus.cc:697] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:44.040380 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:44.041289 9138 consensus_queue.cc:237] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.041632 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 107) took 6771 ms. Trace:
I20260505 20:13:44.041720 9270 rpcz_store.cc:276] 0505 20:13:37.269711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.269881 (+ 170us) service_pool.cc:224] Handling call
0505 20:13:43.748229 (+6478348us) ts_tablet_manager.cc:1151] Deleting tablet f3b3c646af9843048382e77b138aea44
0505 20:13:43.748267 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.874265 (+125998us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.930078 (+ 55813us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.041614 (+111536us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6451003}
I20260505 20:13:44.042062 9270 tablet_replica.cc:333] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:44.042174 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f3b3c646af9843048382e77b138aea44 (table default.Table_74b14c0104de480d8de826c45ff1cf37 [id=7d374a42eb6149a183cce40f5c81326f]) successfully deleted
I20260505 20:13:44.042325 9270 raft_consensus.cc:2243] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.042486 9270 raft_consensus.cc:2272] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.042979 9270 ts_tablet_manager.cc:1916] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.045562 8058 tablet_bootstrap.cc:492] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:44.046221 8058 ts_tablet_manager.cc:1403] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.099s user 0.010s sys 0.002s
I20260505 20:13:44.046188 7410 catalog_manager.cc:5671] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:44.048991 9270 ts_tablet_manager.cc:1929] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:44.049100 9270 log.cc:1199] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/ee19f65120184eca9495513b68440b4f
I20260505 20:13:44.049394 9270 ts_tablet_manager.cc:1950] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:44.050199 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 108) took 6779 ms. Trace:
I20260505 20:13:44.050355 9270 rpcz_store.cc:276] 0505 20:13:37.270234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.270366 (+ 132us) service_pool.cc:224] Handling call
0505 20:13:44.042017 (+6771651us) ts_tablet_manager.cc:1151] Deleting tablet ee19f65120184eca9495513b68440b4f
0505 20:13:44.042026 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.046038 (+ 4012us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.048941 (+ 2903us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.050147 (+ 1206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112384,"tablet-delete.queue_time_us":6771502}
I20260505 20:13:44.051043 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet ee19f65120184eca9495513b68440b4f (table default.Table_5e1f5308c918489ba8d124bd3752d9b3 [id=08ec5e3e61a646439d9cce426e601d16]) successfully deleted
I20260505 20:13:44.051144 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 109) took 6780 ms. Trace:
I20260505 20:13:44.051287 9270 rpcz_store.cc:276] 0505 20:13:37.270330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.270885 (+ 555us) service_pool.cc:224] Handling call
0505 20:13:44.050878 (+6779993us) ts_tablet_manager.cc:1151] Deleting tablet 296494f478244052971e12a09f0b15b4
0505 20:13:44.050890 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.051097 (+ 207us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6779820}
I20260505 20:13:44.051829 9270 tablet_replica.cc:333] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:44.052132 8058 raft_consensus.cc:359] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.052336 8058 raft_consensus.cc:385] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.052390 8058 raft_consensus.cc:740] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.051579 7410 catalog_manager.cc:5671] T 7e5497df41ba46cc9228c0debd18551b P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:44.053542 8058 consensus_queue.cc:260] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:44.053961 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet 296494f478244052971e12a09f0b15b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 296494f478244052971e12a09f0b15b4 already in progress: creating tablet
I20260505 20:13:44.054594 8058 ts_tablet_manager.cc:1434] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260505 20:13:44.054877 8058 tablet_bootstrap.cc:492] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:44.036417 9121 rpcz_store.cc:276] 0505 20:13:35.809655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812612 (+ 2957us) service_pool.cc:224] Handling call
0505 20:13:43.921682 (+8109070us) ts_tablet_manager.cc:1151] Deleting tablet 1e453fdf9a424fe8974076fac3ad74bf
0505 20:13:43.921699 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:43.961127 (+ 39428us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:43.976830 (+ 15703us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.033553 (+ 56723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8108737}
I20260505 20:13:44.057431 8054 tablet_bootstrap.cc:492] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.057600 8054 ts_tablet_manager.cc:1403] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.132s user 0.007s sys 0.003s
I20260505 20:13:44.058475 8054 raft_consensus.cc:359] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.058645 8054 raft_consensus.cc:385] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.059235 8054 raft_consensus.cc:740] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.059337 8053 tablet_bootstrap.cc:492] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:44.059563 8053 ts_tablet_manager.cc:1403] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.001s
I20260505 20:13:44.059962 7737 leader_election.cc:304] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.060550 9842 raft_consensus.cc:2749] T 34883b630a87480f953facb44615ef65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:44.062309 7737 consensus_peers.cc:597] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98af33c2cdb24937858efdc7b638418f. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:44.063568 7737 leader_election.cc:304] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.063831 9842 raft_consensus.cc:2804] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:44.063901 9842 raft_consensus.cc:493] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:44.063987 9842 raft_consensus.cc:3060] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.067655 9842 raft_consensus.cc:515] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.064342 8053 raft_consensus.cc:359] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.068063 8053 raft_consensus.cc:385] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.068152 8053 raft_consensus.cc:740] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.068356 8053 consensus_queue.cc:260] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.069119 8053 ts_tablet_manager.cc:1434] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260505 20:13:44.069159 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:44.069562 8053 tablet_bootstrap.cc:492] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:44.069924 9842 leader_election.cc:290] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.069895 8054 consensus_queue.cc:260] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:44.070248 7736 leader_election.cc:343] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.071079 8054 ts_tablet_manager.cc:1434] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260505 20:13:44.070700 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:44.071820 8054 tablet_bootstrap.cc:492] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.075284 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]). Expected version 2 got 0
I20260505 20:13:44.085875 9121 tablet_replica.cc:333] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.086257 9121 raft_consensus.cc:2243] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:44.052178 9270 raft_consensus.cc:2243] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.085615 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:44.086887 9270 raft_consensus.cc:2272] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.087244 9121 raft_consensus.cc:2272] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.089388 9270 ts_tablet_manager.cc:1916] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.089517 9121 ts_tablet_manager.cc:1916] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.090521 9619 raft_consensus.cc:493] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.090654 9619 raft_consensus.cc:515] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.091238 9619 leader_election.cc:290] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.097108 8054 tablet_bootstrap.cc:654] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.098867 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:44.099558 7870 leader_election.cc:343] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.102659 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 (table default.Table_d991da0b0d3b445b918500a013593fe2 [id=600d612bf56b43cab35d268b714affa3]) successfully deleted
I20260505 20:13:44.103231 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1e453fdf9a424fe8974076fac3ad74bf (table default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f [id=ec71e6a4ae4d45d48362262a5d2bf526]) successfully deleted
I20260505 20:13:44.086934 8053 tablet_bootstrap.cc:654] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.105515 8058 tablet_bootstrap.cc:654] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.106184 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3aad2a9f37ac4cbfa127ecceb132c8bb (table default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214]). Expected version 1 got 0
I20260505 20:13:44.059345 9271 ts_tablet_manager.cc:1929] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.107472 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:44.107719 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:44.107893 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:44.108139 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:44.108351 9271 log.cc:1199] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c6acad22190b402d892d06ff97bd9476
I20260505 20:13:44.108580 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:44.108913 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:44.110297 9271 ts_tablet_manager.cc:1950] T c6acad22190b402d892d06ff97bd9476 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:44.121264 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 101) took 6862 ms. Trace:
I20260505 20:13:44.126187 9429 raft_consensus.cc:493] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.126331 9429 raft_consensus.cc:515] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.127044 9429 leader_election.cc:290] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:44.127825 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663d16be712b40859aa92277eab0c4a2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:44.128720 7870 leader_election.cc:343] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.129844 7869 leader_election.cc:343] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.130506 8054 tablet_bootstrap.cc:492] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.130705 8054 ts_tablet_manager.cc:1403] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.004s
I20260505 20:13:44.130456 7869 leader_election.cc:304] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.131824 9707 raft_consensus.cc:2749] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.132134 8054 raft_consensus.cc:359] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.132475 8054 raft_consensus.cc:385] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.132673 8054 raft_consensus.cc:740] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.133025 8054 consensus_queue.cc:260] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.134047 8054 ts_tablet_manager.cc:1434] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260505 20:13:44.126128 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee19f65120184eca9495513b68440b4f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.136642 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.137295 9271 rpcz_store.cc:276] 0505 20:13:37.258382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.260383 (+ 2001us) service_pool.cc:224] Handling call
0505 20:13:43.636369 (+6375986us) ts_tablet_manager.cc:1151] Deleting tablet c6acad22190b402d892d06ff97bd9476
0505 20:13:43.636381 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.028820 (+392439us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.059289 (+ 30469us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.121234 (+ 61945us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6375831}
I20260505 20:13:44.137699 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:44.138773 9271 tablet_replica.cc:333] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:44.138965 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c6acad22190b402d892d06ff97bd9476 (table default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]) successfully deleted
I20260505 20:13:44.139948 9271 raft_consensus.cc:2243] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:44.140879 9271 raft_consensus.cc:2272] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.144196 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:44.144549 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:44.145467 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:44.146054 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:44.146215 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:44.146368 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:44.146545 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:44.146709 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:44.146845 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:44.147109 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:44.147110 7983 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:44.147130 9758 consensus_queue.cc:1048] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.147256 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:44.147406 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:44.149915 8058 tablet_bootstrap.cc:492] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:44.151082 8058 ts_tablet_manager.cc:1403] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.003s
I20260505 20:13:44.140121 8053 tablet_bootstrap.cc:492] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:44.152783 8053 ts_tablet_manager.cc:1403] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.004s
I20260505 20:13:44.156339 9271 ts_tablet_manager.cc:1916] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.159363 8058 raft_consensus.cc:359] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.159969 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.163090 8053 raft_consensus.cc:359] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.163578 8054 tablet_bootstrap.cc:492] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.164436 8058 raft_consensus.cc:385] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.164996 8053 raft_consensus.cc:385] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:44.165200 7869 consensus_peers.cc:597] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d138d27f444f45d28acdc7d72a9649f5. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:44.165481 8058 raft_consensus.cc:740] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.165764 8053 raft_consensus.cc:740] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.166109 9862 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4615fa5639440fc820498f897adf17d)
I20260505 20:13:44.166862 8054 tablet_bootstrap.cc:654] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.167963 9862 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:44.172277 9121 ts_tablet_manager.cc:1929] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.172504 9121 log.cc:1199] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b966b4bbaf9f4774af96051f857f02f7
I20260505 20:13:44.173416 9121 ts_tablet_manager.cc:1950] T b966b4bbaf9f4774af96051f857f02f7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.174005 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 787 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:44.174160 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 81) took 8364 ms. Trace:
I20260505 20:13:44.174336 9121 rpcz_store.cc:276] 0505 20:13:35.809733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812732 (+ 2999us) service_pool.cc:224] Handling call
0505 20:13:44.071345 (+8258613us) ts_tablet_manager.cc:1151] Deleting tablet b966b4bbaf9f4774af96051f857f02f7
0505 20:13:44.085784 (+ 14439us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.143937 (+ 58153us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.172128 (+ 28191us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.174139 (+ 2011us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8258491}
I20260505 20:13:44.175988 9619 raft_consensus.cc:493] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.176118 9619 raft_consensus.cc:515] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.176633 9619 leader_election.cc:290] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.176731 9619 raft_consensus.cc:493] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.176812 9619 raft_consensus.cc:515] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.177205 9619 leader_election.cc:290] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.177906 9707 raft_consensus.cc:493] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.178187 9707 raft_consensus.cc:515] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.179109 9619 raft_consensus.cc:493] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.179209 9619 raft_consensus.cc:515] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.179622 9619 leader_election.cc:290] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.180212 9707 leader_election.cc:290] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.182305 9862 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:44.183418 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b966b4bbaf9f4774af96051f857f02f7 (table default.Table_7e6c02c635da4beeac8892d580b67a93 [id=9ba85af1a1ee48e691f3b92e820c0500]) successfully deleted
I20260505 20:13:44.186983 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:44.188911 7802 raft_consensus.cc:3060] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.192299 8053 consensus_queue.cc:260] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.193161 8053 ts_tablet_manager.cc:1434] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20260505 20:13:44.193528 8053 tablet_bootstrap.cc:492] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:44.178041 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:44.178121 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:44.180258 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:44.180516 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:44.195338 7870 leader_election.cc:343] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.195551 7870 leader_election.cc:343] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.195690 7870 leader_election.cc:343] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.195847 7870 leader_election.cc:343] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.166771 8058 consensus_queue.cc:260] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.196813 8058 ts_tablet_manager.cc:1434] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260505 20:13:44.199221 9121 tablet_replica.cc:333] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.201002 9121 raft_consensus.cc:2243] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:44.163300 9270 ts_tablet_manager.cc:1929] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:44.203797 9121 raft_consensus.cc:2272] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.206203 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3679480e55444d0d935f262217e44485 (table default.Table_fa95c378428d48efba91d72f220584de [id=5579cbeef0624d4a8cb8beeac55362e9]). Expected version 1 got 0
I20260505 20:13:44.206971 9270 log.cc:1199] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b393bfc209b6461aab958ebf49014d25
I20260505 20:13:44.207427 9270 ts_tablet_manager.cc:1950] T b393bfc209b6461aab958ebf49014d25 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:44.208755 8058 tablet_bootstrap.cc:492] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:44.211273 8053 tablet_bootstrap.cc:654] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.213356 9121 ts_tablet_manager.cc:1916] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.216382 8054 tablet_bootstrap.cc:492] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.216519 8054 ts_tablet_manager.cc:1403] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.000s
I20260505 20:13:44.217211 8054 raft_consensus.cc:359] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.217379 8054 raft_consensus.cc:385] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.217427 8054 raft_consensus.cc:740] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.217610 8054 consensus_queue.cc:260] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.218080 8054 ts_tablet_manager.cc:1434] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260505 20:13:44.224786 8054 tablet_bootstrap.cc:492] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.227376 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 110) took 6956 ms. Trace:
I20260505 20:13:44.227483 9270 rpcz_store.cc:276] 0505 20:13:37.271216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.271403 (+ 187us) service_pool.cc:224] Handling call
0505 20:13:44.051751 (+6780348us) ts_tablet_manager.cc:1151] Deleting tablet b393bfc209b6461aab958ebf49014d25
0505 20:13:44.051762 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.128889 (+ 77127us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.163209 (+ 34320us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.227353 (+ 64144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6780170}
I20260505 20:13:44.227782 9270 tablet_replica.cc:333] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:44.227982 9270 raft_consensus.cc:2243] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.228123 9270 raft_consensus.cc:2272] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.228945 9270 ts_tablet_manager.cc:1916] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.230219 9707 consensus_queue.cc:1048] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.235913 8054 tablet_bootstrap.cc:654] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.245991 9707 raft_consensus.cc:493] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.246156 9707 raft_consensus.cc:515] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.245057 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:44.246790 9707 leader_election.cc:290] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.247570 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:44.248245 7870 leader_election.cc:343] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.252791 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b393bfc209b6461aab958ebf49014d25 (table default.Table_1dd7483dde8948a787cb771f42d23f8e [id=fd2ae4ccfffd4eb5b7aa1bb5e0613015]) successfully deleted
I20260505 20:13:44.223390 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.224027 7785 raft_consensus.cc:1275] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Refusing update from remote peer cab133462c2f46309dc8f0792122bad9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260505 20:13:44.224570 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:44.258405 7410 catalog_manager.cc:5671] T dc1323c894d742909e2add9b8f7e2577 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:44.267645 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:44.268355 8058 tablet_bootstrap.cc:654] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.270397 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:44.279647 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:44.281010 9847 tablet.cc:1724] T 579bd562fea64fe69db2b4a6085b7bed P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:44.282683 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:44.287423 8054 tablet_bootstrap.cc:492] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.287556 8054 ts_tablet_manager.cc:1403] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.001s
I20260505 20:13:44.288447 8054 raft_consensus.cc:359] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.288762 8054 raft_consensus.cc:385] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.288906 8054 raft_consensus.cc:740] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.289269 8054 consensus_queue.cc:260] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:44.290475 7408 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8da300a3c6a743829936ecbfcd9439b5 consensus state has no leader
I20260505 20:13:44.290477 8054 ts_tablet_manager.cc:1434] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260505 20:13:44.290730 7408 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 169) took 2057 ms. Trace:
I20260505 20:13:44.290822 7408 rpcz_store.cc:276] 0505 20:13:42.233737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.751741 (+518004us) service_pool.cc:224] Handling call
0505 20:13:42.758026 (+ 6285us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:42.758268 (+ 242us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:43.019739 (+261471us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:43.019926 (+ 187us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:43.046280 (+ 26354us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:43.046287 (+ 7us) write_op.cc:454] Released schema lock
0505 20:13:43.046362 (+ 75us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:44.290671 (+1244309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:43.020614 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:43.020753 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:43.020760 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:43.020779 (+ 19us) tablet.cc:662] Decoding operations
0505 20:13:43.020872 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:43.020884 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:43.020889 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:43.020946 (+ 57us) tablet.cc:701] Row locks acquired
0505 20:13:43.020949 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:43.020989 (+ 40us) write_op.cc:270] Start()
0505 20:13:43.021020 (+ 31us) write_op.cc:276] Timestamp: P: 1778012023021150 usec, L: 0
0505 20:13:43.021024 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:43.021206 (+ 182us) log.cc:844] Serialized 405 byte log entry
0505 20:13:43.030700 (+ 9494us) op_driver.cc:464] REPLICATION: finished
0505 20:13:43.030830 (+ 130us) write_op.cc:301] APPLY: starting
0505 20:13:43.030848 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:43.030891 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:43.030929 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:43.030985 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:43.031020 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:43.031027 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:43.031108 (+ 81us) log.cc:844] Serialized 23 byte log entry
0505 20:13:43.031184 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:43.031211 (+ 27us) write_op.cc:454] Released schema lock
0505 20:13:43.031221 (+ 10us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76,"apply.run_cpu_time_us":446,"apply.run_wall_time_us":445,"num_ops":1,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":698,"prepare.run_wall_time_us":699,"raft.queue_time_us":512,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":263,"replication_time_us":9643}]]}
W20260505 20:13:44.293177 7869 leader_election.cc:343] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.293298 7869 leader_election.cc:304] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.293503 9707 raft_consensus.cc:2749] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.294171 7869 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.294296 7869 leader_election.cc:304] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.294489 9707 raft_consensus.cc:2749] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.295627 8053 tablet_bootstrap.cc:492] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:44.296439 7869 leader_election.cc:343] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.296622 7869 leader_election.cc:304] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.296821 9707 raft_consensus.cc:2749] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.297361 7869 leader_election.cc:343] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.297494 7869 leader_election.cc:304] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.297708 9707 raft_consensus.cc:2749] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.298369 7869 leader_election.cc:343] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.298499 7869 leader_election.cc:304] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.298738 9707 raft_consensus.cc:2749] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.301785 9270 ts_tablet_manager.cc:1929] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.301913 9270 log.cc:1199] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/d138d27f444f45d28acdc7d72a9649f5
I20260505 20:13:44.302237 9270 ts_tablet_manager.cc:1950] T d138d27f444f45d28acdc7d72a9649f5 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:44.304646 7869 leader_election.cc:343] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.304837 7869 leader_election.cc:304] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.305133 9707 raft_consensus.cc:2749] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.305583 9707 raft_consensus.cc:493] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.305775 9707 raft_consensus.cc:515] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.306917 9707 leader_election.cc:290] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.307363 9757 consensus_queue.cc:1048] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.307427 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9bd035b077474294d274a8f8cb38fd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:44.308027 7870 leader_election.cc:343] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.308838 7412 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 436489e0e72945f689ebd653804e7723 consensus state has no leader
I20260505 20:13:44.311290 8053 ts_tablet_manager.cc:1403] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.118s user 0.004s sys 0.000s
I20260505 20:13:44.311985 7409 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 43a3e9d404f14b43ae99c4a905f50086
I20260505 20:13:44.312191 8053 raft_consensus.cc:359] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.312366 8053 raft_consensus.cc:385] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.312422 8053 raft_consensus.cc:740] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.312577 7409 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 152) took 4117 ms. Trace:
I20260505 20:13:44.312698 7409 rpcz_store.cc:276] 0505 20:13:40.195506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.042827 (+1847321us) service_pool.cc:224] Handling call
0505 20:13:42.043390 (+ 563us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:42.043541 (+ 151us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:42.043613 (+ 72us) catalog_manager.cc:2824] Locking tablets
0505 20:13:42.403314 (+359701us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:42.476655 (+ 73341us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:42.708547 (+231892us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:44.311910 (+1603363us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:44.312536 (+ 626us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.427900 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.428033 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.428038 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:42.428040 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.428155 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.428166 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.428171 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.428292 (+ 121us) tablet.cc:701] Row locks acquired
0505 20:13:42.428294 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.428332 (+ 38us) write_op.cc:270] Start()
0505 20:13:42.428362 (+ 30us) write_op.cc:276] Timestamp: P: 1778012022428334 usec, L: 0
0505 20:13:42.428365 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.428526 (+ 161us) log.cc:844] Serialized 793 byte log entry
0505 20:13:42.475491 (+ 46965us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.476202 (+ 711us) write_op.cc:301] APPLY: starting
0505 20:13:42.476214 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.476246 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.476270 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.476328 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.476355 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:42.476361 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:42.476420 (+ 59us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.476478 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.476500 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:42.476508 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.488853 (+ 12345us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.488864 (+ 11us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":679,"apply.run_cpu_time_us":376,"apply.run_wall_time_us":510,"num_ops":2,"prepare.queue_time_us":23680,"prepare.run_cpu_time_us":7608,"prepare.run_wall_time_us":60903,"raft.queue_time_us":496,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":3,"replication_time_us":47109,"thread_start_us":60099,"threads_started":1}]]}
I20260505 20:13:44.319984 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 43a3e9d404f14b43ae99c4a905f50086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:42 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:44.320261 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 43a3e9d404f14b43ae99c4a905f50086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:42 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:44.321718 9757 raft_consensus.cc:493] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.321930 9757 raft_consensus.cc:515] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.322566 9757 leader_election.cc:290] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:44.324328 7596 consensus_peers.cc:597] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 249cad23ecfe4b9dbbd34f2a1fa899e3. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:44.326239 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 111) took 7054 ms. Trace:
I20260505 20:13:44.327134 8054 tablet_bootstrap.cc:492] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.328380 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c5c661e8aa4962bb9922b9ead7d784" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:44.328598 7926 raft_consensus.cc:2468] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:44.326692 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 43a3e9d404f14b43ae99c4a905f50086 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:42 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:44.331787 7598 leader_election.cc:304] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:44.332095 9704 raft_consensus.cc:2804] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:44.332170 9704 raft_consensus.cc:493] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:44.332229 9704 raft_consensus.cc:3060] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.328549 9270 rpcz_store.cc:276] 0505 20:13:37.271719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.271827 (+ 108us) service_pool.cc:224] Handling call
0505 20:13:44.227738 (+6955911us) ts_tablet_manager.cc:1151] Deleting tablet d138d27f444f45d28acdc7d72a9649f5
0505 20:13:44.227749 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.232255 (+ 4506us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.301701 (+ 69446us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.326216 (+ 24515us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6955776}
I20260505 20:13:44.335165 9704 raft_consensus.cc:515] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.335829 9704 leader_election.cc:290] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:44.335943 9270 tablet_replica.cc:333] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:44.336766 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet d138d27f444f45d28acdc7d72a9649f5 (table default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]) successfully deleted
I20260505 20:13:44.337052 9270 raft_consensus.cc:2243] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.337214 9270 raft_consensus.cc:2272] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.337708 9270 ts_tablet_manager.cc:1916] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.343639 8054 tablet_bootstrap.cc:654] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.343940 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c5c661e8aa4962bb9922b9ead7d784" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:44.344152 7934 raft_consensus.cc:3060] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.344846 9138 raft_consensus.cc:493] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.344981 9138 raft_consensus.cc:515] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.345557 9138 leader_election.cc:290] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.347815 7934 raft_consensus.cc:2468] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:44.348106 9121 ts_tablet_manager.cc:1929] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.348640 7598 leader_election.cc:304] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:44.348914 9757 raft_consensus.cc:2804] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:44.349035 9757 raft_consensus.cc:697] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:44.349315 9757 consensus_queue.cc:237] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.353657 9882 tablet.cc:1724] T 67c582e419f746b28530c0971fede09f P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:44.348212 9121 log.cc:1199] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/bde33085759f4fd8a130d80878d1e564
I20260505 20:13:44.356518 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:44.359094 9121 ts_tablet_manager.cc:1950] T bde33085759f4fd8a130d80878d1e564 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.359272 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b64242395794797aaf7a52ba40e0c60" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:44.360610 7934 raft_consensus.cc:3060] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.363611 7934 raft_consensus.cc:2468] T 2b64242395794797aaf7a52ba40e0c60 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:44.369369 9271 ts_tablet_manager.cc:1929] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.375372 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:44.377822 7404 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_24dc4b8440024bde9145ce5b588d47cc [id=a15b96b299e14a4a84a7f7aea63b09cd] alter complete (version 1)
I20260505 20:13:44.378567 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 81319ed5eed64dafb9b2a121661da9ea
I20260505 20:13:44.379217 7407 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 161) took 4053 ms. Trace:
I20260505 20:13:44.379341 7407 rpcz_store.cc:276] 0505 20:13:40.325629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.461613 (+2135984us) service_pool.cc:224] Handling call
0505 20:13:42.462231 (+ 618us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:42.462378 (+ 147us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:42.462436 (+ 58us) catalog_manager.cc:2824] Locking tablets
0505 20:13:42.462600 (+ 164us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:42.543098 (+ 80498us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:42.721219 (+178121us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:44.378492 (+1657273us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:44.379175 (+ 683us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.500824 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.501038 (+ 214us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.501064 (+ 26us) write_op.cc:435] Acquired schema lock
0505 20:13:42.501066 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.501343 (+ 277us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.501359 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.501366 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:42.501570 (+ 204us) tablet.cc:701] Row locks acquired
0505 20:13:42.501574 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:42.501634 (+ 60us) write_op.cc:270] Start()
0505 20:13:42.501690 (+ 56us) write_op.cc:276] Timestamp: P: 1778012022501664 usec, L: 0
0505 20:13:42.501696 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.502030 (+ 334us) log.cc:844] Serialized 728 byte log entry
0505 20:13:42.540881 (+ 38851us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.541613 (+ 732us) write_op.cc:301] APPLY: starting
0505 20:13:42.541627 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.541663 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.541701 (+ 38us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.541799 (+ 98us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.541827 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:42.541835 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:42.541889 (+ 54us) log.cc:844] Serialized 29 byte log entry
0505 20:13:42.541929 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.541942 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:42.541947 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.542004 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.542008 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":694,"apply.run_cpu_time_us":388,"apply.run_wall_time_us":388,"num_ops":2,"prepare.queue_time_us":37550,"prepare.run_cpu_time_us":1044,"prepare.run_wall_time_us":1647,"replication_time_us":39169}]]}
I20260505 20:13:44.390688 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 81319ed5eed64dafb9b2a121661da9ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:42 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:44.392040 9704 consensus_queue.cc:1048] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.394389 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 81319ed5eed64dafb9b2a121661da9ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:42 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:44.404460 9757 consensus_queue.cc:1048] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.417833 8058 tablet_bootstrap.cc:492] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:44.418097 8058 ts_tablet_manager.cc:1403] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.209s user 0.006s sys 0.005s
I20260505 20:13:44.419760 8058 raft_consensus.cc:359] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.420107 8058 raft_consensus.cc:385] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.420229 8058 raft_consensus.cc:740] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.420578 8058 consensus_queue.cc:260] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.421324 8058 ts_tablet_manager.cc:1434] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:44.421658 8058 tablet_bootstrap.cc:492] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:44.423828 8058 tablet_bootstrap.cc:654] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.438982 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 105) took 8626 ms. Trace:
I20260505 20:13:44.439098 9121 rpcz_store.cc:276] 0505 20:13:35.812041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812225 (+ 184us) service_pool.cc:224] Handling call
0505 20:13:44.198988 (+8386763us) ts_tablet_manager.cc:1151] Deleting tablet bde33085759f4fd8a130d80878d1e564
0505 20:13:44.199010 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.249128 (+ 50118us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.348040 (+ 98912us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.438957 (+ 90917us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8361789}
I20260505 20:13:44.439394 9121 tablet_replica.cc:333] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.439579 9121 raft_consensus.cc:2243] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:44.439858 9121 raft_consensus.cc:2272] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.440434 9121 ts_tablet_manager.cc:1916] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.442143 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet bde33085759f4fd8a130d80878d1e564 (table default.Table_f1c1f40aa3044bdbbaa23ae22445214b [id=53e038ba0a4441ec9746e5dff6df39dc]) successfully deleted
I20260505 20:13:44.442587 9271 log.cc:1199] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b6ed7c0220d147c7853c7afc1ef09607
I20260505 20:13:44.443123 9271 ts_tablet_manager.cc:1950] T b6ed7c0220d147c7853c7afc1ef09607 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:44.444154 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 102) took 7185 ms. Trace:
I20260505 20:13:44.444306 9271 rpcz_store.cc:276] 0505 20:13:37.258459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.260578 (+ 2119us) service_pool.cc:224] Handling call
0505 20:13:44.138728 (+6878150us) ts_tablet_manager.cc:1151] Deleting tablet b6ed7c0220d147c7853c7afc1ef09607
0505 20:13:44.138738 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.220958 (+ 82220us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.369289 (+148331us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.444125 (+ 74836us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6878021}
I20260505 20:13:44.444785 9271 tablet_replica.cc:333] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:44.445075 9271 raft_consensus.cc:2243] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.445298 9271 raft_consensus.cc:2272] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.445972 9271 ts_tablet_manager.cc:1916] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.446470 9121 ts_tablet_manager.cc:1929] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.446573 9121 log.cc:1199] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b6895af5f55b4bc183065626417090a4
I20260505 20:13:44.446918 9121 ts_tablet_manager.cc:1950] T b6895af5f55b4bc183065626417090a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.447222 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 83) took 8637 ms. Trace:
I20260505 20:13:44.447304 9121 rpcz_store.cc:276] 0505 20:13:35.809940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812874 (+ 2934us) service_pool.cc:224] Handling call
0505 20:13:44.439353 (+8626479us) ts_tablet_manager.cc:1151] Deleting tablet b6895af5f55b4bc183065626417090a4
0505 20:13:44.439361 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.443555 (+ 4194us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.446413 (+ 2858us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.447205 (+ 792us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8626345}
I20260505 20:13:44.447592 9121 tablet_replica.cc:333] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.447751 9121 raft_consensus.cc:2243] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.447728 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b6895af5f55b4bc183065626417090a4 (table default.Table_db181a51dd2c430ca2792b4bef5cd912 [id=9c1ec1b20693456f9645c8f8f55af83f]) successfully deleted
I20260505 20:13:44.447894 9121 raft_consensus.cc:2272] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.448351 9121 ts_tablet_manager.cc:1916] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.448338 7596 leader_election.cc:304] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:44.448659 7596 raft_consensus.cc:2686] T ee19f65120184eca9495513b68440b4f P cab133462c2f46309dc8f0792122bad9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:44.425861 9270 ts_tablet_manager.cc:1929] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260505 20:13:44.430182 7599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:44.450526 9270 log.cc:1199] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/64a82a9d144746338b3fc6550aa35d3c
I20260505 20:13:44.451120 9270 ts_tablet_manager.cc:1950] T 64a82a9d144746338b3fc6550aa35d3c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:44.451663 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 112) took 7179 ms. Trace:
I20260505 20:13:44.451867 9270 rpcz_store.cc:276] 0505 20:13:37.272279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.272465 (+ 186us) service_pool.cc:224] Handling call
0505 20:13:44.334357 (+7061892us) ts_tablet_manager.cc:1151] Deleting tablet 64a82a9d144746338b3fc6550aa35d3c
0505 20:13:44.334877 (+ 520us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.340782 (+ 5905us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.421467 (+ 80685us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.451646 (+ 30179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7061740}
I20260505 20:13:44.452479 9270 tablet_replica.cc:333] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:44.452620 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 64a82a9d144746338b3fc6550aa35d3c (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]) successfully deleted
I20260505 20:13:44.453019 9270 raft_consensus.cc:2243] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:44.453446 9270 pending_rounds.cc:70] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
W20260505 20:13:44.459728 7596 leader_election.cc:343] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.432348 9878 tablet.cc:1724] T 579bd562fea64fe69db2b4a6085b7bed P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:44.470118 7596 leader_election.cc:343] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.469672 9270 pending_rounds.cc:77] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737251738923008 op_type: NO_OP noop_request { }
I20260505 20:13:44.470579 9270 raft_consensus.cc:2889] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:44.470788 9270 raft_consensus.cc:2272] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.483510 9879 tablet.cc:1724] T c278b516135b47ee96ed61b1ae595f9a P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:44.389824 7735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260505 20:13:44.487375 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 81319ed5eed64dafb9b2a121661da9ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:42 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:44.487674 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b6ed7c0220d147c7853c7afc1ef09607 (table default.Table_30eb9a9bb910469a805041e2341c0a4f [id=f7354a061d874fa293e746426a9fd9c4]) successfully deleted
I20260505 20:13:44.488842 9242 raft_consensus.cc:493] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.488962 9242 raft_consensus.cc:515] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.489527 9242 leader_election.cc:290] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.371016 8053 consensus_queue.cc:260] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:44.479202 7736 consensus_peers.cc:597] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee19f65120184eca9495513b68440b4f. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:44.487850 8058 tablet_bootstrap.cc:492] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:44.494515 8058 ts_tablet_manager.cc:1403] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.002s
I20260505 20:13:44.479676 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8bd19470294a1db91855afe49be6a5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.480082 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.495462 8058 raft_consensus.cc:359] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.495643 8058 raft_consensus.cc:385] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.495718 8058 raft_consensus.cc:740] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.496174 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:44.497474 8053 ts_tablet_manager.cc:1434] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.186s user 0.002s sys 0.000s
I20260505 20:13:44.498313 8053 tablet_bootstrap.cc:492] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:44.499924 9619 raft_consensus.cc:493] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.500095 9619 raft_consensus.cc:515] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.500720 9619 leader_election.cc:290] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.503815 8053 tablet_bootstrap.cc:654] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.505709 9882 tablet.cc:1724] T c278b516135b47ee96ed61b1ae595f9a P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:44.507055 9270 ts_tablet_manager.cc:1916] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.510875 9707 raft_consensus.cc:493] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.511003 9707 raft_consensus.cc:515] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.512445 9707 leader_election.cc:290] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.513415 9758 consensus_queue.cc:1048] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.515298 8054 tablet_bootstrap.cc:492] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.515475 8054 ts_tablet_manager.cc:1403] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.190s user 0.002s sys 0.010s
I20260505 20:13:44.516585 8054 raft_consensus.cc:359] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.516901 8054 raft_consensus.cc:385] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.516975 8054 raft_consensus.cc:740] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.517236 8054 consensus_queue.cc:260] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.517980 8054 ts_tablet_manager.cc:1434] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.003s sys 0.001s
I20260505 20:13:44.519055 8054 tablet_bootstrap.cc:492] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.519363 9758 raft_consensus.cc:493] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.519594 9758 raft_consensus.cc:515] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.520597 8054 tablet_bootstrap.cc:654] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.522239 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:44.522523 7924 raft_consensus.cc:2468] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:44.523252 7598 leader_election.cc:304] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:44.524283 9757 raft_consensus.cc:2804] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:44.524363 9757 raft_consensus.cc:493] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:44.524425 9757 raft_consensus.cc:3060] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.525324 9758 leader_election.cc:290] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:44.527309 8058 consensus_queue.cc:260] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:44.527694 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 56487.4us
I20260505 20:13:44.529529 8058 ts_tablet_manager.cc:1434] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260505 20:13:44.532770 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4860b4f80ef34a799fa9f9607aac844a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.533847 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.538201 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3535f0c31ad5451ea5bceeb50f756eef" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:44.541002 7596 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.541203 7596 leader_election.cc:304] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:44.541466 9704 raft_consensus.cc:2749] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.545073 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.545943 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663d16be712b40859aa92277eab0c4a2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.546862 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.547791 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.562217 9758 raft_consensus.cc:493] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.562686 9758 raft_consensus.cc:515] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.557221 9121 ts_tablet_manager.cc:1929] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.565696 9121 log.cc:1199] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1218bd76239540be9a93ca455ba3eb47
I20260505 20:13:44.570868 9121 ts_tablet_manager.cc:1950] T 1218bd76239540be9a93ca455ba3eb47 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.573835 8053 tablet_bootstrap.cc:492] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:44.574906 8054 tablet_bootstrap.cc:492] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.575044 8054 ts_tablet_manager.cc:1403] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.002s
I20260505 20:13:44.530915 9757 raft_consensus.cc:515] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.575824 8054 raft_consensus.cc:359] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.576114 8054 raft_consensus.cc:385] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.576254 8054 raft_consensus.cc:740] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.576661 8054 consensus_queue.cc:260] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.577116 8058 tablet_bootstrap.cc:492] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:44.579777 8054 ts_tablet_manager.cc:1434] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260505 20:13:44.581663 8054 tablet_bootstrap.cc:492] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.585584 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 84) took 8775 ms. Trace:
I20260505 20:13:44.587357 8053 ts_tablet_manager.cc:1403] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.002s
I20260505 20:13:44.588406 8053 raft_consensus.cc:359] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.588627 8053 raft_consensus.cc:385] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.588714 8053 raft_consensus.cc:740] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.588966 8053 consensus_queue.cc:260] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.589541 8053 ts_tablet_manager.cc:1434] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:44.589915 8053 tablet_bootstrap.cc:492] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:44.591836 8053 tablet_bootstrap.cc:654] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.597198 7411 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_a60fa5c161734fd1ad2dea23839786c4 [id=a57c99624e8f48bdbf344475ac2f2214] alter complete (version 1)
I20260505 20:13:44.600592 7412 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 171) took 2346 ms. Trace:
I20260505 20:13:44.600728 7412 rpcz_store.cc:276] 0505 20:13:42.253911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:43.068569 (+814658us) service_pool.cc:224] Handling call
0505 20:13:43.069606 (+ 1037us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:43.070284 (+ 678us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:43.070906 (+ 622us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:43.071199 (+ 293us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:43.131457 (+ 60258us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:44.600543 (+1469086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:43.115272 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:43.115385 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:43.115392 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:43.115394 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:43.115505 (+ 111us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:43.115520 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:43.115537 (+ 17us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:43.115597 (+ 60us) tablet.cc:701] Row locks acquired
0505 20:13:43.115600 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:43.115633 (+ 33us) write_op.cc:270] Start()
0505 20:13:43.115665 (+ 32us) write_op.cc:276] Timestamp: P: 1778012023115639 usec, L: 0
0505 20:13:43.115668 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:43.115853 (+ 185us) log.cc:844] Serialized 405 byte log entry
0505 20:13:43.119323 (+ 3470us) op_driver.cc:464] REPLICATION: finished
0505 20:13:43.119568 (+ 245us) write_op.cc:301] APPLY: starting
0505 20:13:43.119587 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:43.119630 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:43.119659 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:43.119713 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:43.119753 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:43.119765 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:43.119852 (+ 87us) log.cc:844] Serialized 23 byte log entry
0505 20:13:43.119915 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:43.119934 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:43.119940 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:43.120007 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:43.120010 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":167,"apply.run_cpu_time_us":452,"apply.run_wall_time_us":452,"num_ops":1,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":679,"prepare.run_wall_time_us":679,"raft.queue_time_us":370,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":256,"replication_time_us":3625}]]}
I20260505 20:13:44.587194 9121 rpcz_store.cc:276] 0505 20:13:35.810027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.813033 (+ 3006us) service_pool.cc:224] Handling call
0505 20:13:44.447554 (+8634521us) ts_tablet_manager.cc:1151] Deleting tablet 1218bd76239540be9a93ca455ba3eb47
0505 20:13:44.447563 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.503064 (+ 55501us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.557086 (+ 54022us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.585296 (+ 28210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8634373}
I20260505 20:13:44.602250 9121 tablet_replica.cc:333] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.602288 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1218bd76239540be9a93ca455ba3eb47 (table default.Table_cfbc6470d8d34b93a3d1434dfa9df8cf [id=813ff9cab8554a79a0b9b5a01f63127c]) successfully deleted
I20260505 20:13:44.602654 9121 raft_consensus.cc:2243] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.602824 7412 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_e0642656a8e54729b28f94bc1f16502b" } new_table_name: "default.Table_2add910ed16e4806844c4179947d54e2" modify_external_catalogs: true
I20260505 20:13:44.603004 9121 raft_consensus.cc:2272] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.604423 9121 ts_tablet_manager.cc:1916] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.604766 9707 raft_consensus.cc:493] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.604916 9707 raft_consensus.cc:515] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.605588 9707 leader_election.cc:290] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.611119 8054 tablet_bootstrap.cc:654] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.625941 8054 tablet_bootstrap.cc:492] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.628239 8054 ts_tablet_manager.cc:1403] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.001s
I20260505 20:13:44.592607 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.592948 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.593299 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.594461 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9bd035b077474294d274a8f8cb38fd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.594923 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaff49cb0ff4298be24603b2015c8a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.595508 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede080523cb1482d8a531f4044164475" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.650434 9707 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:44.650612 9707 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.651264 9707 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:44.654373 9758 leader_election.cc:290] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:44.596828 7737 consensus_peers.cc:597] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c12a95b0ed445c7b598db136f6ac05c. This is attempt 6: this message will repeat every 5th retry.
W20260505 20:13:44.654841 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 58068.5us
W20260505 20:13:44.655711 7737 consensus_peers.cc:597] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4a42f0b6dc74cbd8d72ae36410f9d35. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:44.654000 8054 raft_consensus.cc:359] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:44.657845 7737 consensus_peers.cc:597] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd01314146a34257b444a622829b2fe4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:44.657531 8054 raft_consensus.cc:385] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.659430 8054 raft_consensus.cc:740] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.661525 9842 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:44.661655 9842 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.662354 9842 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:44.664692 9842 consensus_queue.cc:1048] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.663492 8054 consensus_queue.cc:260] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.666739 7737 leader_election.cc:304] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.667573 9842 raft_consensus.cc:2804] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:44.667690 9842 raft_consensus.cc:697] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:44.667917 9842 consensus_queue.cc:237] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.672571 9707 raft_consensus.cc:493] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.672719 9707 raft_consensus.cc:515] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.673512 9707 leader_election.cc:290] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.674222 9894 raft_consensus.cc:493] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:44.674458 9894 raft_consensus.cc:515] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:44.675417 9894 leader_election.cc:290] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:44.681142 9121 ts_tablet_manager.cc:1929] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:44.681293 9121 log.cc:1199] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f0ca8cc557674992b88f3379cc1db652
I20260505 20:13:44.681658 9121 ts_tablet_manager.cc:1950] T f0ca8cc557674992b88f3379cc1db652 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.681927 8054 ts_tablet_manager.cc:1434] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.052s user 0.004s sys 0.000s
I20260505 20:13:44.682724 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f91a58d306e4dd7ab515498aa6ab32b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:44.705602 9707 raft_consensus.cc:493] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.705807 9707 raft_consensus.cc:515] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.706540 9707 leader_election.cc:290] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.710307 9270 ts_tablet_manager.cc:1929] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.728046 8054 tablet_bootstrap.cc:492] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.734156 8054 tablet_bootstrap.cc:654] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.736292 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 103) took 8924 ms. Trace:
I20260505 20:13:44.736414 9121 rpcz_store.cc:276] 0505 20:13:35.811814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.812346 (+ 532us) service_pool.cc:224] Handling call
0505 20:13:44.602140 (+8789794us) ts_tablet_manager.cc:1151] Deleting tablet f0ca8cc557674992b88f3379cc1db652
0505 20:13:44.602153 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.661786 (+ 59633us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.681063 (+ 19277us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.736264 (+ 55201us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8788769}
I20260505 20:13:44.736850 9121 tablet_replica.cc:333] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.737097 9121 raft_consensus.cc:2243] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.737259 9121 raft_consensus.cc:2272] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.737362 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f0ca8cc557674992b88f3379cc1db652 (table default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]) successfully deleted
I20260505 20:13:44.737843 9121 ts_tablet_manager.cc:1916] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.737818 9894 raft_consensus.cc:493] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:44.737969 9894 raft_consensus.cc:515] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:44.738541 9894 leader_election.cc:290] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:44.744304 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8754580368453aa0aae021d8c665da" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:44.749290 7869 leader_election.cc:343] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.749421 7869 leader_election.cc:304] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.749994 9707 raft_consensus.cc:2749] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.750448 7869 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.750556 7869 leader_election.cc:304] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.751000 9707 raft_consensus.cc:2749] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.761816 9707 raft_consensus.cc:493] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.762023 9707 raft_consensus.cc:515] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.762974 9707 leader_election.cc:290] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.769774 8054 tablet_bootstrap.cc:492] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.769969 8054 ts_tablet_manager.cc:1403] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.042s user 0.009s sys 0.000s
I20260505 20:13:44.772058 8054 raft_consensus.cc:359] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.772578 8054 raft_consensus.cc:385] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.772775 8054 raft_consensus.cc:740] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.634461 9271 ts_tablet_manager.cc:1929] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.773670 9271 log.cc:1199] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e2554ecdcfd64ca6ba75e6b4077a5ab3
I20260505 20:13:44.774360 9271 ts_tablet_manager.cc:1950] T e2554ecdcfd64ca6ba75e6b4077a5ab3 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:44.775331 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 97) took 7517 ms. Trace:
I20260505 20:13:44.775485 9271 rpcz_store.cc:276] 0505 20:13:37.257974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.260800 (+ 2826us) service_pool.cc:224] Handling call
0505 20:13:44.444731 (+7183931us) ts_tablet_manager.cc:1151] Deleting tablet e2554ecdcfd64ca6ba75e6b4077a5ab3
0505 20:13:44.444745 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.537563 (+ 92818us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.634384 (+ 96821us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.775307 (+140923us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7183771}
I20260505 20:13:44.776182 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 (table default.Table_d991da0b0d3b445b918500a013593fe2 [id=600d612bf56b43cab35d268b714affa3]) successfully deleted
I20260505 20:13:44.774304 8054 consensus_queue.cc:260] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:44.779345 7869 leader_election.cc:343] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.779469 7869 leader_election.cc:304] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.780073 9707 raft_consensus.cc:2749] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.787352 9707 raft_consensus.cc:493] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.787590 9707 raft_consensus.cc:515] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.788556 9707 leader_election.cc:290] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.788564 8054 ts_tablet_manager.cc:1434] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.018s user 0.004s sys 0.001s
W20260505 20:13:44.790915 7869 leader_election.cc:343] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.791106 7869 leader_election.cc:304] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.791545 9707 raft_consensus.cc:2749] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.792546 7869 leader_election.cc:343] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.792724 7869 leader_election.cc:304] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.793120 9707 raft_consensus.cc:2749] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.793601 8054 tablet_bootstrap.cc:492] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:44.803524 7869 leader_election.cc:343] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.803800 7869 leader_election.cc:304] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.804283 9707 raft_consensus.cc:2749] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.805516 7869 leader_election.cc:343] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.805725 7869 leader_election.cc:304] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.806164 9707 raft_consensus.cc:2749] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:44.807253 7869 leader_election.cc:343] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.807416 7869 leader_election.cc:304] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.807809 9707 raft_consensus.cc:2749] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.819515 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:44.823261 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:44.827270 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:44.829687 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:44.832551 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:44.834101 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:44.838068 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:44.838157 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:44.838420 7921 raft_consensus.cc:2468] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:44.839295 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
W20260505 20:13:44.841218 7869 leader_election.cc:343] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.841811 7869 leader_election.cc:304] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.842236 9429 raft_consensus.cc:2749] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.842238 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 67c582e419f746b28530c0971fede09f (table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]). Expected version 2 got 0
I20260505 20:13:44.845101 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:44.846796 9882 tablet.cc:1724] T 579bd562fea64fe69db2b4a6085b7bed P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:44.846712 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1]). Expected version 1 got 0
I20260505 20:13:44.849932 8054 tablet_bootstrap.cc:654] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.850507 9429 consensus_queue.cc:1048] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:44.851564 7869 leader_election.cc:343] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.851732 7869 leader_election.cc:304] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.852064 9429 raft_consensus.cc:2749] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.852025 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
W20260505 20:13:44.852586 7869 leader_election.cc:343] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.852717 9121 ts_tablet_manager.cc:1929] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:44.852885 9121 log.cc:1199] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b6ed7c0220d147c7853c7afc1ef09607
I20260505 20:13:44.853300 9121 ts_tablet_manager.cc:1950] T b6ed7c0220d147c7853c7afc1ef09607 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.853794 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 75) took 9044 ms. Trace:
I20260505 20:13:44.687191 9757 leader_election.cc:290] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:44.783793 8058 tablet_bootstrap.cc:654] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.853924 9121 rpcz_store.cc:276] 0505 20:13:35.809174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.813327 (+ 4153us) service_pool.cc:224] Handling call
0505 20:13:44.736778 (+8923451us) ts_tablet_manager.cc:1151] Deleting tablet b6ed7c0220d147c7853c7afc1ef09607
0505 20:13:44.736804 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.783838 (+ 47034us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.852636 (+ 68798us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.853771 (+ 1135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4480,"tablet-delete.queue_time_us":8923307}
I20260505 20:13:44.854413 9121 tablet_replica.cc:333] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:44.854701 9121 raft_consensus.cc:2243] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.854928 9121 raft_consensus.cc:2272] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.855690 9121 ts_tablet_manager.cc:1916] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.857299 9270 log.cc:1199] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e6c5c661e8aa4962bb9922b9ead7d784
I20260505 20:13:44.857793 9270 ts_tablet_manager.cc:1950] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:44.858358 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 113) took 7585 ms. Trace:
I20260505 20:13:44.858493 9270 rpcz_store.cc:276] 0505 20:13:37.272894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.273077 (+ 183us) service_pool.cc:224] Handling call
0505 20:13:44.452406 (+7179329us) ts_tablet_manager.cc:1151] Deleting tablet e6c5c661e8aa4962bb9922b9ead7d784
0505 20:13:44.452416 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.688100 (+235684us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.710230 (+ 22130us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.858336 (+148106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1122,"tablet-delete.queue_time_us":7179163}
I20260505 20:13:44.859190 9270 tablet_replica.cc:333] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:44.859480 9270 raft_consensus.cc:2243] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.859472 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e6c5c661e8aa4962bb9922b9ead7d784 (table default.Table_20042b0bea294bc1ad99439fa62373da [id=bea129294980408ea07ab3a19804d918]) successfully deleted
I20260505 20:13:44.860249 9270 raft_consensus.cc:2272] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.860613 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:44.862035 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:44.864248 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:44.865891 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:44.868727 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:44.869684 9271 tablet_replica.cc:333] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:44.869972 9271 raft_consensus.cc:2243] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:44.852736 7869 leader_election.cc:304] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.870626 9707 raft_consensus.cc:2749] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.872678 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:44.874221 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
W20260505 20:13:44.876780 7869 leader_election.cc:343] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.876993 7869 leader_election.cc:304] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.877287 9707 raft_consensus.cc:2749] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.878273 9894 raft_consensus.cc:493] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.878427 9894 raft_consensus.cc:515] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.879074 9894 leader_election.cc:290] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.880959 8054 tablet_bootstrap.cc:492] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:44.883157 8054 ts_tablet_manager.cc:1403] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.091s user 0.011s sys 0.000s
I20260505 20:13:44.883729 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:44.885032 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:44.888386 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:44.893581 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:44.895115 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:44.896497 9271 raft_consensus.cc:2272] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:44.896977 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:44.899165 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:44.900512 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:44.901721 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:44.902841 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:44.903031 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:44.904657 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:44.902830 8054 raft_consensus.cc:359] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.906466 8054 raft_consensus.cc:385] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:44.908339 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:44.907675 8054 raft_consensus.cc:740] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:44.910616 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:44.911388 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:44.912832 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:44.913931 7408 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:44.912110 8054 consensus_queue.cc:260] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.917544 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c5c661e8aa4962bb9922b9ead7d784" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.918635 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c5c661e8aa4962bb9922b9ead7d784" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:44.919318 7795 raft_consensus.cc:3060] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:44.923532 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 46786.4us
W20260505 20:13:44.923913 7869 leader_election.cc:343] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.924304 7869 leader_election.cc:304] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:44.924616 9707 raft_consensus.cc:2749] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:44.924325 8054 ts_tablet_manager.cc:1434] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.040s user 0.004s sys 0.002s
I20260505 20:13:44.927443 9270 ts_tablet_manager.cc:1916] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:44.811947 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 241449us
I20260505 20:13:44.929806 8054 tablet_bootstrap.cc:492] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:44.932237 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:44.932435 7926 raft_consensus.cc:3060] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:44.936100 7926 raft_consensus.cc:2468] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:44.861349 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 293383us
W20260505 20:13:44.939394 7596 consensus_peers.cc:597] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b596f03adbea413b813c9037d4243fae. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:44.948312 9707 raft_consensus.cc:493] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.948803 9707 raft_consensus.cc:515] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.950695 9707 leader_election.cc:290] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.961453 9757 raft_consensus.cc:493] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.961639 9757 raft_consensus.cc:515] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.962543 9757 leader_election.cc:290] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:44.966455 9398 consensus_queue.cc:1048] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.975286 8054 tablet_bootstrap.cc:654] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:44.982936 9121 ts_tablet_manager.cc:1929] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:44.983915 9271 ts_tablet_manager.cc:1916] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:44.984169 9121 log.cc:1199] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:44.987761 9495 consensus_queue.cc:1048] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:44.988268 9121 ts_tablet_manager.cc:1950] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:44.988605 9707 raft_consensus.cc:493] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:44.988987 9707 raft_consensus.cc:515] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:44.990291 9707 leader_election.cc:290] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:44.992131 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 108) took 9176 ms. Trace:
W20260505 20:13:44.993119 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 69246.2us
W20260505 20:13:44.993402 7869 leader_election.cc:343] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:44.994468 7869 leader_election.cc:343] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:44.999342 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:45.006531 7596 leader_election.cc:343] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.009936 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cce1c38ad5a468dbf1714b4fdb0eb8a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.010260 7795 raft_consensus.cc:2468] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:45.010352 8058 tablet_bootstrap.cc:492] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:45.011409 8058 ts_tablet_manager.cc:1403] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.434s user 0.009s sys 0.001s
W20260505 20:13:45.012428 7596 leader_election.cc:343] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.015645 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.018582 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.019297 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5cfc700aff4082ae089476e2af044f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:44.992945 9121 rpcz_store.cc:276] 0505 20:13:35.815161 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.815218 (+ 57us) service_pool.cc:224] Handling call
0505 20:13:44.854348 (+9039130us) ts_tablet_manager.cc:1151] Deleting tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a
0505 20:13:44.854361 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:44.927134 (+ 72773us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.982244 (+ 55110us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:44.991988 (+ 9744us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9038967}
I20260505 20:13:45.019758 9121 tablet_replica.cc:333] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.020015 9121 raft_consensus.cc:2243] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.020202 9121 raft_consensus.cc:2272] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.020900 9121 ts_tablet_manager.cc:1916] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.024840 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b6ed7c0220d147c7853c7afc1ef09607 (table default.Table_30eb9a9bb910469a805041e2341c0a4f [id=f7354a061d874fa293e746426a9fd9c4]) successfully deleted
I20260505 20:13:45.026636 8053 tablet_bootstrap.cc:492] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:45.026890 8053 ts_tablet_manager.cc:1403] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.437s user 0.114s sys 0.165s
I20260505 20:13:45.027797 8053 raft_consensus.cc:359] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.028061 8053 raft_consensus.cc:385] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.028160 8053 raft_consensus.cc:740] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.028437 8053 consensus_queue.cc:260] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.029044 8053 ts_tablet_manager.cc:1434] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:45.030244 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.032757 8053 tablet_bootstrap.cc:492] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:45.038096 8053 tablet_bootstrap.cc:654] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.047389 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:45.047552 8054 tablet_bootstrap.cc:492] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:45.047698 8054 ts_tablet_manager.cc:1403] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.119s user 0.004s sys 0.009s
I20260505 20:13:45.072384 9429 raft_consensus.cc:493] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.072556 9429 raft_consensus.cc:515] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.072480 8054 raft_consensus.cc:359] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.072943 8054 raft_consensus.cc:385] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.073107 8054 raft_consensus.cc:740] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.073567 9429 leader_election.cc:290] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.073642 8054 consensus_queue.cc:260] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.075266 8054 ts_tablet_manager.cc:1434] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20260505 20:13:45.076015 8054 tablet_bootstrap.cc:492] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:45.076413 9429 raft_consensus.cc:493] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.076546 9429 raft_consensus.cc:515] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.077232 9429 leader_election.cc:290] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.079070 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:45.080096 8054 tablet_bootstrap.cc:654] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.081956 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.085155 9495 raft_consensus.cc:493] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.085310 9495 raft_consensus.cc:515] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.086331 9920 tablet.cc:1724] T 43a3e9d404f14b43ae99c4a905f50086 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:45.090025 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.092454 9121 ts_tablet_manager.cc:1929] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.093475 9121 log.cc:1199] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/0d5ed062508b411eb0fa5a14637830ea
I20260505 20:13:45.085958 9495 leader_election.cc:290] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:45.102910 9121 ts_tablet_manager.cc:1950] T 0d5ed062508b411eb0fa5a14637830ea P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.107621 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:45.115370 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 107) took 9300 ms. Trace:
I20260505 20:13:45.117144 9121 rpcz_store.cc:276] 0505 20:13:35.814326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.817419 (+ 3093us) service_pool.cc:224] Handling call
0505 20:13:45.019689 (+9202270us) ts_tablet_manager.cc:1151] Deleting tablet 0d5ed062508b411eb0fa5a14637830ea
0505 20:13:45.019703 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.051082 (+ 31379us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.091901 (+ 40819us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.115031 (+ 23130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9202088}
I20260505 20:13:45.121443 9121 tablet_replica.cc:333] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.121649 9121 raft_consensus.cc:2243] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.097334 9911 consensus_queue.cc:1048] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260505 20:13:45.130954 9121 raft_consensus.cc:2272] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.131618 9121 ts_tablet_manager.cc:1916] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:45.133044 7869 leader_election.cc:343] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.133360 7869 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
W20260505 20:13:45.133654 7869 raft_consensus.cc:2686] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:45.134189 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 0d5ed062508b411eb0fa5a14637830ea (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]) successfully deleted
I20260505 20:13:45.134629 9707 raft_consensus.cc:493] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.134819 9707 raft_consensus.cc:515] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.138103 9121 ts_tablet_manager.cc:1929] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.138211 9121 log.cc:1199] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b9f684cd880b4a748cab49795de11503
I20260505 20:13:45.138568 9121 ts_tablet_manager.cc:1950] T b9f684cd880b4a748cab49795de11503 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.139328 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 106) took 9325 ms. Trace:
I20260505 20:13:45.144117 9707 leader_election.cc:290] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:45.158198 8058 raft_consensus.cc:359] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.158437 8058 raft_consensus.cc:385] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.158501 8058 raft_consensus.cc:740] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.156193 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:45.162865 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:45.163879 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaff49cb0ff4298be24603b2015c8a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.163964 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede080523cb1482d8a531f4044164475" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.164006 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:45.165205 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.165714 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.165436 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:45.165818 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.166774 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5cfc700aff4082ae089476e2af044f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.167613 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:45.168876 7407 catalog_manager.cc:5671] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:45.170897 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:45.139405 9121 rpcz_store.cc:276] 0505 20:13:35.813560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.817821 (+ 4261us) service_pool.cc:224] Handling call
0505 20:13:45.121390 (+9303569us) ts_tablet_manager.cc:1151] Deleting tablet b9f684cd880b4a748cab49795de11503
0505 20:13:45.121400 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.134781 (+ 13381us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.138051 (+ 3270us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.139310 (+ 1259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9078,"tablet-delete.queue_time_us":9303414}
I20260505 20:13:45.173409 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1]). Expected version 1 got 0
I20260505 20:13:45.174747 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:45.176730 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:45.176961 9121 tablet_replica.cc:333] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.178946 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.180646 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.181994 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.183271 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.183589 9121 raft_consensus.cc:2243] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.186319 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b9f684cd880b4a748cab49795de11503 (table default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]) successfully deleted
I20260505 20:13:45.186803 9707 raft_consensus.cc:493] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.187007 9707 raft_consensus.cc:515] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.186256 9121 raft_consensus.cc:2272] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.187971 9707 leader_election.cc:290] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.188434 8058 consensus_queue.cc:260] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.189152 8058 ts_tablet_manager.cc:1434] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.177s user 0.002s sys 0.000s
I20260505 20:13:45.189495 8058 tablet_bootstrap.cc:492] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:45.192080 7655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "004a8e72cab44d31af3369b8df1e434e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.207314 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:45.207566 7931 raft_consensus.cc:2468] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:45.207544 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:45.211344 9121 ts_tablet_manager.cc:1916] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.213073 9757 raft_consensus.cc:493] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.213235 9757 raft_consensus.cc:515] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.213948 9757 leader_election.cc:290] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:45.213663 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
W20260505 20:13:45.218029 7598 leader_election.cc:343] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f0ca8cc557674992b88f3379cc1db652
I20260505 20:13:45.219005 7598 leader_election.cc:304] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.219839 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:45.225942 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:45.227227 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:45.227604 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:45.227923 7921 raft_consensus.cc:2393] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:45.230366 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:45.232529 9757 raft_consensus.cc:2804] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:45.232458 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:45.232674 9757 raft_consensus.cc:697] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:45.234419 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:45.234908 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:45.237027 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
W20260505 20:13:45.237986 7598 consensus_peers.cc:597] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d5ed062508b411eb0fa5a14637830ea. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:45.238320 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:45.238868 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:45.240051 7598 leader_election.cc:304] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.240409 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:45.240918 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:45.241559 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:45.242851 9757 consensus_queue.cc:237] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.250854 9906 raft_consensus.cc:2804] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:45.250978 9906 raft_consensus.cc:493] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:45.251052 9906 raft_consensus.cc:3060] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.254658 9906 raft_consensus.cc:515] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.255831 9906 leader_election.cc:290] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:45.257894 9398 consensus_queue.cc:1048] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:45.263918 8058 tablet_bootstrap.cc:654] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.269272 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.278949 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:45.282557 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:45.285737 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
W20260505 20:13:45.287786 7869 leader_election.cc:343] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:45.288394 7869 leader_election.cc:343] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:45.289120 7869 leader_election.cc:343] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.291586 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:45.293015 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:45.309163 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
W20260505 20:13:45.310737 7869 leader_election.cc:343] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.311216 7407 catalog_manager.cc:5671] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:45.315855 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:45.094950 9271 ts_tablet_manager.cc:1929] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.099275 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.100677 8053 tablet_bootstrap.cc:492] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:45.317705 8053 ts_tablet_manager.cc:1403] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.285s user 0.010s sys 0.005s
I20260505 20:13:45.101538 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.129340 9894 raft_consensus.cc:493] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.161394 9842 raft_consensus.cc:493] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.318308 9842 raft_consensus.cc:515] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.318708 8053 raft_consensus.cc:359] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.318879 8053 raft_consensus.cc:385] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.318941 8053 raft_consensus.cc:740] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.319049 9842 leader_election.cc:290] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:45.202484 7736 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:45.319133 8053 consensus_queue.cc:260] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:45.319217 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 116809us
W20260505 20:13:45.319432 7736 leader_election.cc:343] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 3d74dbab83b840d9b2bd103e946d3032
I20260505 20:13:45.255039 9138 raft_consensus.cc:493] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.319806 9138 raft_consensus.cc:515] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.320379 9138 leader_election.cc:290] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.301710 9469 raft_consensus.cc:493] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.320551 9469 raft_consensus.cc:515] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.321079 9469 leader_election.cc:290] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.323285 9894 raft_consensus.cc:515] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.324570 9894 leader_election.cc:290] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.324054 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:45.146250 7737 leader_election.cc:304] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.319696 8053 ts_tablet_manager.cc:1434] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:45.331579 9894 raft_consensus.cc:2749] T 9f91a58d306e4dd7ab515498aa6ab32b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:45.332497 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 186364us
I20260505 20:13:45.332034 7407 catalog_manager.cc:5671] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:45.334959 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:45.335716 9271 log.cc:1199] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/949fecb197084426b5a6adb959f5c886
I20260505 20:13:45.336261 9271 ts_tablet_manager.cc:1950] T 949fecb197084426b5a6adb959f5c886 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:45.336431 7407 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
W20260505 20:13:45.350425 7870 leader_election.cc:343] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.350584 7870 leader_election.cc:304] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.351045 9619 raft_consensus.cc:2749] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:45.352224 7870 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:45.364041 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:45.364234 7934 raft_consensus.cc:3060] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.367798 7934 raft_consensus.cc:2468] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:45.371810 7870 leader_election.cc:343] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.371953 7870 leader_election.cc:304] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:45.372403 7870 leader_election.cc:343] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.372501 7870 leader_election.cc:304] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:45.372852 7870 leader_election.cc:343] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.372948 7870 leader_election.cc:304] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.373723 9619 raft_consensus.cc:2749] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:45.373915 9619 raft_consensus.cc:2749] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:45.374033 9619 raft_consensus.cc:2749] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:45.368808 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:45.378036 7921 raft_consensus.cc:2468] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:45.396253 9121 ts_tablet_manager.cc:1929] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:45.396421 9121 log.cc:1199] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f5dfabb36fa5499780b0d15c71404307
I20260505 20:13:45.396787 9121 ts_tablet_manager.cc:1950] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.397192 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 109) took 9570 ms. Trace:
I20260505 20:13:45.397297 9121 rpcz_store.cc:276] 0505 20:13:35.826913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.826989 (+ 76us) service_pool.cc:224] Handling call
0505 20:13:45.175876 (+9348887us) ts_tablet_manager.cc:1151] Deleting tablet f5dfabb36fa5499780b0d15c71404307
0505 20:13:45.175900 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.275807 (+ 99907us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.396195 (+120388us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.397171 (+ 976us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9348025}
W20260505 20:13:45.397691 7869 leader_election.cc:343] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.397714 9121 tablet_replica.cc:333] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.398397 9121 raft_consensus.cc:2243] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.398561 9121 raft_consensus.cc:2272] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.399127 9121 ts_tablet_manager.cc:1916] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.292193 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.316110 7660 raft_consensus.cc:3060] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.290540 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5dfabb36fa5499780b0d15c71404307" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.355285 9906 raft_consensus.cc:493] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:45.407516 9906 raft_consensus.cc:515] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.274014 9270 ts_tablet_manager.cc:1929] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.409440 9270 log.cc:1199] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/c720fc66db36402a83a7690d70a40353
W20260505 20:13:45.416049 7869 leader_election.cc:343] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.424261 9906 leader_election.cc:290] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:45.427973 7598 leader_election.cc:304] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.428409 7598 leader_election.cc:304] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.428714 9495 raft_consensus.cc:2804] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:45.428853 9495 raft_consensus.cc:697] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:45.429105 9398 raft_consensus.cc:2804] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:45.429174 9398 raft_consensus.cc:493] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:45.429246 9398 raft_consensus.cc:3060] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.438064 9495 consensus_queue.cc:237] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.356725 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 107) took 8096 ms. Trace:
I20260505 20:13:45.344291 8053 tablet_bootstrap.cc:492] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:45.340056 7737 leader_election.cc:304] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.441381 9842 raft_consensus.cc:2749] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:45.441674 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 101694us
I20260505 20:13:45.443674 7737 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.443935 8053 tablet_bootstrap.cc:654] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:45.444223 7737 leader_election.cc:343] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 3d74dbab83b840d9b2bd103e946d3032
I20260505 20:13:45.444391 7737 leader_election.cc:304] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.444644 9138 raft_consensus.cc:2749] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:45.444815 7398 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8da300a3c6a743829936ecbfcd9439b5 consensus state has no leader
I20260505 20:13:45.443953 9842 raft_consensus.cc:2804] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:45.445122 9842 raft_consensus.cc:493] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:45.445183 9842 raft_consensus.cc:3060] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:45.446065 9920 tablet.cc:1724] T 436489e0e72945f689ebd653804e7723 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260505 20:13:45.440630 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 121081us
I20260505 20:13:45.449391 9842 raft_consensus.cc:515] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.451344 9842 leader_election.cc:290] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:45.452075 9271 rpcz_store.cc:276] 0505 20:13:37.260236 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.260982 (+ 746us) service_pool.cc:224] Handling call
0505 20:13:44.869576 (+7608594us) ts_tablet_manager.cc:1151] Deleting tablet 949fecb197084426b5a6adb959f5c886
0505 20:13:44.869590 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.091391 (+221801us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.094897 (+ 3506us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.356701 (+261804us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26249,"tablet-delete.queue_time_us":7608463}
I20260505 20:13:45.453433 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 949fecb197084426b5a6adb959f5c886 (table default.Table_5e2133ac533b4b6084978252a3244509 [id=db04ad55e6964d88bb71e0eab4cc4f65]) successfully deleted
I20260505 20:13:45.453886 9271 tablet_replica.cc:333] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:45.454610 9271 raft_consensus.cc:2243] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.455053 9271 pending_rounds.cc:70] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:45.455260 9271 pending_rounds.cc:77] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737233538039808 op_type: NO_OP noop_request { }
W20260505 20:13:45.458772 8261 leader_election.cc:336] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755): Timed out: RequestConsensusVote RPC to 127.7.33.254:38755 timed out after 0.632s (SENT)
I20260505 20:13:45.459009 8261 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98; no voters: 73028cd481e446daa9432a35522a7967, f4615fa5639440fc820498f897adf17d
I20260505 20:13:45.455571 9271 raft_consensus.cc:2889] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:45.463603 9271 raft_consensus.cc:2272] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.470090 9398 raft_consensus.cc:515] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:45.469938 7596 leader_election.cc:343] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.471015 9398 leader_election.cc:290] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:45.475607 9928 tablet.cc:1724] T 43a3e9d404f14b43ae99c4a905f50086 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:45.476676 9270 ts_tablet_manager.cc:1950] T c720fc66db36402a83a7690d70a40353 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:45.478241 9121 ts_tablet_manager.cc:1929] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.478490 9121 log.cc:1199] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/54becbd4690c403e803a7a79f12cb6d5
I20260505 20:13:45.479094 9121 ts_tablet_manager.cc:1950] T 54becbd4690c403e803a7a79f12cb6d5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.479959 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 111) took 9652 ms. Trace:
I20260505 20:13:45.480405 9121 rpcz_store.cc:276] 0505 20:13:35.827129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.827244 (+ 115us) service_pool.cc:224] Handling call
0505 20:13:45.397670 (+9570426us) ts_tablet_manager.cc:1151] Deleting tablet 54becbd4690c403e803a7a79f12cb6d5
0505 20:13:45.397680 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.466201 (+ 68521us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.478117 (+ 11916us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.479894 (+ 1777us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9570275}
I20260505 20:13:45.480958 9121 tablet_replica.cc:333] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.482582 8054 tablet_bootstrap.cc:492] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:45.482710 8054 ts_tablet_manager.cc:1403] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.407s user 0.050s sys 0.116s
W20260505 20:13:45.482584 7596 consensus_peers.cc:597] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:45.481331 9121 raft_consensus.cc:2243] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.485105 9121 raft_consensus.cc:2272] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:45.485268 7596 leader_election.cc:343] T e6c5c661e8aa4962bb9922b9ead7d784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.486375 9121 ts_tablet_manager.cc:1916] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.493917 8054 raft_consensus.cc:359] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.494171 8054 raft_consensus.cc:385] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.494323 8054 raft_consensus.cc:740] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.494617 8054 consensus_queue.cc:260] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.495244 8054 ts_tablet_manager.cc:1434] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:45.485550 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 114) took 8212 ms. Trace:
I20260505 20:13:45.501441 8054 tablet_bootstrap.cc:492] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:45.497481 9398 consensus_queue.cc:1048] T 9f91a58d306e4dd7ab515498aa6ab32b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:45.506181 9270 rpcz_store.cc:276] 0505 20:13:37.273042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.273530 (+ 488us) service_pool.cc:224] Handling call
0505 20:13:44.859139 (+7585609us) ts_tablet_manager.cc:1151] Deleting tablet c720fc66db36402a83a7690d70a40353
0505 20:13:44.859151 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.126223 (+267072us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.273944 (+147721us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.485527 (+211583us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7585448}
I20260505 20:13:45.507174 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet c720fc66db36402a83a7690d70a40353 (table default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]) successfully deleted
W20260505 20:13:45.507656 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 134863us
I20260505 20:13:45.511889 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f5dfabb36fa5499780b0d15c71404307 (table default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]) successfully deleted
W20260505 20:13:45.515774 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 51593.5us
W20260505 20:13:45.516119 7736 leader_election.cc:343] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 84fb3dcea55d4b348cbf92c3c4581dda
W20260505 20:13:45.517087 7870 leader_election.cc:343] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.517380 7870 leader_election.cc:304] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.511211 8054 tablet_bootstrap.cc:654] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.518020 9941 raft_consensus.cc:2749] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:45.518460 9270 tablet_replica.cc:333] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:45.518712 9270 raft_consensus.cc:2243] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:45.519039 9270 pending_rounds.cc:70] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:45.528162 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 54becbd4690c403e803a7a79f12cb6d5 (table default.Table_98748ee269264963be11b33de38e1d1e [id=46cde0b7c30d4eae8254a080cb8caac8]) successfully deleted
I20260505 20:13:45.529296 9429 raft_consensus.cc:493] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.529503 9429 raft_consensus.cc:515] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.530241 9429 leader_election.cc:290] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.532986 9270 pending_rounds.cc:77] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737197028032512 op_type: NO_OP noop_request { }
I20260505 20:13:45.533535 9270 raft_consensus.cc:2889] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:45.533684 9270 raft_consensus.cc:2272] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.534324 9270 ts_tablet_manager.cc:1916] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:45.538758 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 91968.5us
W20260505 20:13:45.539119 7737 leader_election.cc:343] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 84fb3dcea55d4b348cbf92c3c4581dda
W20260505 20:13:45.532859 7870 leader_election.cc:343] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.547544 7870 leader_election.cc:304] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.548198 9619 raft_consensus.cc:2749] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:45.548916 7870 leader_election.cc:343] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.549156 7870 leader_election.cc:304] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.540071 9271 ts_tablet_manager.cc:1916] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.577636 9271 ts_tablet_manager.cc:1929] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.504133 8058 tablet_bootstrap.cc:492] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:45.603404 8058 ts_tablet_manager.cc:1403] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.414s user 0.007s sys 0.004s
I20260505 20:13:45.604370 8058 raft_consensus.cc:359] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.604652 8058 raft_consensus.cc:385] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.604756 8058 raft_consensus.cc:740] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.605046 8058 consensus_queue.cc:260] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.605842 8058 ts_tablet_manager.cc:1434] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:45.606168 8058 tablet_bootstrap.cc:492] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:45.607237 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 58348.9us
W20260505 20:13:45.607616 7870 consensus_peers.cc:597] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64a82a9d144746338b3fc6550aa35d3c. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:45.607853 7870 leader_election.cc:343] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.608023 7870 leader_election.cc:304] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.608659 9619 raft_consensus.cc:2749] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:45.608829 9619 raft_consensus.cc:2749] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:45.609398 7870 consensus_peers.cc:597] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d138d27f444f45d28acdc7d72a9649f5. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:45.609619 7870 leader_election.cc:343] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:45.611702 7598 leader_election.cc:343] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:45.618605 9271 log.cc:1199] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b9f684cd880b4a748cab49795de11503
I20260505 20:13:45.619089 9271 ts_tablet_manager.cc:1950] T b9f684cd880b4a748cab49795de11503 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:45.619922 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 98) took 8361 ms. Trace:
I20260505 20:13:45.620059 9271 rpcz_store.cc:276] 0505 20:13:37.258097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.261128 (+ 3031us) service_pool.cc:224] Handling call
0505 20:13:45.453717 (+8192589us) ts_tablet_manager.cc:1151] Deleting tablet b9f684cd880b4a748cab49795de11503
0505 20:13:45.453733 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.574130 (+120397us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.577567 (+ 3437us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.619900 (+ 42333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72726,"tablet-delete.queue_time_us":8192209}
I20260505 20:13:45.620728 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b9f684cd880b4a748cab49795de11503 (table default.Table_3558bdbcaf1644aeb0377cc616ce9dae [id=5ba6366d8ed4421ab8ff36fc82d60b6b]) successfully deleted
I20260505 20:13:45.621212 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 108) took 8360 ms. Trace:
I20260505 20:13:45.621335 9271 rpcz_store.cc:276] 0505 20:13:37.260341 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.261322 (+ 981us) service_pool.cc:224] Handling call
0505 20:13:45.621084 (+8359762us) ts_tablet_manager.cc:1151] Deleting tablet f5dfabb36fa5499780b0d15c71404307
0505 20:13:45.621095 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.621194 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8359622}
W20260505 20:13:45.621999 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f5dfabb36fa5499780b0d15c71404307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5dfabb36fa5499780b0d15c71404307 already in progress: creating tablet
I20260505 20:13:45.622732 9271 tablet_replica.cc:333] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:45.623952 9946 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260505 20:13:45.625958 8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 167347us
I20260505 20:13:45.626576 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:45.629374 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:45.575774 8054 tablet_bootstrap.cc:492] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:45.629936 8054 ts_tablet_manager.cc:1403] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.134s user 0.011s sys 0.007s
W20260505 20:13:45.630100 7870 leader_election.cc:343] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.612840 9121 ts_tablet_manager.cc:1929] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.542196 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:45.630367 9121 log.cc:1199] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/bcd289ce979940ae96554d5756d140d7
I20260505 20:13:45.630517 7921 raft_consensus.cc:3060] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.630757 9121 ts_tablet_manager.cc:1950] T bcd289ce979940ae96554d5756d140d7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.630857 8054 raft_consensus.cc:359] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.631032 8054 raft_consensus.cc:385] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.631106 8054 raft_consensus.cc:740] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.631286 8054 consensus_queue.cc:260] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.631038 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:45.631544 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 110) took 9804 ms. Trace:
I20260505 20:13:45.631628 9121 rpcz_store.cc:276] 0505 20:13:35.827034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.827446 (+ 412us) service_pool.cc:224] Handling call
0505 20:13:45.480881 (+9653435us) ts_tablet_manager.cc:1151] Deleting tablet bcd289ce979940ae96554d5756d140d7
0505 20:13:45.480890 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.591509 (+110619us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.612615 (+ 21106us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.631526 (+ 18911us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9653285}
I20260505 20:13:45.631764 8054 ts_tablet_manager.cc:1434] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:45.631989 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 112) took 9804 ms. Trace:
I20260505 20:13:45.632078 9121 rpcz_store.cc:276] 0505 20:13:35.827257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.827625 (+ 368us) service_pool.cc:224] Handling call
0505 20:13:45.631893 (+9804268us) ts_tablet_manager.cc:1151] Deleting tablet 096ca710e3564d4b8db50f29dd56a5d4
0505 20:13:45.631901 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.631975 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9804154}
I20260505 20:13:45.632340 9121 tablet_replica.cc:333] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.632510 9121 raft_consensus.cc:2243] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:45.632433 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:45.632756 9121 raft_consensus.cc:2272] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.633266 9121 ts_tablet_manager.cc:1916] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.632023 8054 tablet_bootstrap.cc:492] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:45.634012 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet bcd289ce979940ae96554d5756d140d7 (table default.Table_471e002676d8465fb3a2af7b858cd2c0 [id=3fa488eaad8a4777bfb3ff65aa8b15f2]) successfully deleted
I20260505 20:13:45.634152 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
W20260505 20:13:45.634680 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 096ca710e3564d4b8db50f29dd56a5d4 because the tablet was not found. No further retry: Not found: Tablet not found: 096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:45.635087 8054 tablet_bootstrap.cc:654] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.635115 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:45.635774 7921 raft_consensus.cc:2468] T 534726d2291044d78740896ff9031fca P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:45.636497 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:45.637168 7870 leader_election.cc:304] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:45.637640 7870 leader_election.cc:343] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.638144 9941 raft_consensus.cc:2749] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:45.638355 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1]). Expected version 1 got 0
I20260505 20:13:45.639909 9271 raft_consensus.cc:2243] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:45.640432 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
W20260505 20:13:45.582823 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 50599.1us
I20260505 20:13:45.643220 9939 consensus_queue.cc:1048] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:45.645123 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:45.647004 9939 raft_consensus.cc:493] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:45.647141 9939 raft_consensus.cc:515] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:45.647764 9939 leader_election.cc:290] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.639532 8053 tablet_bootstrap.cc:492] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:45.648772 8053 ts_tablet_manager.cc:1403] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.305s user 0.007s sys 0.005s
I20260505 20:13:45.649610 8053 raft_consensus.cc:359] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.649852 8053 raft_consensus.cc:385] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.649948 8053 raft_consensus.cc:740] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.650223 8053 consensus_queue.cc:260] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.650918 8053 ts_tablet_manager.cc:1434] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:45.651248 8053 tablet_bootstrap.cc:492] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:45.583150 7737 leader_election.cc:304] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.652501 9939 raft_consensus.cc:2749] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:45.652891 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 113833us
I20260505 20:13:45.653577 7737 leader_election.cc:304] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:45.653891 9939 raft_consensus.cc:2749] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:45.654784 8054 tablet_bootstrap.cc:492] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:45.654930 8054 ts_tablet_manager.cc:1403] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260505 20:13:45.657450 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.656852 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:45.658870 9271 raft_consensus.cc:2272] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.659503 9271 ts_tablet_manager.cc:1916] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.659744 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:45.660271 8054 raft_consensus.cc:359] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.660491 8054 raft_consensus.cc:385] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.660567 8054 raft_consensus.cc:740] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.660799 8054 consensus_queue.cc:260] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:45.661126 7870 leader_election.cc:343] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.661273 8054 ts_tablet_manager.cc:1434] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260505 20:13:45.661459 7870 leader_election.cc:343] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.661259 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:45.663151 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:45.661568 8054 tablet_bootstrap.cc:492] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:45.665326 8054 tablet_bootstrap.cc:654] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.665927 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:45.666054 9121 ts_tablet_manager.cc:1929] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.666749 9121 log.cc:1199] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f2b2e40635b141c59d3789aca81efba7
I20260505 20:13:45.668349 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:45.670641 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:45.673364 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 61038.3us
I20260505 20:13:45.675256 7598 leader_election.cc:304] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.675565 9398 raft_consensus.cc:2804] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:45.675680 9398 raft_consensus.cc:697] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:45.675899 9398 consensus_queue.cc:237] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.676123 9121 ts_tablet_manager.cc:1950] T f2b2e40635b141c59d3789aca81efba7 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.678301 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:45.679446 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:45.681267 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:45.683849 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:45.687058 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:45.688311 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:45.689553 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:45.691534 8054 tablet_bootstrap.cc:492] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:45.691867 8054 ts_tablet_manager.cc:1403] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.010s
I20260505 20:13:45.691730 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:45.693938 8054 raft_consensus.cc:359] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.694412 8054 raft_consensus.cc:385] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:45.694552 8054 raft_consensus.cc:740] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:45.695111 8054 consensus_queue.cc:260] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.695391 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:45.696676 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:45.696732 8054 ts_tablet_manager.cc:1434] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260505 20:13:45.697662 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:45.698400 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.698611 7654 raft_consensus.cc:2468] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:45.698618 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:45.701081 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:45.704941 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3679480e55444d0d935f262217e44485 (table default.Table_fa95c378428d48efba91d72f220584de [id=5579cbeef0624d4a8cb8beeac55362e9]). Expected version 1 got 0
I20260505 20:13:45.710013 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:45.715622 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:45.717082 8058 tablet_bootstrap.cc:654] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.717331 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 579bd562fea64fe69db2b4a6085b7bed (table default.Table_b32b876ca24341f7bd70ee43912ee08f [id=d29890b44f684d74b435fd28c0f5d28f]). Expected version 1 got 0
I20260505 20:13:45.720038 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:45.721733 7409 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:45.724390 7407 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c] alter complete (version 2)
I20260505 20:13:45.729257 7405 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_af2341b021674fe494cd635374e98c3e [id=3734c4511d224584aeed0efd6bac453d] alter complete (version 1)
I20260505 20:13:45.733542 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.734323 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.734530 7654 raft_consensus.cc:2468] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:45.735237 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:45.744490 7870 leader_election.cc:343] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.746311 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 296494f478244052971e12a09f0b15b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:34 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.746284 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet ee19f65120184eca9495513b68440b4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.747769 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.747929 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c5c661e8aa4962bb9922b9ead7d784 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.748065 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.748200 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet b393bfc209b6461aab958ebf49014d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.750123 7633 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.750175 7629 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.750128 7631 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.750367 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 38bc883c8e98495882e4d8ef68c9da80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:21 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.750499 7632 tablet_service.cc:1558] Processing DeleteTablet for tablet 84fb3dcea55d4b348cbf92c3c4581dda with delete_type TABLET_DATA_DELETED (replaced by tablet 56bd0f4254424c979f90da0400e0ec70) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.750911 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.751065 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.751194 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet c720fc66db36402a83a7690d70a40353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.753212 7638 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf77f6323af4263852853e10003faee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.753506 7627 tablet_service.cc:1558] Processing DeleteTablet for tablet beb404fa927641f48f28c6bdaa297db3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.753660 7635 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.753839 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.753980 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.755474 7636 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.755786 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 4939dab5a4d54a08a75424bcaabbb8dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.761101 9941 raft_consensus.cc:493] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.761325 9941 raft_consensus.cc:515] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.762148 9941 leader_election.cc:290] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.764390 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:45.769507 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f27847d940e46778ad10a2f4cf40d27" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:45.770298 7870 leader_election.cc:343] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:45.771831 9928 tablet.cc:1724] T 436489e0e72945f689ebd653804e7723 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:45.773958 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
W20260505 20:13:45.778856 7406 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8ff674539e1045408c212b533ca8a3db consensus state has no leader
W20260505 20:13:45.784924 7404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 249) took 5771 ms (client timeout 1000 ms). Trace:
W20260505 20:13:45.785213 7404 rpcz_store.cc:269] 0505 20:13:40.013798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.018355 (+ 4557us) service_pool.cc:224] Handling call
0505 20:13:45.784831 (+5766476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:41.662707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:41.663013 (+ 306us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:41.663021 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:41.663023 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:41.663233 (+ 210us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:41.663248 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:41.663254 (+ 6us) tablet.cc:685] Acquiring locks for 3 operations
0505 20:13:41.663348 (+ 94us) tablet.cc:701] Row locks acquired
0505 20:13:41.663351 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:41.663395 (+ 44us) write_op.cc:270] Start()
0505 20:13:41.663433 (+ 38us) write_op.cc:276] Timestamp: P: 1778012021663355 usec, L: 0
0505 20:13:41.663437 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:41.663795 (+ 358us) log.cc:844] Serialized 1284 byte log entry
0505 20:13:41.676322 (+ 12527us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x60c000661940. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d95eace5 00007f70d1128210 00007f70c59519c0 0000000000a91736 00007f70c5970c0a 00007f70c596c62c 00007f70c597195e 00007f70d110d43c 00007f70d111a76b 00007f70d111b1a0
0505 20:13:41.693075 (+ 16753us) op_driver.cc:464] REPLICATION: finished
0505 20:13:41.713304 (+ 20229us) write_op.cc:301] APPLY: starting
0505 20:13:41.713333 (+ 29us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:41.713435 (+ 102us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:41.713440 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:41.713582 (+ 142us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:41.713639 (+ 57us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0505 20:13:41.713650 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:41.713789 (+ 139us) log.cc:844] Serialized 35 byte log entry
0505 20:13:41.713867 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:41.713892 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:41.713900 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0505 20:13:42.020111 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.020227 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.020234 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:42.020237 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.020347 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.020363 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.020368 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:42.020435 (+ 67us) tablet.cc:701] Row locks acquired
0505 20:13:42.020438 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:42.020479 (+ 41us) write_op.cc:270] Start()
0505 20:13:42.020517 (+ 38us) write_op.cc:276] Timestamp: P: 1778012022020581 usec, L: 0
0505 20:13:42.020520 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.020729 (+ 209us) log.cc:844] Serialized 356 byte log entry
0505 20:13:42.025632 (+ 4903us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.025788 (+ 156us) write_op.cc:301] APPLY: starting
0505 20:13:42.025807 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.025854 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.025901 (+ 47us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.026044 (+ 143us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.026088 (+ 44us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:42.026100 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:42.026188 (+ 88us) log.cc:844] Serialized 23 byte log entry
0505 20:13:42.026258 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.026276 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:42.026282 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.026363 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.026367 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:42.044712 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.044841 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.044850 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:42.044852 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.044954 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.044968 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.044973 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:42.045031 (+ 58us) tablet.cc:701] Row locks acquired
0505 20:13:42.045033 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.045069 (+ 36us) write_op.cc:270] Start()
0505 20:13:42.045102 (+ 33us) write_op.cc:276] Timestamp: P: 1778012022044920 usec, L: 0
0505 20:13:42.045106 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.045311 (+ 205us) log.cc:844] Serialized 356 byte log entry
0505 20:13:42.099572 (+ 54261us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.099946 (+ 374us) write_op.cc:301] APPLY: starting
0505 20:13:42.099970 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.100016 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.100041 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.100099 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.100136 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:42.100144 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:42.100241 (+ 97us) log.cc:844] Serialized 23 byte log entry
0505 20:13:42.100311 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.100330 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:42.100337 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.100419 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.100425 (+ 6us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:42.108379 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.108501 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.108507 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:42.108509 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.108608 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.108618 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.108623 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:42.108681 (+ 58us) tablet.cc:701] Row locks acquired
0505 20:13:42.108683 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.108717 (+ 34us) write_op.cc:270] Start()
0505 20:13:42.108745 (+ 28us) write_op.cc:276] Timestamp: P: 1778012022108592 usec, L: 0
0505 20:13:42.108748 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.111795 (+ 3047us) log.cc:844] Serialized 356 byte log entry
0505 20:13:42.111979 (+ 184us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:42.334700 (+222721us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.335055 (+ 355us) write_op.cc:301] APPLY: starting
0505 20:13:42.335075 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.335118 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.335120 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.335177 (+ 57us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.335209 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:42.335216 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:42.335309 (+ 93us) log.cc:844] Serialized 23 byte log entry
0505 20:13:42.335377 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.335394 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:42.335400 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.335467 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.335470 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:42.338183 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.338301 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.338306 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:42.338309 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:42.338400 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.338410 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.338415 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:42.338469 (+ 54us) tablet.cc:701] Row locks acquired
0505 20:13:42.338471 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:42.338503 (+ 32us) write_op.cc:270] Start()
0505 20:13:42.338530 (+ 27us) write_op.cc:276] Timestamp: P: 1778012022338471 usec, L: 0
0505 20:13:42.338534 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.427570 (+ 89036us) log.cc:844] Serialized 356 byte log entry
0505 20:13:42.427793 (+ 223us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:42.475417 (+ 47624us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.475661 (+ 244us) write_op.cc:301] APPLY: starting
0505 20:13:42.475681 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.475741 (+ 60us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.475743 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.475809 (+ 66us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.475848 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:42.475856 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:42.475953 (+ 97us) log.cc:844] Serialized 23 byte log entry
0505 20:13:42.476027 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.476048 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:42.476055 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.476126 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.476131 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82422,"reported_tablets":246,"child_traces":[["op",{"apply.queue_time_us":20097,"apply.run_cpu_time_us":687,"apply.run_wall_time_us":688,"num_ops":3,"prepare.queue_time_us":148334,"prepare.run_cpu_time_us":2537,"prepare.run_wall_time_us":13753,"raft.queue_time_us":274,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":453,"replication_time_us":29587,"spinlock_wait_cycles":9834752,"thread_start_us":181390,"threads_started":3,"wal-append.queue_time_us":7402}],["op",{"apply.queue_time_us":49,"apply.run_cpu_time_us":592,"apply.run_wall_time_us":602,"num_ops":1,"prepare.queue_time_us":8875,"prepare.run_cpu_time_us":744,"prepare.run_wall_time_us":759,"raft.queue_time_us":48,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":350,"replication_time_us":5084}],["op",{"apply.queue_time_us":280,"apply.run_cpu_time_us":466,"apply.run_wall_time_us":466,"num_ops":1,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":681,"prepare.run_wall_time_us":683,"replication_time_us":54431}],["op",{"apply.queue_time_us":293,"apply.run_cpu_time_us":410,"apply.run_wall_time_us":409,"num_ops":1,"prepare.queue_time_us":4067,"prepare.run_cpu_time_us":863,"prepare.run_wall_time_us":3636,"replication_time_us":225920,"spinlock_wait_cycles":6607744}],["op",{"apply.queue_time_us":182,"apply.run_cpu_time_us":455,"apply.run_wall_time_us":455,"num_ops":1,"prepare.queue_time_us":477,"prepare.run_cpu_time_us":1820,"prepare.run_wall_time_us":89679,"raft.queue_time_us":933,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":269,"replication_time_us":136850,"spinlock_wait_cycles":204247936}]]}
I20260505 20:13:45.794752 9495 raft_consensus.cc:493] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:45.794948 9495 raft_consensus.cc:515] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:45.795708 9495 leader_election.cc:290] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:45.797391 7412 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 172) took 3542 ms. Trace:
W20260505 20:13:45.797640 7404 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 288) took 1165 ms (client timeout 1000 ms). Trace:
I20260505 20:13:45.797796 7408 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_fa95c378428d48efba91d72f220584de [id=5579cbeef0624d4a8cb8beeac55362e9] alter complete (version 1)
W20260505 20:13:45.797928 7404 rpcz_store.cc:269] 0505 20:13:44.632032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:45.797244 (+1165212us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:45.797517 (+ 273us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:45.791925 7406 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 260) took 5420 ms (client timeout 1000 ms). Trace:
W20260505 20:13:45.800161 7406 rpcz_store.cc:269] 0505 20:13:40.371025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.472157 (+101132us) service_pool.cc:224] Handling call
0505 20:13:45.791843 (+5319686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:42.137888 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:42.138005 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:42.138011 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:42.138013 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:42.149696 (+ 11683us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:42.149709 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:42.149713 (+ 4us) tablet.cc:685] Acquiring locks for 5 operations
0505 20:13:42.149940 (+ 227us) tablet.cc:701] Row locks acquired
0505 20:13:42.149943 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:42.149985 (+ 42us) write_op.cc:270] Start()
0505 20:13:42.150024 (+ 39us) write_op.cc:276] Timestamp: P: 1778012022149876 usec, L: 0
0505 20:13:42.150028 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:42.150251 (+ 223us) log.cc:844] Serialized 2039 byte log entry
0505 20:13:42.400169 (+249918us) op_driver.cc:464] REPLICATION: finished
0505 20:13:42.400698 (+ 529us) write_op.cc:301] APPLY: starting
0505 20:13:42.400722 (+ 24us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:42.400808 (+ 86us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:42.400887 (+ 79us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:42.401047 (+ 160us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:42.401103 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0505 20:13:42.401115 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:42.401227 (+ 112us) log.cc:844] Serialized 47 byte log entry
0505 20:13:42.401302 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.401330 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:42.401339 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:42.401423 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:42.401430 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":288081,"reported_tablets":243,"child_traces":[["op",{"apply.queue_time_us":415,"apply.run_cpu_time_us":714,"apply.run_wall_time_us":714,"num_ops":5,"prepare.queue_time_us":5153,"prepare.run_cpu_time_us":992,"prepare.run_wall_time_us":12458,"replication_time_us":250071}]]}
I20260505 20:13:45.803700 8054 tablet_bootstrap.cc:492] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:45.806304 8054 tablet_bootstrap.cc:654] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.813869 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 113) took 9984 ms. Trace:
I20260505 20:13:45.814347 9121 rpcz_store.cc:276] 0505 20:13:35.829771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.829863 (+ 92us) service_pool.cc:224] Handling call
0505 20:13:45.632300 (+9802437us) ts_tablet_manager.cc:1151] Deleting tablet f2b2e40635b141c59d3789aca81efba7
0505 20:13:45.632309 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.647081 (+ 14772us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.665791 (+ 18710us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.813840 (+148049us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9802223}
I20260505 20:13:45.814740 9121 tablet_replica.cc:333] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.814977 9121 raft_consensus.cc:2243] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.815135 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet f0ca8cc557674992b88f3379cc1db652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.815186 9121 raft_consensus.cc:2272] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.815577 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet f2b2e40635b141c59d3789aca81efba7 (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:45.815809 9121 ts_tablet_manager.cc:1916] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.820946 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet e32ff17c39f04bc2b1c9c37a1165399b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:30 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.797540 7412 rpcz_store.cc:276] 0505 20:13:42.254697 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:44.602616 (+2347919us) service_pool.cc:224] Handling call
0505 20:13:44.603031 (+ 415us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:44.603360 (+ 329us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:44.603575 (+ 215us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:44.603658 (+ 83us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:44.652057 (+ 48399us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:45.797202 (+1145145us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:44.635621 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:44.635722 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:44.635728 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:44.635740 (+ 12us) tablet.cc:662] Decoding operations
0505 20:13:44.635850 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:44.635864 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:44.635869 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:44.635930 (+ 61us) tablet.cc:701] Row locks acquired
0505 20:13:44.635932 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:44.635974 (+ 42us) write_op.cc:270] Start()
0505 20:13:44.636009 (+ 35us) write_op.cc:276] Timestamp: P: 1778012024635965 usec, L: 0
0505 20:13:44.636012 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:44.636195 (+ 183us) log.cc:844] Serialized 405 byte log entry
0505 20:13:44.649598 (+ 13403us) op_driver.cc:464] REPLICATION: finished
0505 20:13:44.649686 (+ 88us) write_op.cc:301] APPLY: starting
0505 20:13:44.649704 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:44.649770 (+ 66us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:44.649800 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:44.649867 (+ 67us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:44.649906 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:44.649914 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:44.650009 (+ 95us) log.cc:844] Serialized 23 byte log entry
0505 20:13:44.650073 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:44.650094 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:44.650100 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"apply.run_cpu_time_us":495,"apply.run_wall_time_us":494,"num_ops":1,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":684,"prepare.run_wall_time_us":1085,"raft.queue_time_us":10141,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":1496,"replication_time_us":13543}]]}
I20260505 20:13:45.821557 7768 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a82a9d144746338b3fc6550aa35d3c with delete_type TABLET_DATA_DELETED (replaced by tablet d49e4bb0c885499cbe30f86e15f12989) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.822337 9121 ts_tablet_manager.cc:1929] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.822443 9121 log.cc:1199] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/876496f026c84eff8fef175387d20062
I20260505 20:13:45.822790 9121 ts_tablet_manager.cc:1950] T 876496f026c84eff8fef175387d20062 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:45.827507 7408 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 051c258c37544e639000578b1b017abb consensus state has no leader
I20260505 20:13:45.829716 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.830425 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet b91ccd9761ee4386b9e80cb9c9cfa975 with delete_type TABLET_DATA_DELETED (replaced by tablet 249cad23ecfe4b9dbbd34f2a1fa899e3) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.830516 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 114) took 9998 ms. Trace:
I20260505 20:13:45.830621 9121 rpcz_store.cc:276] 0505 20:13:35.832462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.832541 (+ 79us) service_pool.cc:224] Handling call
0505 20:13:45.814680 (+9982139us) ts_tablet_manager.cc:1151] Deleting tablet 876496f026c84eff8fef175387d20062
0505 20:13:45.814695 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.819028 (+ 4333us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.822279 (+ 3251us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.830499 (+ 8220us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9981967}
I20260505 20:13:45.830780 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet f4d78ebf153640e4b2f518fb215f1bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.831357 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 876496f026c84eff8fef175387d20062 (table default.Table_69552f9e9e534627b2cf35ce35cc8d3e [id=a751be2c3deb4410bfda0de55efcfc59]) successfully deleted
I20260505 20:13:45.831879 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e453fdf9a424fe8974076fac3ad74bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.832269 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.832928 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.834234 9121 tablet_replica.cc:333] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.834460 9121 raft_consensus.cc:2243] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.834643 9121 raft_consensus.cc:2272] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.835162 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed44127b4c848bf9ed4a49ad8b106fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.835227 9121 ts_tablet_manager.cc:1916] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.836653 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d5ed062508b411eb0fa5a14637830ea with delete_type TABLET_DATA_DELETED (replaced by tablet f2b0dd5d7870453bb1b771405daeb22f) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.837025 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet 949fecb197084426b5a6adb959f5c886 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.837424 7764 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a98da176254eeb896c680fbcb98caa with delete_type TABLET_DATA_DELETED (replaced by tablet 578a9ebf768d4c73990fb2a28a9d4ccb) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.837630 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1f7a0fefa74f45a1cf3ffeac2c33fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:23 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.838099 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet c6acad22190b402d892d06ff97bd9476 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.838510 7767 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.838651 7765 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.842139 9939 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.842293 9939 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:45.843889 7736 leader_election.cc:304] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.844587 9894 raft_consensus.cc:2804] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:45.844662 9894 raft_consensus.cc:493] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:45.844735 9894 raft_consensus.cc:3060] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.845371 9429 raft_consensus.cc:493] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.845528 9429 raft_consensus.cc:515] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.846375 9429 leader_election.cc:290] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.847239 7736 leader_election.cc:304] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:45.847992 9469 raft_consensus.cc:2804] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:45.848075 9469 raft_consensus.cc:493] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:45.848150 9469 raft_consensus.cc:3060] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.849277 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet bcd289ce979940ae96554d5756d140d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.850678 9429 raft_consensus.cc:493] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.850839 9429 raft_consensus.cc:515] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.851542 9429 leader_election.cc:290] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:45.852515 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.854357 7774 tablet_service.cc:1558] Processing DeleteTablet for tablet 944aad58d3c14577a0c66edd95fdf5e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 096ca710e3564d4b8db50f29dd56a5d4) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.854569 7780 tablet_service.cc:1558] Processing DeleteTablet for tablet d138d27f444f45d28acdc7d72a9649f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.854691 7766 tablet_service.cc:1558] Processing DeleteTablet for tablet f5dfabb36fa5499780b0d15c71404307 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.854848 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_f94812915b8a4549a3a6fd917e329de1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:45.855057 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.855219 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:40056
W20260505 20:13:45.855541 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f94812915b8a4549a3a6fd917e329de1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:45.858085 9121 ts_tablet_manager.cc:1929] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.858207 9121 log.cc:1199] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/7214ab77d7904f0e9d37cb8d7a5a53a4
I20260505 20:13:45.858577 9121 ts_tablet_manager.cc:1950] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.859470 9939 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:45.860764 7736 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:45.858105 9469 raft_consensus.cc:515] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.862498 9469 leader_election.cc:290] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.864180 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 115) took 10030 ms. Trace:
I20260505 20:13:45.864842 9894 raft_consensus.cc:515] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.864264 9121 rpcz_store.cc:276] 0505 20:13:35.833527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.833582 (+ 55us) service_pool.cc:224] Handling call
0505 20:13:45.834177 (+10000595us) ts_tablet_manager.cc:1151] Deleting tablet 7214ab77d7904f0e9d37cb8d7a5a53a4
0505 20:13:45.834190 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.847718 (+ 13528us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.857999 (+ 10281us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.864158 (+ 6159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10000363}
I20260505 20:13:45.865367 9121 tablet_replica.cc:333] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.865461 9894 leader_election.cc:290] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.865579 9121 raft_consensus.cc:2243] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.865772 9121 raft_consensus.cc:2272] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.867596 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet e2554ecdcfd64ca6ba75e6b4077a5ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:45.868175 7802 raft_consensus.cc:3060] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.869190 9121 ts_tablet_manager.cc:1916] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.872283 7412 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 173) took 3612 ms. Trace:
I20260505 20:13:45.872516 7412 rpcz_store.cc:276] 0505 20:13:42.256000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:45.821566 (+3565566us) service_pool.cc:224] Handling call
0505 20:13:45.861634 (+ 40068us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:45.862230 (+ 596us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:45.868175 (+ 5945us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:45.868468 (+ 293us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:45.868744 (+ 276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:45.862835 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:45.862940 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:45.862946 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:45.862949 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:45.863037 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:45.863049 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:45.863053 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:45.863122 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:45.863134 (+ 12us) write_op.cc:260] PREPARE: finished
0505 20:13:45.863173 (+ 39us) write_op.cc:270] Start()
0505 20:13:45.863204 (+ 31us) write_op.cc:276] Timestamp: P: 1778012025863245 usec, L: 0
0505 20:13:45.863208 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:45.863903 (+ 695us) log.cc:844] Serialized 433 byte log entry
0505 20:13:45.867191 (+ 3288us) op_driver.cc:464] REPLICATION: finished
0505 20:13:45.867321 (+ 130us) write_op.cc:301] APPLY: starting
0505 20:13:45.867337 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:45.867393 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:45.867427 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:45.867525 (+ 98us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:45.867563 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:45.867570 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:45.867643 (+ 73us) log.cc:844] Serialized 29 byte log entry
0505 20:13:45.867704 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.867722 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:45.867728 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:45.867800 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.867804 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":471,"apply.run_wall_time_us":471,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":776,"prepare.run_wall_time_us":1183,"raft.queue_time_us":53,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":245,"replication_time_us":3926}]]}
I20260505 20:13:45.872699 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ca8cc557674992b88f3379cc1db652" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.874516 7412 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_67ab8a39b85d4eadb14979ca489af75d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:45.875082 7412 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67ab8a39b85d4eadb14979ca489af75d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:45.879249 7787 raft_consensus.cc:3060] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:45.880278 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ada922a36f4f329a5ff8b328dbef5f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.881004 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:45.881929 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet f3b3c646af9843048382e77b138aea44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.882346 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74dbab83b840d9b2bd103e946d3032 with delete_type TABLET_DATA_DELETED (replaced by tablet 359ab1033ccf4445862867f3f8b78ecd) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.883118 9941 raft_consensus.cc:493] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:45.883285 9941 raft_consensus.cc:515] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:45.883935 9941 leader_election.cc:290] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:45.884943 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 (table default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974 [id=5023dca3a2084d33a514ca739ffa7ba3]) successfully deleted
W20260505 20:13:45.890523 7736 leader_election.cc:343] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 0ec5c094e2bb4a4481825df17becde52
W20260505 20:13:45.906364 7413 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 286) took 3590 ms (client timeout 1000 ms). Trace:
W20260505 20:13:45.906647 7413 rpcz_store.cc:269] 0505 20:13:42.316291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.454689 (+138398us) service_pool.cc:224] Handling call
0505 20:13:45.906177 (+3451488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22149,"reported_tablets":238}
W20260505 20:13:45.909947 7736 consensus_peers.cc:597] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c720fc66db36402a83a7690d70a40353. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:45.892282 9121 ts_tablet_manager.cc:1929] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.905514 7916 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e91e29eb2e6462a975adcf9a379c421 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:24 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.914419 9121 log.cc:1199] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/28ce3efe875a43d9b30d40623bf8a385
I20260505 20:13:45.905892 7917 tablet_service.cc:1558] Processing DeleteTablet for tablet 17acb52d6cde4ced988506cee48eb040 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.906029 7912 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec5c094e2bb4a4481825df17becde52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:33 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.906301 7901 tablet_service.cc:1558] Processing DeleteTablet for tablet b9f684cd880b4a748cab49795de11503 with delete_type TABLET_DATA_DELETED (replaced by tablet 663d16be712b40859aa92277eab0c4a2) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.906399 7913 tablet_service.cc:1558] Processing DeleteTablet for tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 with delete_type TABLET_DATA_DELETED (replaced by tablet f5dfabb36fa5499780b0d15c71404307) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.906443 7907 tablet_service.cc:1558] Processing DeleteTablet for tablet 54becbd4690c403e803a7a79f12cb6d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.906556 7909 tablet_service.cc:1558] Processing DeleteTablet for tablet bde33085759f4fd8a130d80878d1e564 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.906802 7906 tablet_service.cc:1558] Processing DeleteTablet for tablet b6895af5f55b4bc183065626417090a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.907132 7914 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.907403 7900 tablet_service.cc:1558] Processing DeleteTablet for tablet b966b4bbaf9f4774af96051f857f02f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.907544 7910 tablet_service.cc:1558] Processing DeleteTablet for tablet cdda1cc266cd47c993b5d1a0a78c7df9 with delete_type TABLET_DATA_DELETED (replaced by tablet f2b2e40635b141c59d3789aca81efba7) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.907647 7915 tablet_service.cc:1558] Processing DeleteTablet for tablet 2540ed5144664ec0bfe0b548a5386176 with delete_type TABLET_DATA_DELETED (replaced by tablet 335acbbc84624d61b779a422f29919fa) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.907740 7908 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ed7c0220d147c7853c7afc1ef09607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.908195 7902 tablet_service.cc:1558] Processing DeleteTablet for tablet 608bffbbc10141e8bd19f475b95bdc65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.908363 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet e98c0e648c98488e8c5509b296824bea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.915530 9121 ts_tablet_manager.cc:1950] T 28ce3efe875a43d9b30d40623bf8a385 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:45.916033 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 116) took 10081 ms. Trace:
I20260505 20:13:45.900056 8053 tablet_bootstrap.cc:654] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:45.900396 9920 tablet.cc:1724] T c278b516135b47ee96ed61b1ae595f9a P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:45.916144 9121 rpcz_store.cc:276] 0505 20:13:35.834602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.834664 (+ 62us) service_pool.cc:224] Handling call
0505 20:13:45.865317 (+10030653us) ts_tablet_manager.cc:1151] Deleting tablet 28ce3efe875a43d9b30d40623bf8a385
0505 20:13:45.865327 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.880681 (+ 15354us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.892222 (+ 11541us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.916015 (+ 23793us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10030472}
I20260505 20:13:45.916486 9121 tablet_replica.cc:333] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.916720 9121 raft_consensus.cc:2243] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:45.916918 9121 raft_consensus.cc:2272] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.912019 7413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_041ad38b90294db79ee22d0605448fef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:45.917572 9121 ts_tablet_manager.cc:1916] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:45.921175 9758 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:45.921324 9758 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:45.921990 9758 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:45.924536 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:45.924731 7802 raft_consensus.cc:2468] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:45.929174 9121 ts_tablet_manager.cc:1929] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.929292 9121 log.cc:1199] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/004a8e72cab44d31af3369b8df1e434e
I20260505 20:13:45.929626 9121 ts_tablet_manager.cc:1950] T 004a8e72cab44d31af3369b8df1e434e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:45.928418 7413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_041ad38b90294db79ee22d0605448fef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:45.937357 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b05546a4f47aea5fae1cf767b762d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.937441 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.937357 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:45.939805 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 117) took 10104 ms. Trace:
I20260505 20:13:45.939910 9121 rpcz_store.cc:276] 0505 20:13:35.835474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.835522 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:45.916433 (+10080911us) ts_tablet_manager.cc:1151] Deleting tablet 004a8e72cab44d31af3369b8df1e434e
0505 20:13:45.916445 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.921126 (+ 4681us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.929115 (+ 7989us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.939776 (+ 10661us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10080753}
I20260505 20:13:45.940271 9121 tablet_replica.cc:333] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:45.940471 9121 raft_consensus.cc:2243] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:45.940742 9121 raft_consensus.cc:2272] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:45.941350 9121 ts_tablet_manager.cc:1916] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:45.941617 7405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 285) took 6640 ms (client timeout 1000 ms). Trace:
I20260505 20:13:45.954365 7412 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 174) took 3649 ms. Trace:
I20260505 20:13:45.954552 7412 rpcz_store.cc:276] 0505 20:13:42.304532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:45.873887 (+3569355us) service_pool.cc:224] Handling call
0505 20:13:45.875184 (+ 1297us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:45.875648 (+ 464us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:45.884310 (+ 8662us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:45.954128 (+ 69818us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:45.954265 (+ 137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:45.876203 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:45.876312 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:45.876318 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:45.876320 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:45.876394 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:45.876406 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:45.876414 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:45.876499 (+ 85us) tablet.cc:701] Row locks acquired
0505 20:13:45.876503 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:45.876549 (+ 46us) write_op.cc:270] Start()
0505 20:13:45.876585 (+ 36us) write_op.cc:276] Timestamp: P: 1778012025876625 usec, L: 0
0505 20:13:45.876591 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:45.876806 (+ 215us) log.cc:844] Serialized 433 byte log entry
0505 20:13:45.881330 (+ 4524us) op_driver.cc:464] REPLICATION: finished
0505 20:13:45.881442 (+ 112us) write_op.cc:301] APPLY: starting
0505 20:13:45.881456 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:45.881498 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:45.881522 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:45.883738 (+ 2216us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:45.883785 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:45.883793 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:45.883864 (+ 71us) log.cc:844] Serialized 29 byte log entry
0505 20:13:45.883917 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.883936 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:45.883943 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:45.884006 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.884010 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":70,"apply.run_cpu_time_us":458,"apply.run_wall_time_us":2556,"num_ops":2,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":697,"prepare.run_wall_time_us":696,"raft.queue_time_us":266,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":225,"replication_time_us":4711}]]}
I20260505 20:13:45.955628 7412 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_c96f5f09a5b74277ac2f72a83729e57a" } new_table_name: "default.Table_ba3b733a40ce48589c0b347147da20c5" modify_external_catalogs: true
I20260505 20:13:45.959793 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 883ec65f15604346813e5f87d55802fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.960242 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.960604 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 56bd0f4254424c979f90da0400e0ec70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.960889 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet e083f131eca54d98852e5685e08ef46b with delete_type TABLET_DATA_DELETED (replaced by tablet 506b421a774c4929813205dba0fac32b) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.961129 9944 raft_consensus.cc:493] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:45.961267 9944 raft_consensus.cc:515] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.961998 9944 leader_election.cc:290] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:45.964984 7870 leader_election.cc:343] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:45.965307 7870 leader_election.cc:343] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:45.965552 7870 leader_election.cc:343] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:45.944085 7405 rpcz_store.cc:269] 0505 20:13:39.300595 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.314446 (+ 13851us) service_pool.cc:224] Handling call
0505 20:13:39.422003 (+107557us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d973c358 00007f70d01d2ca6 00007f70d01d29d5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:45.940896 (+6518893us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:44.655599 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:44.655710 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:44.655715 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:44.655717 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:44.655888 (+ 171us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:44.655907 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:44.655914 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:44.655992 (+ 78us) tablet.cc:701] Row locks acquired
0505 20:13:44.655997 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:44.656037 (+ 40us) write_op.cc:270] Start()
0505 20:13:44.656072 (+ 35us) write_op.cc:276] Timestamp: P: 1778012024656036 usec, L: 0
0505 20:13:44.656078 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:44.656275 (+ 197us) log.cc:844] Serialized 356 byte log entry
0505 20:13:44.659197 (+ 2922us) op_driver.cc:464] REPLICATION: finished
0505 20:13:44.659299 (+ 102us) write_op.cc:301] APPLY: starting
0505 20:13:44.659315 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:44.659352 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:44.659392 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:44.659443 (+ 51us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:44.659478 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:44.659485 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:44.659557 (+ 72us) log.cc:844] Serialized 23 byte log entry
0505 20:13:44.659630 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:44.659647 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:44.659653 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:44.659722 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:44.659728 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":94880,"reported_tablets":230,"spinlock_wait_cycles":144962944,"child_traces":[["op",{"apply.queue_time_us":55,"apply.run_cpu_time_us":412,"apply.run_wall_time_us":412,"num_ops":1,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":721,"prepare.run_wall_time_us":1078,"raft.queue_time_us":56,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":669,"replication_time_us":3089}]]}
I20260505 20:13:45.971107 9270 ts_tablet_manager.cc:1929] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:45.971377 9270 log.cc:1199] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b596f03adbea413b813c9037d4243fae
I20260505 20:13:45.974925 7405 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9d55ccc940bc44609d7d09a1528c18e2" } modify_external_catalogs: true
I20260505 20:13:45.979635 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b2e40635b141c59d3789aca81efba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.980290 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:27 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.989450 9894 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:45.989631 9894 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:45.990303 9894 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:45.973820 9758 raft_consensus.cc:493] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:45.991609 9758 raft_consensus.cc:515] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:45.992049 9270 ts_tablet_manager.cc:1950] T b596f03adbea413b813c9037d4243fae P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:45.992257 9758 leader_election.cc:290] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:45.992985 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 115) took 8719 ms. Trace:
I20260505 20:13:45.993119 9270 rpcz_store.cc:276] 0505 20:13:37.273954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.274190 (+ 236us) service_pool.cc:224] Handling call
0505 20:13:45.518406 (+8244216us) ts_tablet_manager.cc:1151] Deleting tablet b596f03adbea413b813c9037d4243fae
0505 20:13:45.518418 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.602280 (+ 83862us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.971034 (+368754us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:45.992964 (+ 21930us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8244077}
I20260505 20:13:45.995199 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 876496f026c84eff8fef175387d20062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.995666 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1218bd76239540be9a93ca455ba3eb47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:28 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:45.997406 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 28ce3efe875a43d9b30d40623bf8a385 (table default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]) successfully deleted
I20260505 20:13:45.997782 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 004a8e72cab44d31af3369b8df1e434e (table default.Table_d74b7092fc2d4c3aa335636b0905e53f [id=bc7111d081dd4f4ba06f987ca0b9d6a3]) successfully deleted
I20260505 20:13:46.000043 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.001119 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:46.001329 7789 raft_consensus.cc:3060] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.004453 7789 raft_consensus.cc:2468] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:46.008113 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:46.010684 9121 ts_tablet_manager.cc:1929] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.010818 9121 log.cc:1199] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/20c24f9f26c84ba7b2ce85f9da4bccf8
I20260505 20:13:46.011191 9121 ts_tablet_manager.cc:1950] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:46.011554 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 118) took 10172 ms. Trace:
I20260505 20:13:46.011647 9121 rpcz_store.cc:276] 0505 20:13:35.839443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.839554 (+ 111us) service_pool.cc:224] Handling call
0505 20:13:45.940211 (+10100657us) ts_tablet_manager.cc:1151] Deleting tablet 20c24f9f26c84ba7b2ce85f9da4bccf8
0505 20:13:45.940223 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.957940 (+ 17717us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.010612 (+ 52672us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.011538 (+ 926us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10100505}
I20260505 20:13:46.011991 9121 tablet_replica.cc:333] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:46.012210 9121 raft_consensus.cc:2243] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.012418 9121 raft_consensus.cc:2272] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.013008 9121 ts_tablet_manager.cc:1916] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.017822 9429 raft_consensus.cc:493] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.017967 9429 raft_consensus.cc:515] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.018684 9429 leader_election.cc:290] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.020211 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 (table default.Table_133f54e3650c43b59175c563864bd932 [id=5248510b86d2424eb2167fd9a12ec41e]) successfully deleted
I20260505 20:13:46.043592 8053 tablet_bootstrap.cc:492] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.043859 8053 ts_tablet_manager.cc:1403] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.393s user 0.005s sys 0.003s
W20260505 20:13:46.043879 7408 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.195:36663 (request call id 287) took 2673 ms (client timeout 1000 ms). Trace:
W20260505 20:13:46.044019 7408 rpcz_store.cc:269] 0505 20:13:43.370108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:44.291500 (+921392us) service_pool.cc:224] Handling call
0505 20:13:46.043827 (+1752327us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:45.224560 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:45.226009 (+ 1449us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:45.226019 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:45.226022 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:45.226748 (+ 726us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:45.226882 (+ 134us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:45.226889 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:45.227450 (+ 561us) tablet.cc:701] Row locks acquired
0505 20:13:45.227453 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:45.227721 (+ 268us) write_op.cc:270] Start()
0505 20:13:45.227881 (+ 160us) write_op.cc:276] Timestamp: P: 1778012025227613 usec, L: 0
0505 20:13:45.228003 (+ 122us) op_driver.cc:348] REPLICATION: starting
0505 20:13:45.229451 (+ 1448us) log.cc:844] Serialized 356 byte log entry
0505 20:13:45.289697 (+ 60246us) op_driver.cc:464] REPLICATION: finished
0505 20:13:45.298697 (+ 9000us) write_op.cc:301] APPLY: starting
0505 20:13:45.298717 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:45.299198 (+ 481us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:45.299426 (+ 228us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:45.300036 (+ 610us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:45.300443 (+ 407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:45.300452 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:45.301324 (+ 872us) log.cc:844] Serialized 23 byte log entry
0505 20:13:45.302358 (+ 1034us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.302583 (+ 225us) write_op.cc:454] Released schema lock
0505 20:13:45.302801 (+ 218us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:45.303743 (+ 942us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.303932 (+ 189us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24854,"reported_tablets":246,"child_traces":[["op",{"apply.queue_time_us":8548,"apply.run_cpu_time_us":994,"apply.run_wall_time_us":5018,"num_ops":1,"prepare.queue_time_us":20646,"prepare.run_cpu_time_us":1707,"prepare.run_wall_time_us":7401,"raft.queue_time_us":229,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":336,"replication_time_us":61570,"thread_start_us":26634,"threads_started":2}]]}
I20260505 20:13:46.044909 7408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_aa48f9a5f71b4a5ca3661a5a822ce5c7" } new_table_name: "default.Table_478f5ae54e9e41f0987ddb6bd06ca657" modify_external_catalogs: true
I20260505 20:13:46.046252 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b596f03adbea413b813c9037d4243fae (table default.Table_557af34712374a3e925b6b5308c0545c [id=b4f5e0b1bf67487e86d6f9af9dc16088]) successfully deleted
I20260505 20:13:46.046622 9270 tablet_replica.cc:333] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:46.046880 9270 raft_consensus.cc:2243] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.047093 9270 raft_consensus.cc:2272] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.048147 9121 ts_tablet_manager.cc:1929] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.048278 9270 ts_tablet_manager.cc:1916] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.048291 9121 log.cc:1199] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/168d9a40a69d4beab8e79a97e7723e69
I20260505 20:13:46.048676 9121 ts_tablet_manager.cc:1950] T 168d9a40a69d4beab8e79a97e7723e69 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:45.990864 7598 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 194423us
I20260505 20:13:46.049054 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 119) took 10209 ms. Trace:
I20260505 20:13:46.049142 9121 rpcz_store.cc:276] 0505 20:13:35.839648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.839770 (+ 122us) service_pool.cc:224] Handling call
0505 20:13:46.011937 (+10172167us) ts_tablet_manager.cc:1151] Deleting tablet 168d9a40a69d4beab8e79a97e7723e69
0505 20:13:46.011950 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.032594 (+ 20644us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.048075 (+ 15481us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.049032 (+ 957us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10172017}
I20260505 20:13:46.049527 9121 tablet_replica.cc:333] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:46.050173 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.050375 7789 raft_consensus.cc:2468] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:45.978132 8058 tablet_bootstrap.cc:492] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.053606 8058 ts_tablet_manager.cc:1403] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.447s user 0.005s sys 0.001s
I20260505 20:13:46.054548 8058 raft_consensus.cc:359] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.054739 8058 raft_consensus.cc:385] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.054821 8058 raft_consensus.cc:740] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.055032 8058 consensus_queue.cc:260] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.055648 8058 ts_tablet_manager.cc:1434] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:46.056056 8058 tablet_bootstrap.cc:492] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.037591 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.057909 7870 leader_election.cc:343] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.058229 8058 tablet_bootstrap.cc:654] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.062125 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 168d9a40a69d4beab8e79a97e7723e69 (table default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]) successfully deleted
I20260505 20:13:46.063189 9758 raft_consensus.cc:493] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:46.063342 9758 raft_consensus.cc:515] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.064273 9758 leader_election.cc:290] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.069849 8053 raft_consensus.cc:359] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.071199 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.072480 8053 raft_consensus.cc:385] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.073935 8053 raft_consensus.cc:740] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.091756 8054 tablet_bootstrap.cc:492] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.091935 8054 ts_tablet_manager.cc:1403] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.288s user 0.026s sys 0.033s
I20260505 20:13:46.092788 8054 raft_consensus.cc:359] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.092978 8054 raft_consensus.cc:385] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.093046 8054 raft_consensus.cc:740] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.093269 8054 consensus_queue.cc:260] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.093847 8054 ts_tablet_manager.cc:1434] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:46.094165 8054 tablet_bootstrap.cc:492] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.094538 8053 consensus_queue.cc:260] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.096356 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2540ed5144664ec0bfe0b548a5386176" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.096553 7662 raft_consensus.cc:3060] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.096458 9121 raft_consensus.cc:2243] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.098171 9121 raft_consensus.cc:2272] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.099454 7662 raft_consensus.cc:2468] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:46.099588 7869 leader_election.cc:343] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.099699 7869 leader_election.cc:304] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.099931 9429 raft_consensus.cc:2749] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.100275 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.100433 7662 raft_consensus.cc:3060] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:46.100450 7869 leader_election.cc:343] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.100545 7869 leader_election.cc:304] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.100739 9429 raft_consensus.cc:2749] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.102427 8053 ts_tablet_manager.cc:1434] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260505 20:13:46.102767 8053 tablet_bootstrap.cc:492] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.102938 7662 raft_consensus.cc:2468] T 7447c40ad6914e75a1b1376213218624 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:46.104512 8053 tablet_bootstrap.cc:654] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.105688 8054 tablet_bootstrap.cc:654] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.106618 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.106316 9121 ts_tablet_manager.cc:1916] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.108264 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.109339 7928 raft_consensus.cc:2468] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:46.109705 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53f88d2e8b34b69bd12f53b046ed4de" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.110877 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cd1b7b0456462a80d653dd442589a6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.111100 7921 raft_consensus.cc:2393] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
W20260505 20:13:46.116423 7596 leader_election.cc:343] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.127231 8058 tablet_bootstrap.cc:492] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.127393 8058 ts_tablet_manager.cc:1403] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260505 20:13:46.128384 8058 raft_consensus.cc:359] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.128594 8058 raft_consensus.cc:385] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.128646 8058 raft_consensus.cc:740] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.128862 8058 consensus_queue.cc:260] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.130527 8058 ts_tablet_manager.cc:1434] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260505 20:13:46.131691 8058 tablet_bootstrap.cc:492] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.138296 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.138583 7654 raft_consensus.cc:2468] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:46.154887 7596 leader_election.cc:343] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.155035 7596 leader_election.cc:304] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:46.155247 8054 tablet_bootstrap.cc:492] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.155406 8054 ts_tablet_manager.cc:1403] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.001s
I20260505 20:13:46.155550 9398 raft_consensus.cc:2749] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.156239 8054 raft_consensus.cc:359] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.156462 8054 raft_consensus.cc:385] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.156518 8054 raft_consensus.cc:740] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.156723 8054 consensus_queue.cc:260] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.157292 8054 ts_tablet_manager.cc:1434] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:46.157582 8054 tablet_bootstrap.cc:492] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.159456 8054 tablet_bootstrap.cc:654] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.072753 7795 raft_consensus.cc:2468] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:46.080057 9271 ts_tablet_manager.cc:1929] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.162242 9271 log.cc:1199] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/98af33c2cdb24937858efdc7b638418f
I20260505 20:13:46.162771 9271 ts_tablet_manager.cc:1950] T 98af33c2cdb24937858efdc7b638418f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:46.163233 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 109) took 8901 ms. Trace:
I20260505 20:13:46.163374 9271 rpcz_store.cc:276] 0505 20:13:37.261581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.261627 (+ 46us) service_pool.cc:224] Handling call
0505 20:13:45.622685 (+8361058us) ts_tablet_manager.cc:1151] Deleting tablet 98af33c2cdb24937858efdc7b638418f
0505 20:13:45.622696 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:45.952962 (+330266us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.079958 (+126996us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.163200 (+ 83242us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8360898}
I20260505 20:13:46.164004 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 98af33c2cdb24937858efdc7b638418f (table default.Table_7aa09788a9b54cab8303f80b2237ee4e [id=e8647104c97e4b258208aedab9f5f35d]) successfully deleted
I20260505 20:13:46.164409 9271 tablet_replica.cc:333] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:46.164695 9271 raft_consensus.cc:2243] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.164944 9271 raft_consensus.cc:2272] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.166345 9271 ts_tablet_manager.cc:1916] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.146898 9469 raft_consensus.cc:493] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.171872 9469 raft_consensus.cc:515] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.172720 9469 leader_election.cc:290] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.177868 9398 consensus_queue.cc:1048] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.180999 7596 leader_election.cc:304] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:46.181963 9398 raft_consensus.cc:2749] T 35ada922a36f4f329a5ff8b328dbef5f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.184166 7598 leader_election.cc:343] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e98c0e648c98488e8c5509b296824bea
W20260505 20:13:46.184355 7598 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421
W20260505 20:13:46.184548 7598 leader_election.cc:343] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f62626fb4f8445e3a6e2822277181762
I20260505 20:13:46.185192 9758 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.185315 9758 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.185995 9758 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:46.186420 7736 consensus_peers.cc:597] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.187532 9928 tablet.cc:1724] T 65003660c44547cc8674baeca370e395 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260505 20:13:46.189656 7598 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 22a98da176254eeb896c680fbcb98caa
I20260505 20:13:46.190587 8054 tablet_bootstrap.cc:492] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.190745 8054 ts_tablet_manager.cc:1403] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260505 20:13:46.191540 8054 raft_consensus.cc:359] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.191726 8054 raft_consensus.cc:385] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.191787 8054 raft_consensus.cc:740] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.191988 8054 consensus_queue.cc:260] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.192510 8054 ts_tablet_manager.cc:1434] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:46.192790 8054 tablet_bootstrap.cc:492] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.194749 8054 tablet_bootstrap.cc:654] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.198175 9941 raft_consensus.cc:493] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.198351 9941 raft_consensus.cc:515] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.199054 9941 leader_election.cc:290] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.199930 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76178d1c329b4bf59fe3955f2893cd39" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.201097 7870 leader_election.cc:343] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.201915 8058 tablet_bootstrap.cc:654] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.201921 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.202081 7924 raft_consensus.cc:2468] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:46.203114 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7447c40ad6914e75a1b1376213218624" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:46.203284 7924 raft_consensus.cc:3060] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.206712 7924 raft_consensus.cc:2468] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:46.207433 7596 leader_election.cc:343] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.210373 9971 tablet.cc:1724] T 436489e0e72945f689ebd653804e7723 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:46.212424 9758 consensus_queue.cc:1048] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.214409 8054 tablet_bootstrap.cc:492] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.214556 8054 ts_tablet_manager.cc:1403] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.003s
I20260505 20:13:46.215613 8054 raft_consensus.cc:359] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.215816 8054 raft_consensus.cc:385] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.215888 8054 raft_consensus.cc:740] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.216120 8054 consensus_queue.cc:260] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.216619 8054 ts_tablet_manager.cc:1434] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:46.216890 8054 tablet_bootstrap.cc:492] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.217417 8053 tablet_bootstrap.cc:492] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.217622 8053 ts_tablet_manager.cc:1403] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.001s
I20260505 20:13:46.218559 8054 tablet_bootstrap.cc:654] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:46.219542 7736 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: b393bfc209b6461aab958ebf49014d25
I20260505 20:13:46.219798 7736 leader_election.cc:304] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.220113 9894 raft_consensus.cc:2804] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:46.220245 9894 raft_consensus.cc:697] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:46.220477 9894 consensus_queue.cc:237] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.225629 7736 leader_election.cc:304] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.226028 9270 ts_tablet_manager.cc:1929] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.226147 9270 log.cc:1199] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/a0d4e198c91c4a0e99d8b798a1dd3433
I20260505 20:13:46.226536 9270 ts_tablet_manager.cc:1950] T a0d4e198c91c4a0e99d8b798a1dd3433 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:46.226845 9944 raft_consensus.cc:2804] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:46.226027 9121 ts_tablet_manager.cc:1929] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.226979 9944 raft_consensus.cc:697] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:46.227218 9944 consensus_queue.cc:237] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.227342 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 116) took 8952 ms. Trace:
I20260505 20:13:46.227417 9270 rpcz_store.cc:276] 0505 20:13:37.274455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.274730 (+ 275us) service_pool.cc:224] Handling call
0505 20:13:46.046551 (+8771821us) ts_tablet_manager.cc:1151] Deleting tablet a0d4e198c91c4a0e99d8b798a1dd3433
0505 20:13:46.046564 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.146882 (+100318us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.225950 (+ 79068us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.227318 (+ 1368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8771681}
I20260505 20:13:46.227877 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet a0d4e198c91c4a0e99d8b798a1dd3433 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]) successfully deleted
I20260505 20:13:46.227557 9121 log.cc:1199] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8c8754580368453aa0aae021d8c665da
I20260505 20:13:46.229125 9270 tablet_replica.cc:333] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:46.232599 9121 ts_tablet_manager.cc:1950] T 8c8754580368453aa0aae021d8c665da P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:46.240525 7736 consensus_peers.cc:597] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.242527 7412 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 176) took 3911 ms. Trace:
I20260505 20:13:46.242715 7412 rpcz_store.cc:276] 0505 20:13:42.331023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:45.955406 (+3624383us) service_pool.cc:224] Handling call
0505 20:13:45.955935 (+ 529us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:45.956236 (+ 301us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:45.956434 (+ 198us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:45.956516 (+ 82us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:45.964674 (+ 8158us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:46.242456 (+277782us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:45.957113 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:45.957218 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:45.957225 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:45.957228 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:45.957329 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:45.957343 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:45.957348 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:45.957433 (+ 85us) tablet.cc:701] Row locks acquired
0505 20:13:45.957436 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:45.957472 (+ 36us) write_op.cc:270] Start()
0505 20:13:45.957508 (+ 36us) write_op.cc:276] Timestamp: P: 1778012025957580 usec, L: 0
0505 20:13:45.957512 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:45.957690 (+ 178us) log.cc:844] Serialized 405 byte log entry
0505 20:13:45.961357 (+ 3667us) op_driver.cc:464] REPLICATION: finished
0505 20:13:45.961461 (+ 104us) write_op.cc:301] APPLY: starting
0505 20:13:45.961477 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:45.961520 (+ 43us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:45.961546 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:45.961596 (+ 50us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:45.961625 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:45.961632 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:45.961704 (+ 72us) log.cc:844] Serialized 23 byte log entry
0505 20:13:45.961784 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.961804 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:45.961811 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:45.961876 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.961880 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":408,"apply.run_wall_time_us":407,"num_ops":1,"prepare.queue_time_us":59,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":703,"raft.queue_time_us":382,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":293,"replication_time_us":3818}]]}
I20260505 20:13:46.244926 7736 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.245405 7405 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9d55ccc940bc44609d7d09a1528c18e2" } modify_external_catalogs: true
I20260505 20:13:46.246250 9941 raft_consensus.cc:493] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.246448 9941 raft_consensus.cc:515] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.247084 9941 leader_election.cc:290] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.249641 9948 raft_consensus.cc:2804] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:46.249796 9948 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.249897 9948 raft_consensus.cc:3060] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.252956 9948 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.253645 9948 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.260293 9970 tablet.cc:1724] T 43a3e9d404f14b43ae99c4a905f50086 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:46.263430 7983 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:46.274984 9271 ts_tablet_manager.cc:1929] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.286628 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 121) took 10446 ms. Trace:
I20260505 20:13:46.301594 8054 tablet_bootstrap.cc:492] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.301788 8054 ts_tablet_manager.cc:1403] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.085s user 0.023s sys 0.009s
I20260505 20:13:46.302675 8054 raft_consensus.cc:359] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.302865 8054 raft_consensus.cc:385] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.302917 8054 raft_consensus.cc:740] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.303114 8054 consensus_queue.cc:260] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.303632 8054 ts_tablet_manager.cc:1434] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:46.235932 9758 raft_consensus.cc:493] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.303992 8054 tablet_bootstrap.cc:492] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.304088 9758 raft_consensus.cc:515] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.304672 9758 leader_election.cc:290] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.248404 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.256042 7596 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260505 20:13:46.305598 7870 leader_election.cc:343] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:46.235635 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 46135.6us
I20260505 20:13:46.285190 8058 tablet_bootstrap.cc:492] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.314013 8058 ts_tablet_manager.cc:1403] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.183s user 0.002s sys 0.002s
I20260505 20:13:46.288816 9121 rpcz_store.cc:276] 0505 20:13:35.839862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.839980 (+ 118us) service_pool.cc:224] Handling call
0505 20:13:46.049484 (+10209504us) ts_tablet_manager.cc:1151] Deleting tablet 8c8754580368453aa0aae021d8c665da
0505 20:13:46.049494 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.164154 (+114660us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.225380 (+ 61226us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.286265 (+ 60885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10209319}
I20260505 20:13:46.305712 8054 tablet_bootstrap.cc:654] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.314808 8058 raft_consensus.cc:359] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.314994 8058 raft_consensus.cc:385] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.315049 8058 raft_consensus.cc:740] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.315241 8058 consensus_queue.cc:260] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.218499 8053 raft_consensus.cc:359] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.315505 8053 raft_consensus.cc:385] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.315680 8053 raft_consensus.cc:740] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.315829 8058 ts_tablet_manager.cc:1434] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:46.316102 8058 tablet_bootstrap.cc:492] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.316012 8053 consensus_queue.cc:260] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.316619 8053 ts_tablet_manager.cc:1434] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.099s user 0.002s sys 0.000s
I20260505 20:13:46.316896 9271 log.cc:1199] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1cce1c38ad5a468dbf1714b4fdb0eb8a
W20260505 20:13:46.317406 7598 consensus_peers.cc:597] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bcd289ce979940ae96554d5756d140d7. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.317396 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 120) took 10477 ms. Trace:
I20260505 20:13:46.318884 8053 tablet_bootstrap.cc:492] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.320214 9971 tablet.cc:1724] T 65003660c44547cc8674baeca370e395 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260505 20:13:46.320587 9271 ts_tablet_manager.cc:1950] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:46.320930 8053 tablet_bootstrap.cc:654] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.322428 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 98af33c2cdb24937858efdc7b638418f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:25 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:46.324824 8054 tablet_bootstrap.cc:492] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.324971 8054 ts_tablet_manager.cc:1403] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.003s
I20260505 20:13:46.325815 8054 raft_consensus.cc:359] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.325868 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.326007 8054 raft_consensus.cc:385] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.326069 7921 raft_consensus.cc:2468] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:46.318621 9121 rpcz_store.cc:276] 0505 20:13:35.839752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.840209 (+ 457us) service_pool.cc:224] Handling call
0505 20:13:46.316015 (+10475806us) ts_tablet_manager.cc:1151] Deleting tablet 880cbba188144dd795873186f8cda1e9
0505 20:13:46.316293 (+ 278us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.317177 (+ 884us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10475538}
W20260505 20:13:46.326673 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 880cbba188144dd795873186f8cda1e9 because the tablet was not found. No further retry: Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9
I20260505 20:13:46.326835 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 122) took 10486 ms. Trace:
I20260505 20:13:46.327317 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 110) took 9065 ms. Trace:
I20260505 20:13:46.327109 9121 rpcz_store.cc:276] 0505 20:13:35.840393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.840513 (+ 120us) service_pool.cc:224] Handling call
0505 20:13:46.326629 (+10486116us) ts_tablet_manager.cc:1151] Deleting tablet 48cce2fd271641ad83c9b3e4beeb12ee
0505 20:13:46.326679 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.326821 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10485959}
I20260505 20:13:46.327904 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 123) took 10486 ms. Trace:
I20260505 20:13:46.328111 9121 rpcz_store.cc:276] 0505 20:13:35.841113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.841181 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:46.327691 (+10486510us) ts_tablet_manager.cc:1151] Deleting tablet 089517a7c2214dce9367b21beb555733
0505 20:13:46.327741 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.327889 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10486345}
I20260505 20:13:46.328794 9121 tablet_replica.cc:333] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:46.329463 9121 raft_consensus.cc:2243] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:46.329723 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 089517a7c2214dce9367b21beb555733 because the tablet was not found. No further retry: Not found: Tablet not found: 089517a7c2214dce9367b21beb555733
I20260505 20:13:46.330165 9121 raft_consensus.cc:2272] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.326073 8054 raft_consensus.cc:740] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.235396 9270 raft_consensus.cc:2243] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:46.333952 8054 consensus_queue.cc:260] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.334573 8054 ts_tablet_manager.cc:1434] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260505 20:13:46.327457 9271 rpcz_store.cc:276] 0505 20:13:37.261898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.262535 (+ 637us) service_pool.cc:224] Handling call
0505 20:13:46.164342 (+8901807us) ts_tablet_manager.cc:1151] Deleting tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a
0505 20:13:46.164352 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.270762 (+106410us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.274901 (+ 4139us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.327295 (+ 52394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8901638}
I20260505 20:13:46.334857 8054 tablet_bootstrap.cc:492] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.335500 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:46.336012 9271 tablet_replica.cc:333] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:46.336512 9270 raft_consensus.cc:2272] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.338083 8054 tablet_bootstrap.cc:654] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.338716 9271 raft_consensus.cc:2243] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.339624 9271 raft_consensus.cc:2272] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.343070 9941 raft_consensus.cc:493] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.343200 9941 raft_consensus.cc:515] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.345482 9941 leader_election.cc:290] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.350176 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.350731 7870 leader_election.cc:343] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.352869 9271 ts_tablet_manager.cc:1916] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.353271 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d4e198c91c4a0e99d8b798a1dd3433 with delete_type TABLET_DATA_DELETED (replaced by tablet a694c65f90f4499ab96e45fbbaa9e892) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:46.355197 7413 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 175) took 4041 ms. Trace:
I20260505 20:13:46.355331 7413 rpcz_store.cc:276] 0505 20:13:42.313835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:45.907923 (+3594088us) service_pool.cc:224] Handling call
0505 20:13:46.241631 (+333708us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.242276 (+ 645us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.285146 (+ 42870us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.354873 (+ 69727us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.355107 (+ 234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.242969 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.243102 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.243111 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:46.243115 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:46.243246 (+ 131us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.243265 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.243273 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.243371 (+ 98us) tablet.cc:701] Row locks acquired
0505 20:13:46.243375 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:46.243415 (+ 40us) write_op.cc:270] Start()
0505 20:13:46.243448 (+ 33us) write_op.cc:276] Timestamp: P: 1778012026243435 usec, L: 0
0505 20:13:46.243451 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.243635 (+ 184us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.260123 (+ 16488us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.260336 (+ 213us) write_op.cc:301] APPLY: starting
0505 20:13:46.260351 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.260396 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.260431 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.260531 (+ 100us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.260566 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.260573 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.260641 (+ 68us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.260689 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.260705 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:46.260710 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.260791 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.260796 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":172,"apply.run_cpu_time_us":433,"apply.run_wall_time_us":432,"num_ops":2,"prepare.queue_time_us":62,"prepare.run_cpu_time_us":765,"prepare.run_wall_time_us":764,"raft.queue_time_us":11043,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":385,"replication_time_us":16644}]]}
I20260505 20:13:46.356370 7413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_d66751bd7e2848cbaa9997541b6713b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:46.359073 9941 raft_consensus.cc:493] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.359225 9941 raft_consensus.cc:515] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.359830 9941 leader_election.cc:290] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.361608 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0730b34c7c4298b2ada9ead3a1c63d (DEFAULT_TABLE table=default.Table_f94812915b8a4549a3a6fd917e329de1 [id=8a0c68cf039f4c7fa7ed36d8803c91d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:46.361685 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb5e21649a4cc39764a3847fa41c21" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.362095 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0730b34c7c4298b2ada9ead3a1c63d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:46.362429 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0730b34c7c4298b2ada9ead3a1c63d (DEFAULT_TABLE table=default.Table_f94812915b8a4549a3a6fd917e329de1 [id=8a0c68cf039f4c7fa7ed36d8803c91d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:46.362810 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0730b34c7c4298b2ada9ead3a1c63d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:46.358318 7413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d66751bd7e2848cbaa9997541b6713b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:46.366614 7870 leader_election.cc:343] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.370098 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.370689 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e91e29eb2e6462a975adcf9a379c421" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.370757 9944 raft_consensus.cc:493] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.370859 7662 raft_consensus.cc:3060] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.370889 9944 raft_consensus.cc:515] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.371575 9944 leader_election.cc:290] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.371688 9944 raft_consensus.cc:493] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.371776 9944 raft_consensus.cc:515] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.372241 9944 leader_election.cc:290] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.373639 7662 raft_consensus.cc:2468] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 2.
I20260505 20:13:46.374578 9758 raft_consensus.cc:493] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.374704 9758 raft_consensus.cc:515] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.375262 9758 leader_election.cc:290] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:46.378870 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.379172 7662 raft_consensus.cc:2468] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:46.379944 8058 tablet_bootstrap.cc:654] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.381414 9270 ts_tablet_manager.cc:1916] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.381879 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0730b34c7c4298b2ada9ead3a1c63d (DEFAULT_TABLE table=default.Table_f94812915b8a4549a3a6fd917e329de1 [id=8a0c68cf039f4c7fa7ed36d8803c91d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:46.382454 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0730b34c7c4298b2ada9ead3a1c63d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:46.386382 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.389178 7598 leader_election.cc:343] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 41fdaa9781ef4331bf3f0a7f8db4c1a0
I20260505 20:13:46.389498 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet b596f03adbea413b813c9037d4243fae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:26 UTC) from {username='slave'} at 127.0.0.1:47850
W20260505 20:13:46.390498 7598 consensus_peers.cc:597] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54becbd4690c403e803a7a79f12cb6d5. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.391850 7736 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.392601 9948 raft_consensus.cc:2804] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:46.392727 9948 raft_consensus.cc:697] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:46.392968 9948 consensus_queue.cc:237] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.394013 9121 ts_tablet_manager.cc:1916] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:46.394801 7598 consensus_peers.cc:597] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 168d9a40a69d4beab8e79a97e7723e69. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.397359 7736 leader_election.cc:304] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.398936 9939 raft_consensus.cc:2804] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:46.399029 9939 raft_consensus.cc:493] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.399122 9939 raft_consensus.cc:3060] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:46.400491 7410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 261) took 3885 ms (client timeout 1000 ms). Trace:
W20260505 20:13:46.400650 7410 rpcz_store.cc:269] 0505 20:13:42.515186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.711105 (+195919us) service_pool.cc:224] Handling call
0505 20:13:46.400439 (+3689334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:44.502589 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:44.502711 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:44.502717 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:44.502719 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:44.502925 (+ 206us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:44.502940 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:44.502946 (+ 6us) tablet.cc:685] Acquiring locks for 3 operations
0505 20:13:44.503057 (+ 111us) tablet.cc:701] Row locks acquired
0505 20:13:44.503061 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:44.503104 (+ 43us) write_op.cc:270] Start()
0505 20:13:44.503139 (+ 35us) write_op.cc:276] Timestamp: P: 1778012024503248 usec, L: 0
0505 20:13:44.503142 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:44.503336 (+ 194us) log.cc:844] Serialized 1284 byte log entry
0505 20:13:44.603325 (+ 99989us) op_driver.cc:464] REPLICATION: finished
0505 20:13:44.603641 (+ 316us) write_op.cc:301] APPLY: starting
0505 20:13:44.603660 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:44.603735 (+ 75us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:44.603766 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:44.603845 (+ 79us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:44.603882 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0505 20:13:44.603889 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:44.603974 (+ 85us) log.cc:844] Serialized 35 byte log entry
0505 20:13:44.604050 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:44.604073 (+ 23us) write_op.cc:454] Released schema lock
0505 20:13:44.604080 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:44.604163 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:44.604167 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2146,"reported_tablets":260,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":519,"apply.run_wall_time_us":519,"num_ops":3,"prepare.queue_time_us":63702,"prepare.run_cpu_time_us":898,"prepare.run_wall_time_us":45126,"replication_time_us":100147}]]}
I20260505 20:13:46.403229 9939 raft_consensus.cc:515] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.404165 9939 leader_election.cc:290] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:46.415468 7411 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 250) took 4767 ms (client timeout 1000 ms). Trace:
I20260505 20:13:46.416085 8054 tablet_bootstrap.cc:492] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
W20260505 20:13:46.415627 7411 rpcz_store.cc:269] 0505 20:13:41.648080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.006228 (+358148us) service_pool.cc:224] Handling call
0505 20:13:46.415411 (+4409183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:43.482401 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:43.482582 (+ 181us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:43.482592 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:43.482596 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:43.482738 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:43.482757 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:43.482765 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:43.482851 (+ 86us) tablet.cc:701] Row locks acquired
0505 20:13:43.482855 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:43.482901 (+ 46us) write_op.cc:270] Start()
0505 20:13:43.482946 (+ 45us) write_op.cc:276] Timestamp: P: 1778012023483047 usec, L: 0
0505 20:13:43.482952 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:43.483226 (+ 274us) log.cc:844] Serialized 530 byte log entry
0505 20:13:43.486781 (+ 3555us) op_driver.cc:464] REPLICATION: finished
0505 20:13:43.486906 (+ 125us) write_op.cc:301] APPLY: starting
0505 20:13:43.486965 (+ 59us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:43.487147 (+ 182us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:43.487255 (+ 108us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:43.487374 (+ 119us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:43.487449 (+ 75us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:43.487470 (+ 21us) write_op.cc:312] APPLY: finished
0505 20:13:43.487544 (+ 74us) log.cc:844] Serialized 23 byte log entry
0505 20:13:43.487601 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:43.487621 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:43.487627 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:43.487691 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:43.487694 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:44.485070 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:44.485264 (+ 194us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:44.485273 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:44.485277 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:44.485439 (+ 162us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:44.485459 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:44.485466 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:44.485554 (+ 88us) tablet.cc:701] Row locks acquired
0505 20:13:44.485558 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:44.485603 (+ 45us) write_op.cc:270] Start()
0505 20:13:44.496121 (+ 10518us) write_op.cc:276] Timestamp: P: 1778012024485740 usec, L: 0
0505 20:13:44.496128 (+ 7us) op_driver.cc:348] REPLICATION: starting
0505 20:13:44.496369 (+ 241us) log.cc:844] Serialized 356 byte log entry
0505 20:13:44.580069 (+ 83700us) op_driver.cc:464] REPLICATION: finished
0505 20:13:44.594459 (+ 14390us) write_op.cc:301] APPLY: starting
0505 20:13:44.594486 (+ 27us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:44.594540 (+ 54us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:44.594581 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:44.596551 (+ 1970us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:44.596603 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:44.596617 (+ 14us) write_op.cc:312] APPLY: finished
0505 20:13:44.596787 (+ 170us) log.cc:844] Serialized 23 byte log entry
0505 20:13:44.596881 (+ 94us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:44.596908 (+ 27us) write_op.cc:454] Released schema lock
0505 20:13:44.596917 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":131575,"reported_tablets":268,"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":784,"apply.run_wall_time_us":784,"num_ops":1,"prepare.queue_time_us":334,"prepare.run_cpu_time_us":974,"prepare.run_wall_time_us":973,"raft.queue_time_us":491,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":279,"replication_time_us":3800}],["op",{"apply.queue_time_us":14273,"apply.run_cpu_time_us":713,"apply.run_wall_time_us":2551,"num_ops":1,"prepare.queue_time_us":136515,"prepare.run_cpu_time_us":1332,"prepare.run_wall_time_us":17503,"raft.queue_time_us":3299,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":323,"replication_time_us":83886,"thread_start_us":130612,"threads_started":2}]]}
I20260505 20:13:46.416446 8054 ts_tablet_manager.cc:1403] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.082s user 0.012s sys 0.007s
I20260505 20:13:46.416878 7411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_3e4262d289ac4cf2a732bc2c66459d09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:46.417552 7411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e4262d289ac4cf2a732bc2c66459d09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:46.418771 8054 raft_consensus.cc:359] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.419291 8054 raft_consensus.cc:385] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.419925 8054 raft_consensus.cc:740] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.420545 8058 tablet_bootstrap.cc:492] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.420686 8058 ts_tablet_manager.cc:1403] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.105s user 0.001s sys 0.001s
I20260505 20:13:46.421430 8058 raft_consensus.cc:359] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.421602 8058 raft_consensus.cc:385] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.421663 8058 raft_consensus.cc:740] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.421972 8058 consensus_queue.cc:260] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.422793 8058 ts_tablet_manager.cc:1434] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:46.422024 8054 consensus_queue.cc:260] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.423629 8058 tablet_bootstrap.cc:492] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.424417 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_0c647e85ed684787a671fbc4dfec5f16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:46.425028 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c647e85ed684787a671fbc4dfec5f16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:46.415527 9987 log.cc:927] Time spent T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260505 20:13:46.427197 8054 ts_tablet_manager.cc:1434] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260505 20:13:46.427630 8058 tablet_bootstrap.cc:654] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.432494 8053 tablet_bootstrap.cc:492] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.432713 8053 ts_tablet_manager.cc:1403] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.114s user 0.006s sys 0.000s
I20260505 20:13:46.433533 8053 raft_consensus.cc:359] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.433718 8053 raft_consensus.cc:385] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.395975 7598 leader_election.cc:304] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.433871 8053 raft_consensus.cc:740] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.434041 9704 raft_consensus.cc:2804] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:46.434140 9704 raft_consensus.cc:493] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.434214 9704 raft_consensus.cc:3060] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.434144 8053 consensus_queue.cc:260] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.434685 8053 ts_tablet_manager.cc:1434] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:46.434973 8053 tablet_bootstrap.cc:492] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.436480 8053 tablet_bootstrap.cc:654] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.436463 9906 consensus_queue.cc:1048] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.437121 9704 raft_consensus.cc:515] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.437733 9704 leader_election.cc:290] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.438359 9906 consensus_queue.cc:1048] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:46.439733 7598 leader_election.cc:343] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1e453fdf9a424fe8974076fac3ad74bf
W20260505 20:13:46.444233 7596 consensus_peers.cc:597] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 949fecb197084426b5a6adb959f5c886. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.445889 9271 ts_tablet_manager.cc:1929] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.446041 9271 log.cc:1199] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b8d50ceda0ff4bb6b49920c922dfee9e
W20260505 20:13:46.447886 7596 leader_election.cc:343] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:46.449954 7397 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 051c258c37544e639000578b1b017abb consensus state has no leader
W20260505 20:13:46.450768 7407 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 251) took 2412 ms (client timeout 1000 ms). Trace:
I20260505 20:13:46.451164 7413 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 179) took 3794 ms. Trace:
I20260505 20:13:46.451282 7413 rpcz_store.cc:276] 0505 20:13:42.656605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.356067 (+3699462us) service_pool.cc:224] Handling call
0505 20:13:46.364489 (+ 8422us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.369113 (+ 4624us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.386651 (+ 17538us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.450949 (+ 64298us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.451100 (+ 151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.375774 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.375921 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.375929 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:46.375931 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.376043 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.376059 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.376064 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.376172 (+ 108us) tablet.cc:701] Row locks acquired
0505 20:13:46.376177 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:46.376225 (+ 48us) write_op.cc:270] Start()
0505 20:13:46.376274 (+ 49us) write_op.cc:276] Timestamp: P: 1778012026376294 usec, L: 0
0505 20:13:46.376280 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.376494 (+ 214us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.381036 (+ 4542us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.381198 (+ 162us) write_op.cc:301] APPLY: starting
0505 20:13:46.381223 (+ 25us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.381276 (+ 53us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.381302 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.381427 (+ 125us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.381462 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.381469 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.381549 (+ 80us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.381609 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.381631 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:46.381638 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.381705 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.381708 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":503,"apply.run_wall_time_us":502,"num_ops":2,"prepare.queue_time_us":2828,"prepare.run_cpu_time_us":826,"prepare.run_wall_time_us":826,"replication_time_us":4720}]]}
I20260505 20:13:46.452732 7413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_a921d77be67041078921ff843f067f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:46.453624 7596 leader_election.cc:343] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:46.453786 7596 leader_election.cc:304] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:46.453876 7413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a921d77be67041078921ff843f067f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:46.454273 9704 raft_consensus.cc:2749] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:46.455250 7596 leader_election.cc:343] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.463714 7596 leader_election.cc:304] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:46.464319 9704 raft_consensus.cc:2804] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:46.464340 7411 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 180) took 3804 ms. Trace:
I20260505 20:13:46.464483 9704 raft_consensus.cc:493] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.464695 9704 raft_consensus.cc:3060] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.466825 8054 tablet_bootstrap.cc:492] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.468106 9704 raft_consensus.cc:515] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.468273 7413 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 182) took 3802 ms. Trace:
I20260505 20:13:46.468865 9704 leader_election.cc:290] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:46.462834 9271 ts_tablet_manager.cc:1950] T b8d50ceda0ff4bb6b49920c922dfee9e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:46.468561 7413 rpcz_store.cc:276] 0505 20:13:42.665677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.451918 (+3786241us) service_pool.cc:224] Handling call
0505 20:13:46.454137 (+ 2219us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.455105 (+ 968us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.467768 (+ 12663us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.467985 (+ 217us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.468182 (+ 197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.460930 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.461145 (+ 215us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.461150 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:46.461152 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.461329 (+ 177us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.461342 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.461347 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.461485 (+ 138us) tablet.cc:701] Row locks acquired
0505 20:13:46.461488 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:46.461553 (+ 65us) write_op.cc:270] Start()
0505 20:13:46.461618 (+ 65us) write_op.cc:276] Timestamp: P: 1778012026461658 usec, L: 0
0505 20:13:46.461622 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.461927 (+ 305us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.467171 (+ 5244us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.467264 (+ 93us) write_op.cc:301] APPLY: starting
0505 20:13:46.467276 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.467314 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.467337 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.467438 (+ 101us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.467467 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.467474 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.467537 (+ 63us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.467591 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.467608 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:46.467614 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.467678 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.467682 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":53,"apply.run_cpu_time_us":405,"apply.run_wall_time_us":404,"num_ops":2,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":819,"prepare.run_wall_time_us":1124,"replication_time_us":5520}]]}
W20260505 20:13:46.471316 7596 leader_election.cc:343] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: f62626fb4f8445e3a6e2822277181762
I20260505 20:13:46.471519 7596 leader_election.cc:304] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:46.472007 9704 raft_consensus.cc:2749] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:46.472728 9121 ts_tablet_manager.cc:1929] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.472853 9121 log.cc:1199] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b17da5cf513647d9b8e582a9b3b460a1
W20260505 20:13:46.473104 7596 leader_election.cc:343] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 22a98da176254eeb896c680fbcb98caa
I20260505 20:13:46.473274 9121 ts_tablet_manager.cc:1950] T b17da5cf513647d9b8e582a9b3b460a1 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:46.473251 7596 leader_election.cc:304] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:46.473785 9704 raft_consensus.cc:2749] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:46.474069 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 124) took 10632 ms. Trace:
I20260505 20:13:46.474160 9121 rpcz_store.cc:276] 0505 20:13:35.841598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.841660 (+ 62us) service_pool.cc:224] Handling call
0505 20:13:46.328666 (+10487006us) ts_tablet_manager.cc:1151] Deleting tablet b17da5cf513647d9b8e582a9b3b460a1
0505 20:13:46.328675 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.423176 (+ 94501us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.472667 (+ 49491us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.474049 (+ 1382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10486777}
I20260505 20:13:46.474490 9121 tablet_replica.cc:333] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:46.474690 9121 raft_consensus.cc:2243] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.474650 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b17da5cf513647d9b8e582a9b3b460a1 (table default.Table_3320012d7d2d474e8bb80df0f8f7ee59 [id=37a0fe2c6a244790a917bf66649e81ee]) successfully deleted
I20260505 20:13:46.474874 9121 raft_consensus.cc:2272] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.475447 9121 ts_tablet_manager.cc:1916] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.472548 7413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_270a7713798242e4a709ebcbe0e0da03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:46.464691 7411 rpcz_store.cc:276] 0505 20:13:42.659560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.416608 (+3757048us) service_pool.cc:224] Handling call
0505 20:13:46.455437 (+ 38829us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.456810 (+ 1373us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.463706 (+ 6896us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.463984 (+ 278us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.464191 (+ 207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.457921 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.458137 (+ 216us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.458142 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:46.458144 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.458345 (+ 201us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.458357 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.458362 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.458539 (+ 177us) tablet.cc:701] Row locks acquired
0505 20:13:46.458541 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.458608 (+ 67us) write_op.cc:270] Start()
0505 20:13:46.458672 (+ 64us) write_op.cc:276] Timestamp: P: 1778012026458681 usec, L: 0
0505 20:13:46.458676 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.459040 (+ 364us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.463110 (+ 4070us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.463206 (+ 96us) write_op.cc:301] APPLY: starting
0505 20:13:46.463220 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.463262 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.463296 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.463396 (+ 100us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.463433 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.463440 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.463508 (+ 68us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.463566 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.463581 (+ 15us) write_op.cc:454] Released schema lock
0505 20:13:46.463588 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.463658 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.463662 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":445,"apply.run_wall_time_us":445,"num_ops":2,"prepare.queue_time_us":164,"prepare.run_cpu_time_us":936,"prepare.run_wall_time_us":1286,"replication_time_us":4407}]]}
I20260505 20:13:46.477267 7410 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 181) took 3814 ms. Trace:
I20260505 20:13:46.477396 7410 rpcz_store.cc:276] 0505 20:13:42.662383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.424218 (+3761835us) service_pool.cc:224] Handling call
0505 20:13:46.451191 (+ 26973us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.451776 (+ 585us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.476932 (+ 25156us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.476941 (+ 9us) write_op.cc:454] Released schema lock
0505 20:13:46.477024 (+ 83us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.477136 (+ 112us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.477226 (+ 90us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.452617 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.452755 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.452762 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:46.452764 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.452880 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.452893 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.452898 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.452975 (+ 77us) tablet.cc:701] Row locks acquired
0505 20:13:46.452978 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:46.453019 (+ 41us) write_op.cc:270] Start()
0505 20:13:46.453055 (+ 36us) write_op.cc:276] Timestamp: P: 1778012026453121 usec, L: 0
0505 20:13:46.453059 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.453294 (+ 235us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.457129 (+ 3835us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.457238 (+ 109us) write_op.cc:301] APPLY: starting
0505 20:13:46.457256 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.457304 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.457348 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.457463 (+ 115us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.457500 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.457507 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.457584 (+ 77us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.457646 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.457667 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:46.457674 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":487,"apply.run_wall_time_us":486,"num_ops":2,"prepare.queue_time_us":57,"prepare.run_cpu_time_us":744,"prepare.run_wall_time_us":1132,"raft.queue_time_us":101,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":2608,"replication_time_us":4039}]]}
I20260505 20:13:46.478554 7410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_c7157ba30a7545deacef9ed5821f90b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:46.479099 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
W20260505 20:13:46.479206 7410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7157ba30a7545deacef9ed5821f90b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:46.479305 7930 raft_consensus.cc:3060] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.482482 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 111) took 9219 ms. Trace:
I20260505 20:13:46.482636 7930 raft_consensus.cc:2468] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:46.482095 7411 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_13e34bc0465a46e392ef089f7b07a2c8" } modify_external_catalogs: true
W20260505 20:13:46.483376 7413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_270a7713798242e4a709ebcbe0e0da03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:46.484385 9271 rpcz_store.cc:276] 0505 20:13:37.262835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.262965 (+ 130us) service_pool.cc:224] Handling call
0505 20:13:46.335957 (+9072992us) ts_tablet_manager.cc:1151] Deleting tablet b8d50ceda0ff4bb6b49920c922dfee9e
0505 20:13:46.335969 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.437333 (+101364us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.445814 (+ 8481us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.482457 (+ 36643us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9072846}
I20260505 20:13:46.485123 7411 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_13e34bc0465a46e392ef089f7b07a2c8" } modify_external_catalogs: true
I20260505 20:13:46.488082 8054 tablet_bootstrap.cc:654] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.488485 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b8d50ceda0ff4bb6b49920c922dfee9e (table default.Table_4236c5f7709145e588050eb7b3d4ae44 [id=4073d8bcda1046afb42e5be3af1a9acf]) successfully deleted
W20260505 20:13:46.450987 7407 rpcz_store.cc:269] 0505 20:13:44.038183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:44.379944 (+341761us) service_pool.cc:224] Handling call
0505 20:13:46.450720 (+2070776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:45.348280 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:45.348409 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:45.348415 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:45.348417 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:45.348629 (+ 212us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:45.348646 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:45.348655 (+ 9us) tablet.cc:685] Acquiring locks for 3 operations
0505 20:13:45.348783 (+ 128us) tablet.cc:701] Row locks acquired
0505 20:13:45.348787 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:45.348836 (+ 49us) write_op.cc:270] Start()
0505 20:13:45.348881 (+ 45us) write_op.cc:276] Timestamp: P: 1778012025348888 usec, L: 0
0505 20:13:45.348886 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:45.349137 (+ 251us) log.cc:844] Serialized 1284 byte log entry
0505 20:13:45.357070 (+ 7933us) op_driver.cc:464] REPLICATION: finished
0505 20:13:45.357241 (+ 171us) write_op.cc:301] APPLY: starting
0505 20:13:45.357261 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:45.357328 (+ 67us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:45.357357 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:45.357443 (+ 86us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:45.357484 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0505 20:13:45.357491 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:45.357569 (+ 78us) log.cc:844] Serialized 35 byte log entry
0505 20:13:45.357649 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.357676 (+ 27us) write_op.cc:454] Released schema lock
0505 20:13:45.357683 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:45.357779 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.357783 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:45.414079 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:45.414270 (+ 191us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:45.414280 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:45.414285 (+ 5us) tablet.cc:662] Decoding operations
0505 20:13:45.414406 (+ 121us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:45.414423 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:45.414427 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:45.414487 (+ 60us) tablet.cc:701] Row locks acquired
0505 20:13:45.414490 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:45.414530 (+ 40us) write_op.cc:270] Start()
0505 20:13:45.414583 (+ 53us) write_op.cc:276] Timestamp: P: 1778012025414609 usec, L: 0
0505 20:13:45.414588 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:45.414779 (+ 191us) log.cc:844] Serialized 356 byte log entry
0505 20:13:45.419110 (+ 4331us) op_driver.cc:464] REPLICATION: finished
0505 20:13:45.419235 (+ 125us) write_op.cc:301] APPLY: starting
0505 20:13:45.419252 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:45.419296 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:45.419362 (+ 66us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:45.419414 (+ 52us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:45.419448 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:45.419456 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:45.419522 (+ 66us) log.cc:844] Serialized 23 byte log entry
0505 20:13:45.419590 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.419608 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:45.419614 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:45.419677 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:45.419681 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88470,"reported_tablets":270,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":513,"apply.run_wall_time_us":513,"num_ops":3,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":983,"prepare.run_wall_time_us":983,"raft.queue_time_us":3646,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":272,"replication_time_us":8150}],["op",{"apply.queue_time_us":38,"apply.run_cpu_time_us":443,"apply.run_wall_time_us":444,"num_ops":1,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":824,"prepare.run_wall_time_us":824,"raft.queue_time_us":48,"raft.run_cpu_time_us":599,"raft.run_wall_time_us":598,"replication_time_us":4482}]]}
I20260505 20:13:46.489559 9271 tablet_replica.cc:333] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:46.490072 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_931c21464de44ef0b036b4024d64f4c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:46.490717 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_931c21464de44ef0b036b4024d64f4c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:46.491685 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5dfabb36fa5499780b0d15c71404307" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.492292 9271 raft_consensus.cc:2243] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.493873 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.494585 9271 raft_consensus.cc:2272] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.496954 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.500211 9906 raft_consensus.cc:493] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.500385 9906 raft_consensus.cc:515] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.501070 9906 leader_election.cc:290] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.502540 7776 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cce1c38ad5a468dbf1714b4fdb0eb8a with delete_type TABLET_DATA_DELETED (replaced by tablet e083f131eca54d98852e5685e08ef46b) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:46.503065 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet b8d50ceda0ff4bb6b49920c922dfee9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:29 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:46.505967 9271 ts_tablet_manager.cc:1916] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.507097 7413 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 183) took 3838 ms. Trace:
I20260505 20:13:46.508275 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f27847d940e46778ad10a2f4cf40d27" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.508443 7785 raft_consensus.cc:2468] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:46.509524 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.511864 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.512107 7662 raft_consensus.cc:2393] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:46.507928 7413 rpcz_store.cc:276] 0505 20:13:42.667802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.471102 (+3803300us) service_pool.cc:224] Handling call
0505 20:13:46.484555 (+ 13453us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.493572 (+ 9017us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.506001 (+ 12429us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.506230 (+ 229us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.506568 (+ 338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.501190 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.501291 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.501297 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:46.501299 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.501405 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.501418 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.501422 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.501496 (+ 74us) tablet.cc:701] Row locks acquired
0505 20:13:46.501498 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.501532 (+ 34us) write_op.cc:270] Start()
0505 20:13:46.501561 (+ 29us) write_op.cc:276] Timestamp: P: 1778012026501654 usec, L: 0
0505 20:13:46.501564 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.501718 (+ 154us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.504821 (+ 3103us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.504948 (+ 127us) write_op.cc:301] APPLY: starting
0505 20:13:46.504965 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.505013 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.505037 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.505152 (+ 115us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.505192 (+ 40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.505200 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:46.505275 (+ 75us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.505332 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.505352 (+ 20us) write_op.cc:454] Released schema lock
0505 20:13:46.505357 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.505421 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.505424 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76,"apply.run_cpu_time_us":468,"apply.run_wall_time_us":467,"num_ops":2,"prepare.queue_time_us":231,"prepare.run_cpu_time_us":671,"prepare.run_wall_time_us":962,"raft.queue_time_us":34,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":228,"replication_time_us":3227}]]}
I20260505 20:13:46.518095 7410 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 185) took 3595 ms. Trace:
I20260505 20:13:46.517483 7413 master_service.cc:954] ReplaceTablet: received request to replace tablet f6eaa274f7ef4cd6b9752f14b143ab6c from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:46.518239 7410 rpcz_store.cc:276] 0505 20:13:42.922242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.478333 (+3556091us) service_pool.cc:224] Handling call
0505 20:13:46.479303 (+ 970us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.479783 (+ 480us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.517736 (+ 37953us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.517947 (+ 211us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.518059 (+ 112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.480469 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.480572 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.480577 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:46.480580 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:46.480671 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.480685 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.480690 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.480793 (+ 103us) tablet.cc:701] Row locks acquired
0505 20:13:46.480795 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.480830 (+ 35us) write_op.cc:270] Start()
0505 20:13:46.480861 (+ 31us) write_op.cc:276] Timestamp: P: 1778012026480944 usec, L: 0
0505 20:13:46.480865 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.481041 (+ 176us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.485370 (+ 4329us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.485482 (+ 112us) write_op.cc:301] APPLY: starting
0505 20:13:46.485499 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.485559 (+ 60us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.485596 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.485801 (+ 205us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.485844 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.485851 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.485932 (+ 81us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.485997 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.486021 (+ 24us) write_op.cc:454] Released schema lock
0505 20:13:46.486042 (+ 21us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.486123 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.486127 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":629,"apply.run_wall_time_us":628,"num_ops":2,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":684,"prepare.run_wall_time_us":684,"raft.queue_time_us":93,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":678,"replication_time_us":4476}]]}
I20260505 20:13:46.521340 7413 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 187) took 3256 ms. Trace:
I20260505 20:13:46.522605 7410 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_6ffbc06ec7fd4793b25a6183080486ae" } modify_external_catalogs: true
I20260505 20:13:46.522815 7410 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_6ffbc06ec7fd4793b25a6183080486ae" } modify_external_catalogs: true
I20260505 20:13:46.522704 7413 rpcz_store.cc:276] 0505 20:13:43.264479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.516662 (+3252183us) service_pool.cc:224] Handling call
0505 20:13:46.521055 (+ 4393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:46.524011 8053 tablet_bootstrap.cc:492] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.524286 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 186) took 3576 ms. Trace:
I20260505 20:13:46.525496 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.525887 8053 ts_tablet_manager.cc:1403] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.004s
I20260505 20:13:46.525705 7407 rpcz_store.cc:276] 0505 20:13:42.947779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.489719 (+3541940us) service_pool.cc:224] Handling call
0505 20:13:46.490806 (+ 1087us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:46.491264 (+ 458us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:46.523871 (+ 32607us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.523879 (+ 8us) write_op.cc:454] Released schema lock
0505 20:13:46.523960 (+ 81us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:46.524144 (+ 184us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:46.524235 (+ 91us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.491895 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.492021 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.492028 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:46.492032 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:46.492136 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.492151 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.492155 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.492240 (+ 85us) tablet.cc:701] Row locks acquired
0505 20:13:46.492242 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.492280 (+ 38us) write_op.cc:270] Start()
0505 20:13:46.492312 (+ 32us) write_op.cc:276] Timestamp: P: 1778012026492396 usec, L: 0
0505 20:13:46.492315 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.492491 (+ 176us) log.cc:844] Serialized 433 byte log entry
0505 20:13:46.495686 (+ 3195us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.495788 (+ 102us) write_op.cc:301] APPLY: starting
0505 20:13:46.495806 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.495850 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.495897 (+ 47us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.496009 (+ 112us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.496047 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:46.496054 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.496128 (+ 74us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.496189 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.496207 (+ 18us) write_op.cc:454] Released schema lock
0505 20:13:46.496214 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":53,"apply.run_cpu_time_us":481,"apply.run_wall_time_us":483,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":720,"prepare.run_wall_time_us":1052,"raft.queue_time_us":30,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":221,"replication_time_us":3343}]]}
I20260505 20:13:46.526620 7407 master_service.cc:954] ReplaceTablet: received request to replace tablet 9f91a58d306e4dd7ab515498aa6ab32b from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:46.526911 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b05546a4f47aea5fae1cf767b762d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.526760 7413 master_service.cc:954] ReplaceTablet: received request to replace tablet f1425e08c7c342e3bc05074645969b2c from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:46.527911 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.529139 8054 tablet_bootstrap.cc:492] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.529287 8054 ts_tablet_manager.cc:1403] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.001s
I20260505 20:13:46.530149 8054 raft_consensus.cc:359] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.530318 8054 raft_consensus.cc:385] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.530375 8054 raft_consensus.cc:740] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.530511 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76178d1c329b4bf59fe3955f2893cd39" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.530570 8054 consensus_queue.cc:260] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.533943 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.534636 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.538421 9619 raft_consensus.cc:493] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.538560 9619 raft_consensus.cc:515] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.539178 9619 leader_election.cc:290] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.541446 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d78ebf153640e4b2f518fb215f1bf1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.542150 7870 leader_election.cc:343] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.543597 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb5e21649a4cc39764a3847fa41c21" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.545976 7596 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:46.546489 9906 raft_consensus.cc:2764] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260505 20:13:46.547142 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4816f1ccb82e4641b2dcfe9ce9b55fae" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.552524 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.552735 7931 raft_consensus.cc:2393] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:46.552784 8058 tablet_bootstrap.cc:492] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.552924 8058 ts_tablet_manager.cc:1403] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.002s
I20260505 20:13:46.553463 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49e4bb0c885499cbe30f86e15f12989" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.554558 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:46.554757 7931 raft_consensus.cc:2393] T 6375582031e0445086c58402e8b189c0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
W20260505 20:13:46.560755 7869 leader_election.cc:343] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.560885 7869 leader_election.cc:304] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:46.561045 7869 raft_consensus.cc:2686] T f5dfabb36fa5499780b0d15c71404307 P 974ed93a43c54ccbb58e60bfdae7c546: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260505 20:13:46.561946 7869 leader_election.cc:343] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.562052 7869 leader_election.cc:304] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:46.563512 7869 leader_election.cc:343] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.563609 7869 leader_election.cc:304] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.564038 9429 raft_consensus.cc:2749] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.564302 9619 raft_consensus.cc:2749] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.566898 9271 ts_tablet_manager.cc:1929] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.567447 7413 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet f1425e08c7c342e3bc05074645969b2c
I20260505 20:13:46.568342 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet f1425e08c7c342e3bc05074645969b2c with delete_type TABLET_DATA_DELETED (replaced by tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:46.568393 7869 leader_election.cc:304] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.568746 9619 raft_consensus.cc:2804] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:46.568804 7413 catalog_manager.cc:6741] ReplaceTablet: tablet f1425e08c7c342e3bc05074645969b2c deleted and replaced by tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf
I20260505 20:13:46.568820 9619 raft_consensus.cc:493] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.568888 9619 raft_consensus.cc:3060] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.569849 7413 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 189) took 3251 ms. Trace:
I20260505 20:13:46.569957 7413 rpcz_store.cc:276] 0505 20:13:43.317844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.526134 (+3208290us) service_pool.cc:224] Handling call
0505 20:13:46.568906 (+ 42772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.545411 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.545544 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.545552 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:46.545554 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.545672 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.545687 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.545691 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.545801 (+ 110us) tablet.cc:701] Row locks acquired
0505 20:13:46.545803 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.545843 (+ 40us) write_op.cc:270] Start()
0505 20:13:46.547878 (+ 2035us) write_op.cc:276] Timestamp: P: 1778012026545981 usec, L: 0
0505 20:13:46.547885 (+ 7us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.558132 (+ 10247us) log.cc:844] Serialized 625 byte log entry
0505 20:13:46.561897 (+ 3765us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.562007 (+ 110us) write_op.cc:301] APPLY: starting
0505 20:13:46.562026 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.562077 (+ 51us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.562107 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.562223 (+ 116us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.562292 (+ 69us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:46.562304 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:46.562392 (+ 88us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.562474 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.562498 (+ 24us) write_op.cc:454] Released schema lock
0505 20:13:46.562508 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.562592 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.562596 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":56,"apply.run_cpu_time_us":573,"apply.run_wall_time_us":573,"num_ops":2,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":928,"prepare.run_wall_time_us":14003,"raft.queue_time_us":39,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":270,"replication_time_us":13975}]]}
I20260505 20:13:46.570484 9270 ts_tablet_manager.cc:1929] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.570586 9270 log.cc:1199] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e69bdfc75a494635837178cb16c08c1c
I20260505 20:13:46.570930 9270 ts_tablet_manager.cc:1950] T e69bdfc75a494635837178cb16c08c1c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:46.571420 9619 raft_consensus.cc:515] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.571604 7413 master_service.cc:954] ReplaceTablet: received request to replace tablet 624398f68961440f8369a7859b0724c4 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:46.571990 7413 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 191) took 2983 ms. Trace:
I20260505 20:13:46.572084 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 117) took 9297 ms. Trace:
I20260505 20:13:46.572549 7413 rpcz_store.cc:276] 0505 20:13:43.588739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.570675 (+2981936us) service_pool.cc:224] Handling call
0505 20:13:46.571956 (+ 1281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:46.572919 7413 master_service.cc:954] ReplaceTablet: received request to replace tablet 5060bba634d440a09840e36e37a80d46 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:46.574234 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f27847d940e46778ad10a2f4cf40d27" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:46.575086 7870 leader_election.cc:343] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.575604 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet f1425e08c7c342e3bc05074645969b2c with delete_type TABLET_DATA_DELETED (replaced by tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:46.575728 7409 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 262) took 2655 ms (client timeout 1000 ms). Trace:
I20260505 20:13:46.575816 9619 leader_election.cc:290] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:46.575848 7409 rpcz_store.cc:269] 0505 20:13:43.920394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:44.313458 (+393064us) service_pool.cc:224] Handling call
0505 20:13:46.575660 (+2262202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133901,"reported_tablets":266}
I20260505 20:13:46.576287 7409 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_5a10edf039e649cdaebec19cc78b2149" } new_table_name: "default.Table_c4f910d5074640b49ae08dc7c5966877" modify_external_catalogs: true
W20260505 20:13:46.576715 7869 leader_election.cc:343] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.576818 7869 leader_election.cc:304] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.577251 9619 raft_consensus.cc:2749] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.578229 7869 leader_election.cc:343] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.578387 7869 leader_election.cc:304] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.578804 9619 raft_consensus.cc:2749] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.579193 7869 leader_election.cc:343] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.579341 7869 leader_election.cc:304] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.579694 9619 raft_consensus.cc:2749] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.580047 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 9f91a58d306e4dd7ab515498aa6ab32b
I20260505 20:13:46.580901 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f91a58d306e4dd7ab515498aa6ab32b with delete_type TABLET_DATA_DELETED (replaced by tablet ef11066bc0d24d19910df97e73fbb3cd) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:46.581199 7407 catalog_manager.cc:6741] ReplaceTablet: tablet 9f91a58d306e4dd7ab515498aa6ab32b deleted and replaced by tablet ef11066bc0d24d19910df97e73fbb3cd
I20260505 20:13:46.581386 7407 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 190) took 3224 ms. Trace:
I20260505 20:13:46.581501 7407 rpcz_store.cc:276] 0505 20:13:43.357258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.526574 (+3169316us) service_pool.cc:224] Handling call
0505 20:13:46.569093 (+ 42519us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d974e85b 00007f70d01e2107 00007f70d01e1e35 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:46.581322 (+ 12229us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.571542 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.573233 (+ 1691us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.573239 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:46.573242 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:46.573367 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.573381 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.573386 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.573465 (+ 79us) tablet.cc:701] Row locks acquired
0505 20:13:46.573468 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:46.573509 (+ 41us) write_op.cc:270] Start()
0505 20:13:46.573549 (+ 40us) write_op.cc:276] Timestamp: P: 1778012026573660 usec, L: 0
0505 20:13:46.573553 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.573737 (+ 184us) log.cc:844] Serialized 659 byte log entry
0505 20:13:46.578818 (+ 5081us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.578930 (+ 112us) write_op.cc:301] APPLY: starting
0505 20:13:46.578948 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.578995 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.579029 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.579155 (+ 126us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.579217 (+ 62us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:46.579224 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.579320 (+ 96us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.579381 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.579406 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:46.579415 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.579483 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.579487 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":14864768,"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":543,"apply.run_wall_time_us":542,"num_ops":2,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":807,"prepare.run_wall_time_us":2974,"raft.queue_time_us":43,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":236,"replication_time_us":5229}]]}
I20260505 20:13:46.582705 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_395edb36b813456893ae9293c5e20b87" } modify_external_catalogs: true
I20260505 20:13:46.582919 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_395edb36b813456893ae9293c5e20b87" } modify_external_catalogs: true
I20260505 20:13:46.583192 7904 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f91a58d306e4dd7ab515498aa6ab32b with delete_type TABLET_DATA_DELETED (replaced by tablet ef11066bc0d24d19910df97e73fbb3cd) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:46.583570 7869 leader_election.cc:343] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.583619 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:46.583726 7869 leader_election.cc:304] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.584856 9928 tablet.cc:1724] T 8e190c973c984ec080178efa39b2def0 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:46.585150 9619 raft_consensus.cc:2749] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.586411 7869 leader_election.cc:343] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.586546 7869 leader_election.cc:304] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.586872 9619 raft_consensus.cc:2749] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.587558 7869 leader_election.cc:343] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.587690 7869 leader_election.cc:304] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.588012 9619 raft_consensus.cc:2749] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.588579 7869 leader_election.cc:343] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.588713 7869 leader_election.cc:304] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.589066 9619 raft_consensus.cc:2749] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.589607 7869 leader_election.cc:343] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.589788 7869 leader_election.cc:304] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.590190 9619 raft_consensus.cc:2749] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.568208 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet f1425e08c7c342e3bc05074645969b2c with delete_type TABLET_DATA_DELETED (replaced by tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:46.580895 7775 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f91a58d306e4dd7ab515498aa6ab32b with delete_type TABLET_DATA_DELETED (replaced by tablet ef11066bc0d24d19910df97e73fbb3cd) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:46.592499 9271 log.cc:1199] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/3d74dbab83b840d9b2bd103e946d3032
I20260505 20:13:46.592955 9271 ts_tablet_manager.cc:1950] T 3d74dbab83b840d9b2bd103e946d3032 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:46.556181 8053 raft_consensus.cc:359] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.593888 8053 raft_consensus.cc:385] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.594007 8053 raft_consensus.cc:740] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.594175 9121 ts_tablet_manager.cc:1929] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.592090 7737 leader_election.cc:304] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.594280 9121 log.cc:1199] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/19720f3a29f34515a952e50f4fec9f97
I20260505 20:13:46.594225 8053 consensus_queue.cc:260] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.594628 9121 ts_tablet_manager.cc:1950] T 19720f3a29f34515a952e50f4fec9f97 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:46.594615 9939 raft_consensus.cc:2749] T b53f88d2e8b34b69bd12f53b046ed4de P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.595620 8053 ts_tablet_manager.cc:1434] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.070s user 0.001s sys 0.001s
W20260505 20:13:46.594915 7737 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:46.596603 8053 tablet_bootstrap.cc:492] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.596064 7737 leader_election.cc:304] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.597429 9939 raft_consensus.cc:2749] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.597899 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 112) took 9334 ms. Trace:
I20260505 20:13:46.599203 9271 rpcz_store.cc:276] 0505 20:13:37.262930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.263139 (+ 209us) service_pool.cc:224] Handling call
0505 20:13:46.489491 (+9226352us) ts_tablet_manager.cc:1151] Deleting tablet 3d74dbab83b840d9b2bd103e946d3032
0505 20:13:46.489506 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.548240 (+ 58734us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.566828 (+ 18588us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.597884 (+ 31056us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9226226}
I20260505 20:13:46.600528 9941 raft_consensus.cc:493] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.600654 9941 raft_consensus.cc:515] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.601236 9941 leader_election.cc:290] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:46.601891 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.602451 7870 leader_election.cc:343] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:46.599849 7737 leader_election.cc:343] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1cce1c38ad5a468dbf1714b4fdb0eb8a
I20260505 20:13:46.602804 7737 leader_election.cc:304] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:46.603017 7737 raft_consensus.cc:2686] T 1cce1c38ad5a468dbf1714b4fdb0eb8a P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260505 20:13:46.603654 7737 consensus_peers.cc:597] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:46.600382 9271 tablet_replica.cc:333] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:46.553649 8058 raft_consensus.cc:359] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.607193 8058 raft_consensus.cc:385] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.607276 8058 raft_consensus.cc:740] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.607594 9271 raft_consensus.cc:2243] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.607800 8058 consensus_queue.cc:260] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.608244 9271 raft_consensus.cc:2272] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.608448 8058 ts_tablet_manager.cc:1434] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.055s user 0.002s sys 0.000s
I20260505 20:13:46.608726 8058 tablet_bootstrap.cc:492] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.608911 9271 ts_tablet_manager.cc:1916] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:46.609838 7737 leader_election.cc:343] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 0ec5c094e2bb4a4481825df17becde52
I20260505 20:13:46.609943 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 125) took 10767 ms. Trace:
I20260505 20:13:46.609983 7737 leader_election.cc:304] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.610047 9121 rpcz_store.cc:276] 0505 20:13:35.842388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.842430 (+ 42us) service_pool.cc:224] Handling call
0505 20:13:46.474440 (+10632010us) ts_tablet_manager.cc:1151] Deleting tablet 19720f3a29f34515a952e50f4fec9f97
0505 20:13:46.474451 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.539126 (+ 64675us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.594119 (+ 54993us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.609927 (+ 15808us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10631828}
I20260505 20:13:46.610208 8058 tablet_bootstrap.cc:654] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.610378 9121 tablet_replica.cc:333] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:46.610474 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 19720f3a29f34515a952e50f4fec9f97 (table default.Table_6560bac418ea4f8aad5c9a8257e5b261 [id=ff0a7d8e28664804b1db5842a0dd8eaa]) successfully deleted
I20260505 20:13:46.610567 9121 raft_consensus.cc:2243] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.610659 9939 raft_consensus.cc:2749] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:46.610697 9121 pending_rounds.cc:70] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:46.610736 9121 pending_rounds.cc:77] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737256197935104 op_type: NO_OP noop_request { }
I20260505 20:13:46.610816 9121 raft_consensus.cc:2889] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:46.610917 9121 raft_consensus.cc:2272] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.613214 7737 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.613477 9939 raft_consensus.cc:2804] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:46.613543 9939 raft_consensus.cc:493] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.613601 9939 raft_consensus.cc:3060] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.616314 9939 raft_consensus.cc:515] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.616847 9939 leader_election.cc:290] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:46.619335 7737 leader_election.cc:343] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:46.621654 7598 leader_election.cc:304] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.622153 9495 raft_consensus.cc:2804] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:46.622284 9495 raft_consensus.cc:697] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
W20260505 20:13:46.622426 7737 consensus_peers.cc:597] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7214ab77d7904f0e9d37cb8d7a5a53a4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.622500 9495 consensus_queue.cc:237] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:46.622612 7598 consensus_peers.cc:597] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 876496f026c84eff8fef175387d20062. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:46.622922 7737 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421
W20260505 20:13:46.623016 7598 leader_election.cc:343] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e98c0e648c98488e8c5509b296824bea
W20260505 20:13:46.623415 7598 leader_election.cc:343] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b6895af5f55b4bc183065626417090a4
W20260505 20:13:46.623199 7737 leader_election.cc:343] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bde33085759f4fd8a130d80878d1e564
I20260505 20:13:46.624341 7737 leader_election.cc:304] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:46.624483 7598 consensus_peers.cc:597] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28ce3efe875a43d9b30d40623bf8a385. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.624558 9939 raft_consensus.cc:2749] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:46.628582 9939 consensus_queue.cc:1048] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.629529 7737 leader_election.cc:304] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.629841 9939 raft_consensus.cc:2749] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:46.630260 7737 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:46.631582 7737 leader_election.cc:304] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.631889 9939 raft_consensus.cc:2749] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.632711 7737 leader_election.cc:304] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.633019 9939 raft_consensus.cc:2749] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.634408 9939 consensus_queue.cc:1048] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.572286 9270 rpcz_store.cc:276] 0505 20:13:37.275017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.275173 (+ 156us) service_pool.cc:224] Handling call
0505 20:13:46.228672 (+8953499us) ts_tablet_manager.cc:1151] Deleting tablet e69bdfc75a494635837178cb16c08c1c
0505 20:13:46.228749 (+ 77us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.454624 (+225875us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.570423 (+115799us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.572063 (+ 1640us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2058,"tablet-delete.queue_time_us":8953281}
I20260505 20:13:46.636171 9270 tablet_replica.cc:333] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:46.636260 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e69bdfc75a494635837178cb16c08c1c (table default.Table_6071ca6b55a24946bfa133a951d84705 [id=1d0a4f96e2d2469eb1f5713c8be415df]) successfully deleted
I20260505 20:13:46.636660 9270 raft_consensus.cc:2243] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:46.637279 9270 raft_consensus.cc:2272] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.638696 9270 ts_tablet_manager.cc:1916] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.642587 9121 ts_tablet_manager.cc:1916] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.650774 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:46.653362 9939 raft_consensus.cc:493] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.653502 9939 raft_consensus.cc:515] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.659168 9619 raft_consensus.cc:493] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.659315 9619 raft_consensus.cc:515] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.659476 8054 ts_tablet_manager.cc:1434] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.130s user 0.023s sys 0.000s
I20260505 20:13:46.659551 9971 tablet.cc:1724] T 8e190c973c984ec080178efa39b2def0 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:46.659747 8054 tablet_bootstrap.cc:492] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.660041 9619 leader_election.cc:290] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.661203 8053 tablet_bootstrap.cc:654] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.662988 8054 tablet_bootstrap.cc:654] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.663582 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.664573 7870 leader_election.cc:343] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.664912 9939 leader_election.cc:290] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.665103 8058 tablet_bootstrap.cc:492] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.665251 8058 ts_tablet_manager.cc:1403] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20260505 20:13:46.666025 8058 raft_consensus.cc:359] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.666200 8058 raft_consensus.cc:385] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.666261 8058 raft_consensus.cc:740] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.666437 8058 consensus_queue.cc:260] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.666940 8058 ts_tablet_manager.cc:1434] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:46.667217 8058 tablet_bootstrap.cc:492] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.668533 8058 tablet_bootstrap.cc:654] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.669649 9271 ts_tablet_manager.cc:1929] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.669770 9271 log.cc:1199] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b91ccd9761ee4386b9e80cb9c9cfa975
I20260505 20:13:46.669994 9619 raft_consensus.cc:493] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.670135 9271 ts_tablet_manager.cc:1950] T b91ccd9761ee4386b9e80cb9c9cfa975 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:46.670112 9619 raft_consensus.cc:515] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.670681 9619 leader_election.cc:290] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.673831 9906 raft_consensus.cc:493] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.673991 9906 raft_consensus.cc:515] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:46.674191 7736 leader_election.cc:343] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: b393bfc209b6461aab958ebf49014d25
I20260505 20:13:46.674690 9906 leader_election.cc:290] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.675241 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.675410 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 113) took 9412 ms. Trace:
W20260505 20:13:46.675719 7870 leader_election.cc:343] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.677414 8054 tablet_bootstrap.cc:492] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.678098 8054 ts_tablet_manager.cc:1403] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
I20260505 20:13:46.680944 8054 raft_consensus.cc:359] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.681797 8054 raft_consensus.cc:385] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.682229 9619 raft_consensus.cc:493] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.682333 9619 raft_consensus.cc:515] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.682873 9619 leader_election.cc:290] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.683415 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.683876 7870 leader_election.cc:343] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.683457 8054 raft_consensus.cc:740] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.684659 8054 consensus_queue.cc:260] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.686654 8054 ts_tablet_manager.cc:1434] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260505 20:13:46.687762 8054 tablet_bootstrap.cc:492] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.690363 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.692700 9906 consensus_queue.cc:1048] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:46.693806 7598 consensus_peers.cc:597] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.694752 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.694941 7795 raft_consensus.cc:2468] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:46.701475 8053 tablet_bootstrap.cc:492] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.701795 8053 ts_tablet_manager.cc:1403] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.105s user 0.004s sys 0.003s
I20260505 20:13:46.702683 7795 raft_consensus.cc:3060] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.702725 8053 raft_consensus.cc:359] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.703079 8053 raft_consensus.cc:385] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.703181 8053 raft_consensus.cc:740] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.703454 8053 consensus_queue.cc:260] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.704571 8053 ts_tablet_manager.cc:1434] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:46.705363 8053 tablet_bootstrap.cc:492] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.707522 9619 raft_consensus.cc:493] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.707573 8053 tablet_bootstrap.cc:654] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.707656 9619 raft_consensus.cc:515] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.708245 9619 leader_election.cc:290] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.708969 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.709491 7870 leader_election.cc:343] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.712256 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.712486 7795 raft_consensus.cc:2393] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:46.714646 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e453fdf9a424fe8974076fac3ad74bf" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.715018 8054 tablet_bootstrap.cc:654] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.715557 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6375582031e0445086c58402e8b189c0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:46.715802 7795 raft_consensus.cc:2393] T 6375582031e0445086c58402e8b189c0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:46.675489 9271 rpcz_store.cc:276] 0505 20:13:37.263372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.263448 (+ 76us) service_pool.cc:224] Handling call
0505 20:13:46.600334 (+9336886us) ts_tablet_manager.cc:1151] Deleting tablet b91ccd9761ee4386b9e80cb9c9cfa975
0505 20:13:46.600345 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.626679 (+ 26334us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.669589 (+ 42910us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.675392 (+ 5803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423,"tablet-delete.queue_time_us":9336741}
I20260505 20:13:46.719866 8054 tablet_bootstrap.cc:492] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.719997 8054 ts_tablet_manager.cc:1403] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.002s
I20260505 20:13:46.720257 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b91ccd9761ee4386b9e80cb9c9cfa975 (table default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]) successfully deleted
I20260505 20:13:46.720523 9271 tablet_replica.cc:333] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:46.720736 9271 raft_consensus.cc:2243] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.720726 8054 raft_consensus.cc:359] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.720911 8054 raft_consensus.cc:385] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.720978 8054 raft_consensus.cc:740] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.721101 9271 raft_consensus.cc:2272] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.721187 8054 consensus_queue.cc:260] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.721704 8054 ts_tablet_manager.cc:1434] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:46.722028 8054 tablet_bootstrap.cc:492] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.722812 7661 raft_consensus.cc:3060] T 2b64242395794797aaf7a52ba40e0c60 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.723344 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98c0e648c98488e8c5509b296824bea" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:46.723423 8054 tablet_bootstrap.cc:654] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.723486 7790 raft_consensus.cc:3060] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.726032 7790 raft_consensus.cc:2468] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 2.
I20260505 20:13:46.727823 8053 tablet_bootstrap.cc:492] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.729018 8053 ts_tablet_manager.cc:1403] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260505 20:13:46.730973 8054 tablet_bootstrap.cc:492] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.731109 8054 ts_tablet_manager.cc:1403] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260505 20:13:46.731820 8054 raft_consensus.cc:359] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.731973 8054 raft_consensus.cc:385] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.732019 8054 raft_consensus.cc:740] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.732204 8054 consensus_queue.cc:260] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.732398 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6895af5f55b4bc183065626417090a4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.732645 8054 ts_tablet_manager.cc:1434] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:46.732903 8054 tablet_bootstrap.cc:492] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.734223 8054 tablet_bootstrap.cc:654] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.740065 8053 raft_consensus.cc:359] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.741430 8058 tablet_bootstrap.cc:492] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.742642 9271 ts_tablet_manager.cc:1916] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.743706 8053 raft_consensus.cc:385] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.744714 8053 raft_consensus.cc:740] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.747152 8058 ts_tablet_manager.cc:1403] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.001s
I20260505 20:13:46.746253 8053 consensus_queue.cc:260] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.747967 8058 raft_consensus.cc:359] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.749171 9429 raft_consensus.cc:493] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:46.749303 7790 raft_consensus.cc:3060] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.749300 9429 raft_consensus.cc:515] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.749878 9429 leader_election.cc:290] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:46.750990 7870 leader_election.cc:343] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 4628e33d204c452ab12acf76f754f2ad
I20260505 20:13:46.751355 8058 raft_consensus.cc:385] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.751633 8058 raft_consensus.cc:740] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.752534 8058 consensus_queue.cc:260] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.754056 8058 ts_tablet_manager.cc:1434] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:46.755257 8053 ts_tablet_manager.cc:1434] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260505 20:13:46.757644 8058 tablet_bootstrap.cc:492] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.751173 9270 ts_tablet_manager.cc:1929] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.759459 8053 tablet_bootstrap.cc:492] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.759902 9270 log.cc:1199] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:46.760372 9270 ts_tablet_manager.cc:1950] T 44ddf95d810c4c80a5f78c1b7600cee4 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:46.743660 7598 leader_election.cc:343] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bde33085759f4fd8a130d80878d1e564
W20260505 20:13:46.762336 7598 consensus_peers.cc:597] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 004a8e72cab44d31af3369b8df1e434e. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:46.762776 7598 consensus_peers.cc:597] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c8754580368453aa0aae021d8c665da. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.763983 7802 raft_consensus.cc:3060] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.764146 8054 tablet_bootstrap.cc:492] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.764284 8054 ts_tablet_manager.cc:1403] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.004s
I20260505 20:13:46.764986 8054 raft_consensus.cc:359] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.765163 8054 raft_consensus.cc:385] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.765223 8054 raft_consensus.cc:740] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.765434 8054 consensus_queue.cc:260] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.765956 8054 ts_tablet_manager.cc:1434] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:46.767288 8054 tablet_bootstrap.cc:492] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.767508 9939 raft_consensus.cc:493] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.767644 9939 raft_consensus.cc:515] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.768194 9939 leader_election.cc:290] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.768635 8054 tablet_bootstrap.cc:654] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.770224 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.770445 7663 raft_consensus.cc:2468] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:46.770939 7736 leader_election.cc:304] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.771512 9939 raft_consensus.cc:2804] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:46.771611 9939 raft_consensus.cc:493] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.771690 9939 raft_consensus.cc:3060] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.774864 9939 raft_consensus.cc:515] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.776810 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 118) took 9501 ms. Trace:
I20260505 20:13:46.776919 9270 rpcz_store.cc:276] 0505 20:13:37.275520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.275700 (+ 180us) service_pool.cc:224] Handling call
0505 20:13:46.636047 (+9360347us) ts_tablet_manager.cc:1151] Deleting tablet 44ddf95d810c4c80a5f78c1b7600cee4
0505 20:13:46.636094 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.711801 (+ 75707us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.751117 (+ 39316us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.776783 (+ 25666us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9360188}
I20260505 20:13:46.777241 9270 tablet_replica.cc:333] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:46.777422 9270 raft_consensus.cc:2243] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:46.777643 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 44ddf95d810c4c80a5f78c1b7600cee4 (table default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]) successfully deleted
I20260505 20:13:46.777766 9270 raft_consensus.cc:2272] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.778321 9270 ts_tablet_manager.cc:1916] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.778230 9939 leader_election.cc:290] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.778949 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.779109 7663 raft_consensus.cc:3060] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.781713 7663 raft_consensus.cc:2468] T feef367085954816b312d4f1cdd80b1d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:46.783815 8054 tablet_bootstrap.cc:492] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.783968 8054 ts_tablet_manager.cc:1403] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.008s
I20260505 20:13:46.784705 8054 raft_consensus.cc:359] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.784870 8054 raft_consensus.cc:385] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.784786 8053 tablet_bootstrap.cc:654] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.784919 8054 raft_consensus.cc:740] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.785120 8054 consensus_queue.cc:260] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.785650 8054 ts_tablet_manager.cc:1434] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:46.785951 8054 tablet_bootstrap.cc:492] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.787583 8054 tablet_bootstrap.cc:654] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.787559 9429 raft_consensus.cc:493] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.787667 9429 raft_consensus.cc:515] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.788269 9429 leader_election.cc:290] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.799099 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.799300 7802 raft_consensus.cc:2468] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:46.799504 8054 tablet_bootstrap.cc:492] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.799657 8054 ts_tablet_manager.cc:1403] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260505 20:13:46.800477 8054 raft_consensus.cc:359] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.800678 8054 raft_consensus.cc:385] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.800741 8054 raft_consensus.cc:740] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.800947 8054 consensus_queue.cc:260] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.801348 8054 ts_tablet_manager.cc:1434] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:46.801628 8054 tablet_bootstrap.cc:492] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.803422 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d78ebf153640e4b2f518fb215f1bf1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.803650 8054 tablet_bootstrap.cc:654] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.803892 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f27847d940e46778ad10a2f4cf40d27" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:46.804313 7802 raft_consensus.cc:3060] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.807080 7802 raft_consensus.cc:2468] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:46.807987 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.808668 7870 leader_election.cc:343] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.809106 7788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.809181 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.809789 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.810235 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.811167 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.811661 7736 leader_election.cc:304] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.812244 7596 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:46.812687 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b393bfc209b6461aab958ebf49014d25" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:46.812825 7931 raft_consensus.cc:3060] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.812860 9939 raft_consensus.cc:2804] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:46.813022 9939 raft_consensus.cc:697] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:46.813326 9939 consensus_queue.cc:237] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.813777 9495 raft_consensus.cc:2804] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:46.813858 9495 raft_consensus.cc:493] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.813926 9495 raft_consensus.cc:3060] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.815524 7931 raft_consensus.cc:2468] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 2.
I20260505 20:13:46.815786 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534726d2291044d78740896ff9031fca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.816435 9495 raft_consensus.cc:515] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.817065 9495 leader_election.cc:290] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:46.816999 9906 consensus_queue.cc:1048] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.818173 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:46.818917 7598 leader_election.cc:343] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 41fdaa9781ef4331bf3f0a7f8db4c1a0
I20260505 20:13:46.819623 8058 tablet_bootstrap.cc:654] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.828341 9121 ts_tablet_manager.cc:1929] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.828475 9121 log.cc:1199] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/d3cd1b7b0456462a80d653dd442589a6
I20260505 20:13:46.828930 9121 ts_tablet_manager.cc:1950] T d3cd1b7b0456462a80d653dd442589a6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:46.829510 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 126) took 10986 ms. Trace:
I20260505 20:13:46.829599 9121 rpcz_store.cc:276] 0505 20:13:35.843265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.843328 (+ 63us) service_pool.cc:224] Handling call
0505 20:13:46.610331 (+10767003us) ts_tablet_manager.cc:1151] Deleting tablet d3cd1b7b0456462a80d653dd442589a6
0505 20:13:46.610342 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.656112 (+ 45770us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.828272 (+172160us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.829487 (+ 1215us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10766813}
I20260505 20:13:46.829990 9121 tablet_replica.cc:333] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:46.830189 9121 raft_consensus.cc:2243] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.830257 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet d3cd1b7b0456462a80d653dd442589a6 (table default.Table_5dcf10cdc4bc4312b75088ac10f28253 [id=59ac3e5d44d149d4b3a35726a6d6aa4a]) successfully deleted
I20260505 20:13:46.830350 9121 raft_consensus.cc:2272] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.831084 9121 ts_tablet_manager.cc:1916] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:46.850193 9619 raft_consensus.cc:493] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.850378 9619 raft_consensus.cc:515] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.851096 9619 leader_election.cc:290] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:46.852752 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ab1033ccf4445862867f3f8b78ecd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:46.853405 7870 leader_election.cc:343] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.870673 8058 tablet_bootstrap.cc:492] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:46.870922 8058 ts_tablet_manager.cc:1403] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20260505 20:13:46.871764 7596 leader_election.cc:304] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:46.872267 7596 leader_election.cc:304] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:46.872246 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:46.872467 7933 raft_consensus.cc:2468] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:46.873133 9906 raft_consensus.cc:2749] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:46.873303 9906 raft_consensus.cc:2804] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:46.873328 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feef367085954816b312d4f1cdd80b1d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:46.873396 9906 raft_consensus.cc:697] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:46.873461 7933 raft_consensus.cc:3060] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.873638 9906 consensus_queue.cc:237] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.876312 7933 raft_consensus.cc:2468] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:46.877498 7869 leader_election.cc:343] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.877662 7869 leader_election.cc:304] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.877945 9619 raft_consensus.cc:2749] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.878291 7869 leader_election.cc:304] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.878552 9619 raft_consensus.cc:2804] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:46.878670 9619 raft_consensus.cc:697] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
W20260505 20:13:46.878806 7869 leader_election.cc:343] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.878895 7869 leader_election.cc:304] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.878945 9619 consensus_queue.cc:237] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:46.879315 7869 leader_election.cc:343] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.879400 7869 leader_election.cc:304] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.880167 9941 raft_consensus.cc:2749] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.880343 9941 raft_consensus.cc:2749] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.894932 10026 tablet.cc:1724] T 65003660c44547cc8674baeca370e395 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260505 20:13:46.904143 8058 raft_consensus.cc:359] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.904489 8058 raft_consensus.cc:385] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.904601 8058 raft_consensus.cc:740] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.904834 8058 consensus_queue.cc:260] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.905501 8058 ts_tablet_manager.cc:1434] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260505 20:13:46.905864 8058 tablet_bootstrap.cc:492] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:46.907478 8058 tablet_bootstrap.cc:654] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.907967 7848 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:46.910231 9271 ts_tablet_manager.cc:1929] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:46.911219 9271 log.cc:1199] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b966b4bbaf9f4774af96051f857f02f7
I20260505 20:13:46.911969 9271 ts_tablet_manager.cc:1950] T b966b4bbaf9f4774af96051f857f02f7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:46.912935 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 114) took 9649 ms. Trace:
I20260505 20:13:46.913147 9894 raft_consensus.cc:493] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.915800 9894 raft_consensus.cc:515] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.916046 9944 raft_consensus.cc:493] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.916218 9944 raft_consensus.cc:515] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.916566 9894 leader_election.cc:290] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.916702 9894 raft_consensus.cc:493] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.916826 9894 raft_consensus.cc:515] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:46.916905 9944 leader_election.cc:290] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.917395 9894 leader_election.cc:290] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.918229 9271 rpcz_store.cc:276] 0505 20:13:37.263705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.263745 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:46.720044 (+9456299us) ts_tablet_manager.cc:1151] Deleting tablet b966b4bbaf9f4774af96051f857f02f7
0505 20:13:46.720077 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.746293 (+ 26216us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.902429 (+156136us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:46.912918 (+ 10489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9456168}
I20260505 20:13:46.919342 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b966b4bbaf9f4774af96051f857f02f7 (table default.Table_7e6c02c635da4beeac8892d580b67a93 [id=9ba85af1a1ee48e691f3b92e820c0500]) successfully deleted
I20260505 20:13:46.919872 9271 tablet_replica.cc:333] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:46.923018 9271 raft_consensus.cc:2243] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:46.926316 8053 tablet_bootstrap.cc:492] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:46.926455 8053 ts_tablet_manager.cc:1403] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.168s user 0.004s sys 0.006s
I20260505 20:13:46.929494 9271 raft_consensus.cc:2272] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:46.930709 8054 tablet_bootstrap.cc:492] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:46.930864 8054 ts_tablet_manager.cc:1403] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.129s user 0.018s sys 0.043s
I20260505 20:13:46.931687 8054 raft_consensus.cc:359] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.931890 8054 raft_consensus.cc:385] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.931960 8054 raft_consensus.cc:740] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.932196 8054 consensus_queue.cc:260] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.932791 8054 ts_tablet_manager.cc:1434] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:46.933092 8054 tablet_bootstrap.cc:492] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:46.933591 9271 ts_tablet_manager.cc:1916] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:46.934155 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 54867.5us
I20260505 20:13:46.937989 8053 raft_consensus.cc:359] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.965866 8053 raft_consensus.cc:385] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:46.965982 8053 raft_consensus.cc:740] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:46.966044 9941 raft_consensus.cc:493] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.966204 9941 raft_consensus.cc:515] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.966220 8053 consensus_queue.cc:260] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.966820 8053 ts_tablet_manager.cc:1434] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20260505 20:13:46.966823 9941 leader_election.cc:290] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.967887 8053 tablet_bootstrap.cc:492] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:46.969894 8053 tablet_bootstrap.cc:654] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:46.973604 10031 raft_consensus.cc:493] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.918040 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.918357 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.974151 7663 raft_consensus.cc:2468] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:46.918696 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e453fdf9a424fe8974076fac3ad74bf" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:46.974375 7660 raft_consensus.cc:2468] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:46.974638 7661 raft_consensus.cc:2468] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:46.975014 7736 leader_election.cc:304] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.975245 10033 raft_consensus.cc:2804] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:46.975368 10033 raft_consensus.cc:493] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.975499 7736 leader_election.cc:304] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:46.975792 7736 raft_consensus.cc:2686] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:46.976035 7736 leader_election.cc:304] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:46.976298 9894 raft_consensus.cc:2804] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:46.976375 9894 raft_consensus.cc:493] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:46.976449 9894 raft_consensus.cc:3060] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:46.976926 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 104393us
I20260505 20:13:46.977605 7596 leader_election.cc:304] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:46.977870 9758 raft_consensus.cc:2749] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:46.978322 9758 consensus_queue.cc:1048] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.979260 9894 raft_consensus.cc:515] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.979866 9894 leader_election.cc:290] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:46.975494 10033 raft_consensus.cc:3060] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:46.981593 7596 consensus_peers.cc:597] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b91ccd9761ee4386b9e80cb9c9cfa975. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:46.982023 9758 consensus_queue.cc:1048] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:46.983029 10033 raft_consensus.cc:515] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.984043 10033 leader_election.cc:290] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.984308 7596 leader_election.cc:304] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:46.984630 9758 raft_consensus.cc:2804] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:46.984700 9758 raft_consensus.cc:493] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:46.984766 9758 raft_consensus.cc:3060] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.987937 9758 raft_consensus.cc:515] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:46.988598 9758 leader_election.cc:290] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.990043 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.990229 7661 raft_consensus.cc:3060] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.973845 10031 raft_consensus.cc:515] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:46.991184 7869 leader_election.cc:343] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.991786 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ab1033ccf4445862867f3f8b78ecd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:46.992870 7661 raft_consensus.cc:2468] T 944eaa335fcf49be975baee21c715642 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:46.993144 9758 raft_consensus.cc:493] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:46.993414 9758 raft_consensus.cc:515] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.993355 7869 leader_election.cc:304] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.993692 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fdaa9781ef4331bf3f0a7f8db4c1a0" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:46.993870 7795 raft_consensus.cc:3060] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:46.995198 9758 leader_election.cc:290] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:46.995353 9619 raft_consensus.cc:2749] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:46.995900 7736 leader_election.cc:304] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:46.996004 7598 leader_election.cc:343] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bde33085759f4fd8a130d80878d1e564
W20260505 20:13:46.996100 7869 leader_election.cc:343] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:46.996222 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:46.996438 9939 raft_consensus.cc:2804] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:46.996460 7661 raft_consensus.cc:3060] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:46.996575 9939 raft_consensus.cc:697] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:46.996465 7869 leader_election.cc:304] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.996826 9939 consensus_queue.cc:237] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:46.997315 7795 raft_consensus.cc:2468] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 2.
I20260505 20:13:46.999331 7737 leader_election.cc:304] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:46.999773 7661 raft_consensus.cc:2468] T 5b3595eb9b1144d9b802f1f563d01461 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:47.000087 9619 raft_consensus.cc:2749] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.000116 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.000276 7933 raft_consensus.cc:2468] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.000742 7737 leader_election.cc:304] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:47.000669 7869 leader_election.cc:343] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 4628e33d204c452ab12acf76f754f2ad
I20260505 20:13:47.000948 10033 raft_consensus.cc:2804] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:47.002274 9894 raft_consensus.cc:2749] T 534726d2291044d78740896ff9031fca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.002516 10033 raft_consensus.cc:697] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:47.002795 10033 consensus_queue.cc:237] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:47.003832 9270 ts_tablet_manager.cc:1929] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.003953 9270 log.cc:1199] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/172cd9f38dd8491ea3ecf42b680d398f
I20260505 20:13:47.004345 9270 ts_tablet_manager.cc:1950] T 172cd9f38dd8491ea3ecf42b680d398f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.004681 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 119) took 9728 ms. Trace:
I20260505 20:13:47.004755 9270 rpcz_store.cc:276] 0505 20:13:37.276079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.276470 (+ 391us) service_pool.cc:224] Handling call
0505 20:13:46.777190 (+9500720us) ts_tablet_manager.cc:1151] Deleting tablet 172cd9f38dd8491ea3ecf42b680d398f
0505 20:13:46.777202 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:46.910896 (+133694us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.003765 (+ 92869us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.004667 (+ 902us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9500577}
I20260505 20:13:47.005298 7736 leader_election.cc:304] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.005312 7598 leader_election.cc:304] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.005623 9894 raft_consensus.cc:2804] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.005736 9894 raft_consensus.cc:697] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:47.005975 9894 consensus_queue.cc:237] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.006321 9758 raft_consensus.cc:2804] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.006390 9758 raft_consensus.cc:493] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.006450 9758 raft_consensus.cc:3060] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.009217 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 172cd9f38dd8491ea3ecf42b680d398f (table default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 [id=53190afe0efc4b75a333dd189a53376c]) successfully deleted
I20260505 20:13:47.016252 9758 raft_consensus.cc:515] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.017153 9758 leader_election.cc:290] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.020401 7596 leader_election.cc:304] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:47.020737 10028 raft_consensus.cc:2804] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:47.020843 10028 raft_consensus.cc:697] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.021062 10028 consensus_queue.cc:237] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:47.025115 8058 tablet_bootstrap.cc:492] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.004395 8054 tablet_bootstrap.cc:654] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.016793 10031 leader_election.cc:290] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.031852 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:47.032388 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:47.032639 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:47.029417 7869 leader_election.cc:304] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.032899 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:47.033201 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:47.033376 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:47.033638 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c278b516135b47ee96ed61b1ae595f9a (table default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0]). Expected version 1 got 0
I20260505 20:13:47.033967 8058 ts_tablet_manager.cc:1403] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.000s
I20260505 20:13:47.037268 8053 tablet_bootstrap.cc:492] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.037820 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.038031 7926 raft_consensus.cc:3060] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.038025 8053 ts_tablet_manager.cc:1403] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.005s
I20260505 20:13:47.040891 7926 raft_consensus.cc:2468] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.041421 7598 leader_election.cc:304] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.041198 8053 raft_consensus.cc:359] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.042639 8058 raft_consensus.cc:359] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.042353 8053 raft_consensus.cc:385] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.042891 8053 raft_consensus.cc:740] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.043824 8053 consensus_queue.cc:260] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.043879 9495 raft_consensus.cc:2804] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.045550 8058 raft_consensus.cc:385] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.045593 8053 ts_tablet_manager.cc:1434] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260505 20:13:47.045903 8058 raft_consensus.cc:740] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.047116 8053 tablet_bootstrap.cc:492] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.054286 10031 raft_consensus.cc:2749] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:47.055778 10031 raft_consensus.cc:493] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.056041 10031 raft_consensus.cc:515] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.056739 8058 consensus_queue.cc:260] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.057621 10031 leader_election.cc:290] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:47.058708 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 58503.5us
I20260505 20:13:47.059988 10031 raft_consensus.cc:493] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.061048 10031 raft_consensus.cc:515] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.064574 10031 leader_election.cc:290] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:47.068764 7869 leader_election.cc:343] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.070734 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.071353 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bde33085759f4fd8a130d80878d1e564" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.071585 7795 raft_consensus.cc:3060] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:47.070711 7869 leader_election.cc:304] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:47.075287 7869 leader_election.cc:343] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.075464 9495 raft_consensus.cc:697] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.075659 7869 leader_election.cc:304] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.075778 9495 consensus_queue.cc:237] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.076596 9121 ts_tablet_manager.cc:1929] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.076707 9121 log.cc:1199] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e69bdfc75a494635837178cb16c08c1c
W20260505 20:13:47.077049 7869 leader_election.cc:343] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.077441 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1]). Expected version 1 got 0
I20260505 20:13:47.077490 7869 leader_election.cc:304] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.077718 9619 raft_consensus.cc:2749] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.078020 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:47.078084 9429 raft_consensus.cc:2749] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.078357 9429 raft_consensus.cc:2749] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.078799 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:47.079428 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.087237 9270 tablet_replica.cc:333] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.088953 10026 tablet.cc:1724] T 8e190c973c984ec080178efa39b2def0 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:47.089035 8054 tablet_bootstrap.cc:492] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.089493 8054 ts_tablet_manager.cc:1403] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.156s user 0.016s sys 0.004s
I20260505 20:13:47.077104 9121 ts_tablet_manager.cc:1950] T e69bdfc75a494635837178cb16c08c1c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.090277 8054 raft_consensus.cc:359] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.090457 8054 raft_consensus.cc:385] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.090510 8054 raft_consensus.cc:740] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.090736 8054 consensus_queue.cc:260] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.091244 8054 ts_tablet_manager.cc:1434] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:47.091526 8054 tablet_bootstrap.cc:492] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.093459 8054 tablet_bootstrap.cc:654] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.093806 9270 raft_consensus.cc:2243] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.095204 9271 ts_tablet_manager.cc:1929] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.095335 9271 log.cc:1199] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1e453fdf9a424fe8974076fac3ad74bf
I20260505 20:13:47.095718 9271 ts_tablet_manager.cc:1950] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:47.096017 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 115) took 9831 ms. Trace:
I20260505 20:13:47.087757 9704 raft_consensus.cc:493] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.096621 9704 raft_consensus.cc:515] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.097240 9704 leader_election.cc:290] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.095314 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 128) took 11249 ms. Trace:
I20260505 20:13:47.099218 8054 tablet_bootstrap.cc:492] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.099792 8054 ts_tablet_manager.cc:1403] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260505 20:13:47.101033 8054 raft_consensus.cc:359] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.101189 8054 raft_consensus.cc:385] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.101236 8054 raft_consensus.cc:740] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.101423 8054 consensus_queue.cc:260] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.101927 8054 ts_tablet_manager.cc:1434] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:47.102196 8054 tablet_bootstrap.cc:492] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.099669 9121 rpcz_store.cc:276] 0505 20:13:35.845905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.845964 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:46.829939 (+10983975us) ts_tablet_manager.cc:1151] Deleting tablet e69bdfc75a494635837178cb16c08c1c
0505 20:13:46.829949 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.001512 (+171563us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.076527 (+ 75015us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.095005 (+ 18478us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10983778}
I20260505 20:13:47.088471 10028 raft_consensus.cc:493] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:47.103554 9619 raft_consensus.cc:493] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.103675 9619 raft_consensus.cc:515] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.103865 8054 tablet_bootstrap.cc:654] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.103755 10028 raft_consensus.cc:515] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.104417 9619 leader_election.cc:290] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.104576 10028 leader_election.cc:290] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:47.091899 7598 consensus_peers.cc:597] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b17da5cf513647d9b8e582a9b3b460a1. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.087631 8058 ts_tablet_manager.cc:1434] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260505 20:13:47.105302 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.105474 7926 raft_consensus.cc:2468] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.105842 9270 raft_consensus.cc:2272] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.104960 9121 tablet_replica.cc:333] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.106094 9121 raft_consensus.cc:2243] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.106249 9121 raft_consensus.cc:2272] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.106791 9121 ts_tablet_manager.cc:1916] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.106151 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca1fb1425e347d191f3c5931d9bf224" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.109836 7795 raft_consensus.cc:2468] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 2.
I20260505 20:13:47.110131 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.107548 7598 leader_election.cc:304] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:47.111857 7598 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b6ed7c0220d147c7853c7afc1ef09607
I20260505 20:13:47.117045 10031 raft_consensus.cc:493] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.117168 10031 raft_consensus.cc:515] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.117728 10031 leader_election.cc:290] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.117758 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca1fb1425e347d191f3c5931d9bf224" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.112056 10028 raft_consensus.cc:2804] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.120450 10028 raft_consensus.cc:493] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.120611 10028 raft_consensus.cc:3060] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.106825 8058 tablet_bootstrap.cc:492] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.113950 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f317f62391b422db2bf2a97ef928f99" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.124814 9121 ts_tablet_manager.cc:1929] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.124943 9121 log.cc:1199] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8f1505e592e543cca92d8949bdae007e
I20260505 20:13:47.125311 9121 ts_tablet_manager.cc:1950] T 8f1505e592e543cca92d8949bdae007e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.125480 10028 raft_consensus.cc:515] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.114678 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.115724 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60c74cfa0d4c498ed50daefe3905ab" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.129103 10028 leader_election.cc:290] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.129061 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_2add910ed16e4806844c4179947d54e2 [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 4 got 3
I20260505 20:13:47.129666 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.129863 7921 raft_consensus.cc:3060] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.130666 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:47.131129 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:47.131312 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:47.131639 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:47.131924 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:47.131656 8053 tablet_bootstrap.cc:654] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.132428 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67]). Expected version 1 got 0
I20260505 20:13:47.132562 7921 raft_consensus.cc:2468] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.096095 9271 rpcz_store.cc:276] 0505 20:13:37.264814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.265239 (+ 425us) service_pool.cc:224] Handling call
0505 20:13:46.919804 (+9654565us) ts_tablet_manager.cc:1151] Deleting tablet 1e453fdf9a424fe8974076fac3ad74bf
0505 20:13:46.919824 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.041968 (+122144us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.095147 (+ 53179us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.096001 (+ 854us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9654414}
I20260505 20:13:47.133375 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.133469 9271 tablet_replica.cc:333] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:47.133556 7921 raft_consensus.cc:2468] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:47.133673 9271 raft_consensus.cc:2243] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.134058 9271 raft_consensus.cc:2272] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.136911 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.137099 7921 raft_consensus.cc:2468] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:47.136765 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.114508 9270 ts_tablet_manager.cc:1916] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.137099 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f317f62391b422db2bf2a97ef928f99" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.138962 9271 ts_tablet_manager.cc:1916] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.137904 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.134066 7598 leader_election.cc:304] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.142045 9704 raft_consensus.cc:2804] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.142158 9704 raft_consensus.cc:697] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.142392 9704 consensus_queue.cc:237] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.147392 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944eaa335fcf49be975baee21c715642" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.147575 7921 raft_consensus.cc:3060] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.148664 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.150367 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 127) took 11305 ms. Trace:
I20260505 20:13:47.150480 9121 rpcz_store.cc:276] 0505 20:13:35.845698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.845774 (+ 76us) service_pool.cc:224] Handling call
0505 20:13:47.104190 (+11258416us) ts_tablet_manager.cc:1151] Deleting tablet 8f1505e592e543cca92d8949bdae007e
0505 20:13:47.104496 (+ 306us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.114655 (+ 10159us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.117736 (+ 3081us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.150345 (+ 32609us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11257683}
I20260505 20:13:47.150848 9121 tablet_replica.cc:333] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.151064 9121 raft_consensus.cc:2243] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.150964 7921 raft_consensus.cc:2468] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:47.151224 9121 raft_consensus.cc:2272] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.151782 9121 ts_tablet_manager.cc:1916] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:47.153848 7870 leader_election.cc:343] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.154230 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3595eb9b1144d9b802f1f563d01461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.154681 7921 raft_consensus.cc:3060] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:47.157133 7870 leader_election.cc:343] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:47.159716 7596 leader_election.cc:343] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:47.160106 7596 leader_election.cc:343] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.160223 9271 ts_tablet_manager.cc:1929] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:47.161118 7596 leader_election.cc:304] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:47.161417 10029 raft_consensus.cc:2804] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:47.161522 10029 raft_consensus.cc:697] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.161782 10029 consensus_queue.cc:237] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.132660 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:47.133240 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1e453fdf9a424fe8974076fac3ad74bf (table default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f [id=ec71e6a4ae4d45d48362262a5d2bf526]) successfully deleted
I20260505 20:13:47.163103 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:47.163565 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:47.165000 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:47.165211 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:47.165863 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:47.166108 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:47.166317 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:47.166612 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:47.168614 9121 ts_tablet_manager.cc:1929] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.168758 9121 log.cc:1199] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/172cd9f38dd8491ea3ecf42b680d398f
I20260505 20:13:47.169159 9121 ts_tablet_manager.cc:1950] T 172cd9f38dd8491ea3ecf42b680d398f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.178972 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Bootstrap replaying log segment 1/1 (140.5K/272.8K this segment, stats: ops{read=313 overwritten=0 applied=313 ignored=0} inserts{seen=285 ignored=0} mutations{seen=345 ignored=0} orphaned_commits=0)
I20260505 20:13:47.179239 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 129) took 11332 ms. Trace:
I20260505 20:13:47.179373 9121 rpcz_store.cc:276] 0505 20:13:35.846842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.846910 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:47.150798 (+11303888us) ts_tablet_manager.cc:1151] Deleting tablet 172cd9f38dd8491ea3ecf42b680d398f
0505 20:13:47.150809 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.154851 (+ 4042us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.168545 (+ 13694us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.179194 (+ 10649us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11303687}
I20260505 20:13:47.179785 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 130) took 11332 ms. Trace:
I20260505 20:13:47.179888 9121 rpcz_store.cc:276] 0505 20:13:35.847730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.847959 (+ 229us) service_pool.cc:224] Handling call
0505 20:13:47.179663 (+11331704us) ts_tablet_manager.cc:1151] Deleting tablet 44ddf95d810c4c80a5f78c1b7600cee4
0505 20:13:47.179674 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.179751 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11331523}
I20260505 20:13:47.180160 9121 tablet_replica.cc:333] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.180388 9121 raft_consensus.cc:2243] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.180578 9121 raft_consensus.cc:2272] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.181185 9121 ts_tablet_manager.cc:1916] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.166772 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
W20260505 20:13:47.188757 7598 consensus_peers.cc:597] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f1505e592e543cca92d8949bdae007e. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.191517 9271 log.cc:1199] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:47.192035 9271 ts_tablet_manager.cc:1950] T 0112c04befa14c48bb5b2e7dfb60dac7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:47.192384 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 116) took 9926 ms. Trace:
I20260505 20:13:47.192464 9271 rpcz_store.cc:276] 0505 20:13:37.265507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.265547 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:47.133417 (+9867870us) ts_tablet_manager.cc:1151] Deleting tablet 0112c04befa14c48bb5b2e7dfb60dac7
0505 20:13:47.133428 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.157349 (+ 23921us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.160166 (+ 2817us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.192369 (+ 32203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9867726}
I20260505 20:13:47.193018 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 0112c04befa14c48bb5b2e7dfb60dac7 (table default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]) successfully deleted
I20260505 20:13:47.193544 8053 tablet_bootstrap.cc:492] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.193634 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:47.193867 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:47.194017 8053 ts_tablet_manager.cc:1403] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.147s user 0.003s sys 0.006s
I20260505 20:13:47.194149 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:47.194643 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:47.194979 7406 catalog_manager.cc:5671] T 2b64242395794797aaf7a52ba40e0c60 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:47.195559 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:47.126859 8058 tablet_bootstrap.cc:654] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.198446 7921 raft_consensus.cc:2468] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:47.198801 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60c74cfa0d4c498ed50daefe3905ab" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.199389 9271 tablet_replica.cc:333] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:47.197178 8053 raft_consensus.cc:359] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.209223 8053 raft_consensus.cc:385] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.209457 8053 raft_consensus.cc:740] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.199803 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.205506 7737 leader_election.cc:343] T 1e453fdf9a424fe8974076fac3ad74bf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1e453fdf9a424fe8974076fac3ad74bf
I20260505 20:13:47.210646 8053 consensus_queue.cc:260] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.212358 8053 ts_tablet_manager.cc:1434] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.018s user 0.001s sys 0.003s
W20260505 20:13:47.214450 7598 consensus_peers.cc:597] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:47.214490 10033 consensus_queue.cc:1048] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.217537 9271 raft_consensus.cc:2243] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:47.221239 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 60163.7us
I20260505 20:13:47.221470 9271 raft_consensus.cc:2272] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:47.223424 7737 consensus_peers.cc:597] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2540ed5144664ec0bfe0b548a5386176. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.222174 9271 ts_tablet_manager.cc:1916] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:47.225658 7869 leader_election.cc:343] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.227437 7869 leader_election.cc:304] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.230859 8053 tablet_bootstrap.cc:492] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.196780 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e69bdfc75a494635837178cb16c08c1c (table default.Table_6071ca6b55a24946bfa133a951d84705 [id=1d0a4f96e2d2469eb1f5713c8be415df]) successfully deleted
I20260505 20:13:47.196360 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8e190c973c984ec080178efa39b2def0 (table default.Table_ba3b733a40ce48589c0b347147da20c5 [id=d52c9e2e31b34773959865aaa6f1833a]). Expected version 1 got 0
I20260505 20:13:47.231465 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 8f1505e592e543cca92d8949bdae007e (table default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]) successfully deleted
I20260505 20:13:47.231673 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 172cd9f38dd8491ea3ecf42b680d398f (table default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 [id=53190afe0efc4b75a333dd189a53376c]) successfully deleted
W20260505 20:13:47.231879 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 44ddf95d810c4c80a5f78c1b7600cee4 because the tablet was not found. No further retry: Not found: Tablet not found: 44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:47.233004 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:47.234368 9619 raft_consensus.cc:2749] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.236853 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:47.237833 8058 tablet_bootstrap.cc:492] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.238744 9121 ts_tablet_manager.cc:1929] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.238880 9121 log.cc:1199] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/a0d4e198c91c4a0e99d8b798a1dd3433
I20260505 20:13:47.239172 7406 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:47.239281 9121 ts_tablet_manager.cc:1950] T a0d4e198c91c4a0e99d8b798a1dd3433 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.243010 8058 ts_tablet_manager.cc:1403] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.136s user 0.003s sys 0.002s
W20260505 20:13:47.243319 7869 leader_election.cc:343] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.244781 7869 leader_election.cc:304] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:47.238080 7596 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: b6ed7c0220d147c7853c7afc1ef09607
I20260505 20:13:47.245792 7596 leader_election.cc:304] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:47.246084 9619 raft_consensus.cc:2749] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.246531 7596 leader_election.cc:343] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:47.247419 7870 leader_election.cc:343] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.246733 9495 raft_consensus.cc:2749] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:47.248354 7869 leader_election.cc:343] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.248735 7869 leader_election.cc:304] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:47.248978 7870 leader_election.cc:343] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.249364 9619 raft_consensus.cc:2749] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.249806 7870 leader_election.cc:343] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:47.250054 7869 leader_election.cc:343] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.250425 7869 leader_election.cc:304] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.251940 9429 raft_consensus.cc:2749] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.252602 7869 leader_election.cc:343] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.253422 7869 leader_election.cc:304] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.258083 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.261658 8053 tablet_bootstrap.cc:654] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.266139 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.268965 9619 raft_consensus.cc:2749] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.269124 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 131) took 11420 ms. Trace:
I20260505 20:13:47.269447 8058 raft_consensus.cc:359] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.269604 8058 raft_consensus.cc:385] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.269651 8058 raft_consensus.cc:740] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.269855 8058 consensus_queue.cc:260] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.270413 8058 ts_tablet_manager.cc:1434] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260505 20:13:47.270551 8054 tablet_bootstrap.cc:492] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.270720 8054 ts_tablet_manager.cc:1403] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.169s user 0.014s sys 0.013s
I20260505 20:13:47.270762 8058 tablet_bootstrap.cc:492] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.269871 9121 rpcz_store.cc:276] 0505 20:13:35.848930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.849245 (+ 315us) service_pool.cc:224] Handling call
0505 20:13:47.180097 (+11330852us) ts_tablet_manager.cc:1151] Deleting tablet a0d4e198c91c4a0e99d8b798a1dd3433
0505 20:13:47.180107 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.217492 (+ 37385us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.238662 (+ 21170us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.268625 (+ 29963us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10477,"tablet-delete.queue_time_us":11330658}
I20260505 20:13:47.271996 8054 raft_consensus.cc:359] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.272198 8054 raft_consensus.cc:385] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.272276 8054 raft_consensus.cc:740] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
W20260505 20:13:47.272305 7869 leader_election.cc:343] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.272531 9121 tablet_replica.cc:333] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.272531 8054 consensus_queue.cc:260] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.274252 8054 ts_tablet_manager.cc:1434] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:47.274577 8054 tablet_bootstrap.cc:492] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.275115 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet a0d4e198c91c4a0e99d8b798a1dd3433 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]) successfully deleted
I20260505 20:13:47.276046 7983 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:47.276842 8054 tablet_bootstrap.cc:654] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.280493 9270 ts_tablet_manager.cc:1929] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.281821 9270 log.cc:1199] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/19720f3a29f34515a952e50f4fec9f97
I20260505 20:13:47.282267 9619 raft_consensus.cc:493] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.275913 9121 raft_consensus.cc:2243] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.282440 9619 raft_consensus.cc:515] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.283125 9619 leader_election.cc:290] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.283557 9429 raft_consensus.cc:493] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.283702 9429 raft_consensus.cc:515] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.284235 9429 leader_election.cc:290] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.287211 9271 ts_tablet_manager.cc:1929] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.287572 9271 log.cc:1199] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b6895af5f55b4bc183065626417090a4
I20260505 20:13:47.289069 8054 tablet_bootstrap.cc:492] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.289208 8054 ts_tablet_manager.cc:1403] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20260505 20:13:47.290015 8054 raft_consensus.cc:359] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.290194 8054 raft_consensus.cc:385] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.290266 8054 raft_consensus.cc:740] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.290495 8054 consensus_queue.cc:260] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.291080 8054 ts_tablet_manager.cc:1434] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260505 20:13:47.291280 7596 leader_election.cc:343] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.291370 8054 tablet_bootstrap.cc:492] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.292169 9270 ts_tablet_manager.cc:1950] T 19720f3a29f34515a952e50f4fec9f97 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.298264 8054 tablet_bootstrap.cc:654] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.298324 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 120) took 10021 ms. Trace:
I20260505 20:13:47.297801 9121 raft_consensus.cc:2272] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.301157 9271 ts_tablet_manager.cc:1950] T b6895af5f55b4bc183065626417090a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:47.298403 9270 rpcz_store.cc:276] 0505 20:13:37.276721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.276859 (+ 138us) service_pool.cc:224] Handling call
0505 20:13:47.087168 (+9810309us) ts_tablet_manager.cc:1151] Deleting tablet 19720f3a29f34515a952e50f4fec9f97
0505 20:13:47.087179 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.141131 (+ 53952us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.280412 (+139281us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.298306 (+ 17894us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9810199}
I20260505 20:13:47.302570 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 19720f3a29f34515a952e50f4fec9f97 (table default.Table_6560bac418ea4f8aad5c9a8257e5b261 [id=ff0a7d8e28664804b1db5842a0dd8eaa]) successfully deleted
I20260505 20:13:47.306463 9270 tablet_replica.cc:333] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.306773 9270 raft_consensus.cc:2243] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
W20260505 20:13:47.308511 7870 leader_election.cc:343] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.308727 7870 leader_election.cc:304] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.309415 9619 raft_consensus.cc:2749] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.311086 8054 tablet_bootstrap.cc:492] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.311254 8054 ts_tablet_manager.cc:1403] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260505 20:13:47.312075 8054 raft_consensus.cc:359] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.312275 8054 raft_consensus.cc:385] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.312361 8054 raft_consensus.cc:740] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.312608 8054 consensus_queue.cc:260] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.313167 8054 ts_tablet_manager.cc:1434] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:47.314611 8054 tablet_bootstrap.cc:492] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.315353 8058 tablet_bootstrap.cc:654] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.316552 9270 raft_consensus.cc:2272] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.316286 8054 tablet_bootstrap.cc:654] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.321834 9619 raft_consensus.cc:493] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.321981 9619 raft_consensus.cc:515] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.322566 9619 leader_election.cc:290] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.322103 9121 ts_tablet_manager.cc:1916] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.311816 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc9a6e1c824305869f6634192c5e78" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.313716 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907b7dccd7a94115aca36915a558b103" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.314117 8053 tablet_bootstrap.cc:492] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:47.321290 7737 consensus_peers.cc:597] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19720f3a29f34515a952e50f4fec9f97. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.325336 8053 ts_tablet_manager.cc:1403] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.095s user 0.007s sys 0.000s
I20260505 20:13:47.326249 8053 raft_consensus.cc:359] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.326442 8053 raft_consensus.cc:385] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.326496 8053 raft_consensus.cc:740] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.326706 8053 consensus_queue.cc:260] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.327280 8053 ts_tablet_manager.cc:1434] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:47.328898 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.333679 7869 leader_election.cc:343] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.340245 9270 ts_tablet_manager.cc:1916] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.341245 8054 tablet_bootstrap.cc:492] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.341462 8054 ts_tablet_manager.cc:1403] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.001s
W20260505 20:13:47.339977 7869 leader_election.cc:343] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.342350 8054 raft_consensus.cc:359] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.342594 8054 raft_consensus.cc:385] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.342743 8054 raft_consensus.cc:740] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.343086 8054 consensus_queue.cc:260] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.343925 8054 ts_tablet_manager.cc:1434] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260505 20:13:47.344705 7869 leader_election.cc:343] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.349959 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc9a6e1c824305869f6634192c5e78" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.351047 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907b7dccd7a94115aca36915a558b103" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.352690 8053 tablet_bootstrap.cc:492] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.352977 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 117) took 10079 ms. Trace:
I20260505 20:13:47.353147 8054 tablet_bootstrap.cc:492] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.353078 9271 rpcz_store.cc:276] 0505 20:13:37.273182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.273241 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:47.199343 (+9926102us) ts_tablet_manager.cc:1151] Deleting tablet b6895af5f55b4bc183065626417090a4
0505 20:13:47.199353 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.249016 (+ 49663us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.287144 (+ 38128us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.352952 (+ 65808us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9925858}
I20260505 20:13:47.353451 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 118) took 10079 ms. Trace:
I20260505 20:13:47.353554 9271 rpcz_store.cc:276] 0505 20:13:37.274084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.274129 (+ 45us) service_pool.cc:224] Handling call
0505 20:13:47.353344 (+10079215us) ts_tablet_manager.cc:1151] Deleting tablet f62626fb4f8445e3a6e2822277181762
0505 20:13:47.353353 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.353430 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10079061}
I20260505 20:13:47.353859 9271 tablet_replica.cc:333] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:47.353708 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.354048 9271 raft_consensus.cc:2243] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.354225 9271 raft_consensus.cc:2272] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.354534 8053 tablet_bootstrap.cc:654] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.354933 8054 tablet_bootstrap.cc:654] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.354931 9271 ts_tablet_manager.cc:1916] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.356709 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b6895af5f55b4bc183065626417090a4 (table default.Table_db181a51dd2c430ca2792b4bef5cd912 [id=9c1ec1b20693456f9645c8f8f55af83f]) successfully deleted
W20260505 20:13:47.357044 7397 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f62626fb4f8445e3a6e2822277181762 because the tablet was not found. No further retry: Not found: Tablet not found: f62626fb4f8445e3a6e2822277181762
I20260505 20:13:47.357656 10033 consensus_queue.cc:1048] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.365473 8054 tablet_bootstrap.cc:492] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.365671 8054 ts_tablet_manager.cc:1403] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260505 20:13:47.366530 8054 raft_consensus.cc:359] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.366742 8054 raft_consensus.cc:385] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.366830 8054 raft_consensus.cc:740] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.367069 8054 consensus_queue.cc:260] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:47.367372 7870 leader_election.cc:343] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.367504 7870 leader_election.cc:304] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.367606 8054 ts_tablet_manager.cc:1434] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:47.367929 8054 tablet_bootstrap.cc:492] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.367967 9429 raft_consensus.cc:2749] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.368359 7870 leader_election.cc:343] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.368481 7870 leader_election.cc:304] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.368875 9429 raft_consensus.cc:2749] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.369526 7870 leader_election.cc:343] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.369645 7870 leader_election.cc:304] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.369822 8054 tablet_bootstrap.cc:654] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.370002 9429 raft_consensus.cc:2749] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.380366 9271 ts_tablet_manager.cc:1929] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.383055 9271 log.cc:1199] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/bde33085759f4fd8a130d80878d1e564
I20260505 20:13:47.384235 9271 ts_tablet_manager.cc:1950] T bde33085759f4fd8a130d80878d1e564 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:47.384950 8053 tablet_bootstrap.cc:492] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.386660 8053 ts_tablet_manager.cc:1403] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.005s
I20260505 20:13:47.387533 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 119) took 10113 ms. Trace:
I20260505 20:13:47.387552 8053 raft_consensus.cc:359] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.387773 8053 raft_consensus.cc:385] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.387835 8053 raft_consensus.cc:740] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.388046 8053 consensus_queue.cc:260] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.387696 9271 rpcz_store.cc:276] 0505 20:13:37.274388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.274424 (+ 36us) service_pool.cc:224] Handling call
0505 20:13:47.353813 (+10079389us) ts_tablet_manager.cc:1151] Deleting tablet bde33085759f4fd8a130d80878d1e564
0505 20:13:47.353826 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.363413 (+ 9587us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.380290 (+ 16877us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.387518 (+ 7228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10079276}
I20260505 20:13:47.388578 8053 ts_tablet_manager.cc:1434] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:47.389336 8053 tablet_bootstrap.cc:492] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.389467 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet bde33085759f4fd8a130d80878d1e564 (table default.Table_f1c1f40aa3044bdbbaa23ae22445214b [id=53e038ba0a4441ec9746e5dff6df39dc]) successfully deleted
I20260505 20:13:47.391162 8053 tablet_bootstrap.cc:654] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.394690 8053 tablet_bootstrap.cc:492] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.394837 8053 ts_tablet_manager.cc:1403] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260505 20:13:47.395619 8053 raft_consensus.cc:359] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.395785 8053 raft_consensus.cc:385] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.395844 8053 raft_consensus.cc:740] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.396036 8053 consensus_queue.cc:260] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.396642 8053 ts_tablet_manager.cc:1434] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:47.396943 8053 tablet_bootstrap.cc:492] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.398763 8053 tablet_bootstrap.cc:654] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.398948 8054 tablet_bootstrap.cc:492] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.400810 8058 tablet_bootstrap.cc:492] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.403375 8058 ts_tablet_manager.cc:1403] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.133s user 0.006s sys 0.000s
I20260505 20:13:47.421896 9758 raft_consensus.cc:493] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.422060 9758 raft_consensus.cc:515] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.422717 9758 leader_election.cc:290] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:47.422940 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.423126 7931 raft_consensus.cc:2468] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.423581 7598 leader_election.cc:304] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.423875 9704 raft_consensus.cc:2804] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.423954 9704 raft_consensus.cc:493] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.424019 9704 raft_consensus.cc:3060] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.426647 9704 raft_consensus.cc:515] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.427175 9704 leader_election.cc:290] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:47.430464 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.430629 7931 raft_consensus.cc:3060] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.430675 8053 tablet_bootstrap.cc:492] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.430821 8053 ts_tablet_manager.cc:1403] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.006s
I20260505 20:13:47.431674 8053 raft_consensus.cc:359] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.431838 8053 raft_consensus.cc:385] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.431890 8053 raft_consensus.cc:740] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.432075 8053 consensus_queue.cc:260] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.428351 8058 raft_consensus.cc:359] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.432703 8053 ts_tablet_manager.cc:1434] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:47.433372 7931 raft_consensus.cc:2468] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.434110 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.434760 7598 leader_election.cc:304] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.435483 9271 tablet_replica.cc:333] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:47.435667 9271 raft_consensus.cc:2243] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.435797 9271 raft_consensus.cc:2272] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.436386 9271 ts_tablet_manager.cc:1916] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.437078 8058 raft_consensus.cc:385] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.438455 9906 raft_consensus.cc:2804] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.439409 9906 raft_consensus.cc:697] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.438951 8058 raft_consensus.cc:740] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.441319 9975 consensus_queue.cc:1048] T 7447c40ad6914e75a1b1376213218624 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.441633 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.439762 9906 consensus_queue.cc:237] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.445597 8058 consensus_queue.cc:260] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.451472 9121 ts_tablet_manager.cc:1929] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:47.451944 7737 consensus_peers.cc:597] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.458231 8058 ts_tablet_manager.cc:1434] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.054s user 0.004s sys 0.000s
I20260505 20:13:47.458621 8058 tablet_bootstrap.cc:492] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.458659 9758 raft_consensus.cc:493] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.458801 9758 raft_consensus.cc:515] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.459460 9758 leader_election.cc:290] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.460211 7663 raft_consensus.cc:1275] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Refusing update from remote peer c59c731e012f4f9fbfd7151790b9a5bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260505 20:13:47.460764 8058 tablet_bootstrap.cc:654] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.463163 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.463330 7795 raft_consensus.cc:2468] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.465346 9271 ts_tablet_manager.cc:1929] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:47.465508 9271 log.cc:1199] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/41fdaa9781ef4331bf3f0a7f8db4c1a0
I20260505 20:13:47.465943 9271 ts_tablet_manager.cc:1950] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:47.466728 9121 log.cc:1199] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e6c5c661e8aa4962bb9922b9ead7d784
I20260505 20:13:47.467077 9121 ts_tablet_manager.cc:1950] T e6c5c661e8aa4962bb9922b9ead7d784 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.468832 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 135) took 11611 ms. Trace:
I20260505 20:13:47.468923 9121 rpcz_store.cc:276] 0505 20:13:35.857927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.858153 (+ 226us) service_pool.cc:224] Handling call
0505 20:13:47.271931 (+11413778us) ts_tablet_manager.cc:1151] Deleting tablet e6c5c661e8aa4962bb9922b9ead7d784
0505 20:13:47.272068 (+ 137us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.406518 (+134450us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.451379 (+ 44861us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.468811 (+ 17432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":913,"tablet-delete.queue_time_us":11413443}
I20260505 20:13:47.469414 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e6c5c661e8aa4962bb9922b9ead7d784 (table default.Table_20042b0bea294bc1ad99439fa62373da [id=bea129294980408ea07ab3a19804d918]) successfully deleted
I20260505 20:13:47.470129 9121 tablet_replica.cc:333] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.470340 9121 raft_consensus.cc:2243] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.470481 9121 raft_consensus.cc:2272] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.470973 9121 ts_tablet_manager.cc:1916] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.471691 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.471865 7931 raft_consensus.cc:2468] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.473091 9270 ts_tablet_manager.cc:1929] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.473191 9270 log.cc:1199] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b17da5cf513647d9b8e582a9b3b460a1
W20260505 20:13:47.473275 7596 leader_election.cc:343] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.474753 9975 consensus_queue.cc:1048] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260505 20:13:47.475944 8058 tablet_bootstrap.cc:492] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.476059 8058 ts_tablet_manager.cc:1403] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260505 20:13:47.476234 8053 tablet_bootstrap.cc:492] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.476783 8058 raft_consensus.cc:359] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.476966 8058 raft_consensus.cc:385] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.477021 8058 raft_consensus.cc:740] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.477962 8053 tablet_bootstrap.cc:654] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.480283 7598 leader_election.cc:304] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.488654 9758 raft_consensus.cc:2804] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.488754 9758 raft_consensus.cc:493] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.488811 9758 raft_consensus.cc:3060] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.490564 8058 consensus_queue.cc:260] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.491079 8058 ts_tablet_manager.cc:1434] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260505 20:13:47.490336 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 120) took 10215 ms. Trace:
I20260505 20:13:47.491357 8058 tablet_bootstrap.cc:492] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.491530 9758 raft_consensus.cc:515] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.492133 9758 leader_election.cc:290] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.491369 9271 rpcz_store.cc:276] 0505 20:13:37.274671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.274709 (+ 38us) service_pool.cc:224] Handling call
0505 20:13:47.398297 (+10123588us) ts_tablet_manager.cc:1151] Deleting tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0
0505 20:13:47.435423 (+ 37126us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.461614 (+ 26191us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.465271 (+ 3657us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.489960 (+ 24689us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10123457}
I20260505 20:13:47.495424 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 (table default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]) successfully deleted
I20260505 20:13:47.496690 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.496904 7931 raft_consensus.cc:3060] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.499254 8058 tablet_bootstrap.cc:654] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.500543 7931 raft_consensus.cc:2468] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.505035 7598 leader_election.cc:304] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.506387 9906 raft_consensus.cc:2804] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.506924 9906 raft_consensus.cc:697] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.507458 9906 consensus_queue.cc:237] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.507393 9271 tablet_replica.cc:333] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:47.509866 9271 raft_consensus.cc:2243] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.514424 9271 raft_consensus.cc:2272] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.515533 9121 ts_tablet_manager.cc:1929] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:47.515672 9121 log.cc:1199] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/b393bfc209b6461aab958ebf49014d25
I20260505 20:13:47.516014 9121 ts_tablet_manager.cc:1950] T b393bfc209b6461aab958ebf49014d25 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.517923 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 133) took 11663 ms. Trace:
I20260505 20:13:47.518004 9121 rpcz_store.cc:276] 0505 20:13:35.854578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.859150 (+ 4572us) service_pool.cc:224] Handling call
0505 20:13:47.470076 (+11610926us) ts_tablet_manager.cc:1151] Deleting tablet b393bfc209b6461aab958ebf49014d25
0505 20:13:47.470088 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.486862 (+ 16774us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.515452 (+ 28590us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.517902 (+ 2450us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11610699}
I20260505 20:13:47.518504 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet b393bfc209b6461aab958ebf49014d25 (table default.Table_1dd7483dde8948a787cb771f42d23f8e [id=fd2ae4ccfffd4eb5b7aa1bb5e0613015]) successfully deleted
I20260505 20:13:47.519579 8053 tablet_bootstrap.cc:492] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.519740 8053 ts_tablet_manager.cc:1403] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260505 20:13:47.520133 9121 tablet_replica.cc:333] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.520448 9121 raft_consensus.cc:2243] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.520774 9121 raft_consensus.cc:2272] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.520670 8053 raft_consensus.cc:359] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.520867 8053 raft_consensus.cc:385] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.521310 9121 ts_tablet_manager.cc:1916] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:47.522930 7399 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f54b7c83e66c473db8470e5c4c4decab consensus state has no leader
I20260505 20:13:47.526314 7413 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 192) took 3891 ms. Trace:
I20260505 20:13:47.526428 7413 rpcz_store.cc:276] 0505 20:13:43.634612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.572864 (+2938252us) service_pool.cc:224] Handling call
0505 20:13:47.526244 (+953380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:47.526497 9619 raft_consensus.cc:493] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.526613 9619 raft_consensus.cc:515] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.527225 9619 leader_election.cc:290] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.527335 9619 raft_consensus.cc:493] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.527418 9619 raft_consensus.cc:515] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.527890 9619 leader_election.cc:290] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.528656 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c99f02ea514a2581f0697dc3ef6461" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.529091 7869 leader_election.cc:343] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.530978 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27febef8234419caa855dd7a180fe8f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.533218 7869 leader_election.cc:343] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.534380 9429 raft_consensus.cc:493] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.534502 9429 raft_consensus.cc:515] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.535008 9429 leader_election.cc:290] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.536234 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e217456754440cf90a1c5a642eb2627" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.536640 7869 leader_election.cc:343] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.543123 9975 raft_consensus.cc:493] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.543257 9975 raft_consensus.cc:515] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.542896 8054 ts_tablet_manager.cc:1403] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.175s user 0.023s sys 0.000s
I20260505 20:13:47.544013 9975 leader_election.cc:290] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.544071 8054 raft_consensus.cc:359] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.544220 8054 raft_consensus.cc:385] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.544294 8054 raft_consensus.cc:740] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.544513 8054 consensus_queue.cc:260] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:47.545117 7737 leader_election.cc:343] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e6c5c661e8aa4962bb9922b9ead7d784
W20260505 20:13:47.545437 7736 leader_election.cc:343] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: e6c5c661e8aa4962bb9922b9ead7d784
I20260505 20:13:47.545532 7736 leader_election.cc:304] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.545948 9975 raft_consensus.cc:2749] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.549093 9270 ts_tablet_manager.cc:1950] T b17da5cf513647d9b8e582a9b3b460a1 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.549698 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 121) took 10272 ms. Trace:
I20260505 20:13:47.549889 9270 rpcz_store.cc:276] 0505 20:13:37.277072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.277207 (+ 135us) service_pool.cc:224] Handling call
0505 20:13:47.306385 (+10029178us) ts_tablet_manager.cc:1151] Deleting tablet b17da5cf513647d9b8e582a9b3b460a1
0505 20:13:47.306398 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.375976 (+ 69578us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.473036 (+ 97060us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.549676 (+ 76640us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9396,"tablet-delete.queue_time_us":10029067}
I20260505 20:13:47.550263 9429 raft_consensus.cc:493] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.550406 9429 raft_consensus.cc:515] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.550565 9270 tablet_replica.cc:333] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.550572 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b17da5cf513647d9b8e582a9b3b460a1 (table default.Table_3320012d7d2d474e8bb80df0f8f7ee59 [id=37a0fe2c6a244790a917bf66649e81ee]) successfully deleted
I20260505 20:13:47.550766 9270 raft_consensus.cc:2243] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.550931 9270 raft_consensus.cc:2272] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.551036 9429 leader_election.cc:290] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.551409 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be05357416b24dabaaa5f2ce2f33c82e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.551520 9270 ts_tablet_manager.cc:1916] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:47.551870 7869 leader_election.cc:343] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.554212 9121 ts_tablet_manager.cc:1929] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.554320 9121 log.cc:1199] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/64a82a9d144746338b3fc6550aa35d3c
I20260505 20:13:47.554633 9121 ts_tablet_manager.cc:1950] T 64a82a9d144746338b3fc6550aa35d3c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.556036 8054 ts_tablet_manager.cc:1434] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260505 20:13:47.556367 8054 tablet_bootstrap.cc:492] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.559508 8058 tablet_bootstrap.cc:492] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.559669 8058 ts_tablet_manager.cc:1403] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.007s
I20260505 20:13:47.559942 8053 raft_consensus.cc:740] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.560194 8053 consensus_queue.cc:260] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.560297 9429 raft_consensus.cc:493] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.560427 9429 raft_consensus.cc:515] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.560433 8058 raft_consensus.cc:359] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.560598 8058 raft_consensus.cc:385] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.560665 8058 raft_consensus.cc:740] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.561030 9429 leader_election.cc:290] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.560829 8058 consensus_queue.cc:260] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.561378 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81319ed5eed64dafb9b2a121661da9ea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.561497 8058 ts_tablet_manager.cc:1434] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260505 20:13:47.561861 7869 leader_election.cc:343] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.562072 8058 tablet_bootstrap.cc:492] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:47.565122 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 91900.5us
W20260505 20:13:47.565474 7596 leader_election.cc:343] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.567855 9975 raft_consensus.cc:493] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.567978 9975 raft_consensus.cc:515] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.568550 9975 leader_election.cc:290] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.569198 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.569640 8054 tablet_bootstrap.cc:654] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.570176 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c9aaca827442cc8cc605f56c222860" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.570310 8058 tablet_bootstrap.cc:654] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.570418 7931 raft_consensus.cc:2393] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:47.571046 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c99f02ea514a2581f0697dc3ef6461" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.571496 7737 leader_election.cc:304] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.572007 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27febef8234419caa855dd7a180fe8f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.572021 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f27d918f0945208e780bd9583f529e" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.572182 7787 raft_consensus.cc:3060] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.573786 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e217456754440cf90a1c5a642eb2627" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.574230 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be05357416b24dabaaa5f2ce2f33c82e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.574654 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81319ed5eed64dafb9b2a121661da9ea" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.574848 10033 raft_consensus.cc:3060] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:47.575215 7870 leader_election.cc:343] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.575327 7870 leader_election.cc:304] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.575971 9429 raft_consensus.cc:2749] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.576367 7870 leader_election.cc:343] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.576463 7870 leader_election.cc:304] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.576674 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 136) took 11717 ms. Trace:
I20260505 20:13:47.576838 9429 raft_consensus.cc:2749] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.576748 9121 rpcz_store.cc:276] 0505 20:13:35.859015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.859239 (+ 224us) service_pool.cc:224] Handling call
0505 20:13:47.520078 (+11660839us) ts_tablet_manager.cc:1151] Deleting tablet 64a82a9d144746338b3fc6550aa35d3c
0505 20:13:47.520088 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.526014 (+ 5926us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.554160 (+ 28146us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.576658 (+ 22498us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11660615}
I20260505 20:13:47.577217 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 64a82a9d144746338b3fc6550aa35d3c (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]) successfully deleted
I20260505 20:13:47.577492 10033 raft_consensus.cc:2749] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.577585 9121 tablet_replica.cc:333] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.577802 9121 raft_consensus.cc:2243] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.577955 9121 raft_consensus.cc:2272] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:47.578202 7870 leader_election.cc:343] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.578295 7870 leader_election.cc:304] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.578557 9121 ts_tablet_manager.cc:1916] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.578656 9429 raft_consensus.cc:2749] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:47.579034 7870 leader_election.cc:343] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.579120 7870 leader_election.cc:304] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.579716 9429 raft_consensus.cc:2749] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.579870 7787 raft_consensus.cc:2468] T d5f27d918f0945208e780bd9583f529e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:47.580119 7870 leader_election.cc:343] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.580212 7870 leader_election.cc:304] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.580653 9429 raft_consensus.cc:2749] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.581853 9758 consensus_queue.cc:1048] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.583104 9975 consensus_queue.cc:1048] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.587714 9758 consensus_queue.cc:1048] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.587881 8053 ts_tablet_manager.cc:1434] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.068s user 0.016s sys 0.000s
I20260505 20:13:47.588222 8053 tablet_bootstrap.cc:492] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.590579 9429 raft_consensus.cc:493] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.590996 9429 raft_consensus.cc:515] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.591694 9429 leader_election.cc:290] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.592052 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca16deae2e4f4f9a9069822b57c5bc7f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.592586 7869 leader_election.cc:343] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.598173 8053 tablet_bootstrap.cc:654] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.602547 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca16deae2e4f4f9a9069822b57c5bc7f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.604195 9270 ts_tablet_manager.cc:1929] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260505 20:13:47.605466 7870 leader_election.cc:343] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.605604 7870 leader_election.cc:304] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.606243 9429 raft_consensus.cc:2749] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.606492 9270 log.cc:1199] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/944aad58d3c14577a0c66edd95fdf5e0
I20260505 20:13:47.609128 9270 ts_tablet_manager.cc:1950] T 944aad58d3c14577a0c66edd95fdf5e0 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.609863 8054 tablet_bootstrap.cc:492] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.610109 9121 ts_tablet_manager.cc:1929] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.610221 9121 log.cc:1199] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ee19f65120184eca9495513b68440b4f
I20260505 20:13:47.610607 9121 ts_tablet_manager.cc:1950] T ee19f65120184eca9495513b68440b4f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.610743 8054 ts_tablet_manager.cc:1403] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.054s user 0.005s sys 0.001s
I20260505 20:13:47.611352 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 137) took 11751 ms. Trace:
I20260505 20:13:47.611445 9121 rpcz_store.cc:276] 0505 20:13:35.860370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.860434 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:47.577540 (+11717106us) ts_tablet_manager.cc:1151] Deleting tablet ee19f65120184eca9495513b68440b4f
0505 20:13:47.577550 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.598969 (+ 21419us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.610040 (+ 11071us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.611334 (+ 1294us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11716928}
I20260505 20:13:47.611923 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet ee19f65120184eca9495513b68440b4f (table default.Table_5e1f5308c918489ba8d124bd3752d9b3 [id=08ec5e3e61a646439d9cce426e601d16]) successfully deleted
I20260505 20:13:47.612545 8053 tablet_bootstrap.cc:492] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.610616 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 122) took 10333 ms. Trace:
I20260505 20:13:47.614216 9270 rpcz_store.cc:276] 0505 20:13:37.277418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.277555 (+ 137us) service_pool.cc:224] Handling call
0505 20:13:47.550514 (+10272959us) ts_tablet_manager.cc:1151] Deleting tablet 944aad58d3c14577a0c66edd95fdf5e0
0505 20:13:47.550525 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.567808 (+ 17283us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.604125 (+ 36317us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.610600 (+ 6475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10272844}
I20260505 20:13:47.614758 8053 ts_tablet_manager.cc:1403] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260505 20:13:47.615275 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 944aad58d3c14577a0c66edd95fdf5e0 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:47.615687 9270 tablet_replica.cc:333] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.616521 8053 raft_consensus.cc:359] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.617056 9270 raft_consensus.cc:2243] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.615377 8054 raft_consensus.cc:359] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.617519 8054 raft_consensus.cc:385] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.617707 8054 raft_consensus.cc:740] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.617970 9270 raft_consensus.cc:2272] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.618287 8054 consensus_queue.cc:260] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.619541 9270 ts_tablet_manager.cc:1916] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.620672 8053 raft_consensus.cc:385] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.620888 8053 raft_consensus.cc:740] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.621287 8053 consensus_queue.cc:260] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.621757 8054 ts_tablet_manager.cc:1434] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260505 20:13:47.624202 8053 ts_tablet_manager.cc:1434] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260505 20:13:47.624878 8053 tablet_bootstrap.cc:492] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.626238 8058 tablet_bootstrap.cc:492] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.626377 8058 ts_tablet_manager.cc:1403] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.002s
I20260505 20:13:47.627112 8058 raft_consensus.cc:359] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.627197 9429 raft_consensus.cc:493] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.627295 8058 raft_consensus.cc:385] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.627357 8058 raft_consensus.cc:740] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.627337 9429 raft_consensus.cc:515] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.627558 8058 consensus_queue.cc:260] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.627976 9429 leader_election.cc:290] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.628072 8058 ts_tablet_manager.cc:1434] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:47.628333 8058 tablet_bootstrap.cc:492] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.628697 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6dc9ec93ddb406ab956389518a9a7b3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:47.630218 7870 leader_election.cc:343] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.630759 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6dc9ec93ddb406ab956389518a9a7b3" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.631251 7869 leader_election.cc:343] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.631356 7869 leader_election.cc:304] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.631480 9948 consensus_queue.cc:1048] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.631002 8058 tablet_bootstrap.cc:654] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.631846 8053 tablet_bootstrap.cc:654] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.632155 9429 raft_consensus.cc:2749] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.638008 9270 ts_tablet_manager.cc:1929] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.638146 9270 log.cc:1199] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b6895af5f55b4bc183065626417090a4
I20260505 20:13:47.638548 9270 ts_tablet_manager.cc:1950] T b6895af5f55b4bc183065626417090a4 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.638906 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 123) took 10361 ms. Trace:
I20260505 20:13:47.639001 9270 rpcz_store.cc:276] 0505 20:13:37.277840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278049 (+ 209us) service_pool.cc:224] Handling call
0505 20:13:47.615636 (+10337587us) ts_tablet_manager.cc:1151] Deleting tablet b6895af5f55b4bc183065626417090a4
0505 20:13:47.615649 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.629542 (+ 13893us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.637929 (+ 8387us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.638882 (+ 953us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10337460}
I20260505 20:13:47.641115 9121 tablet_replica.cc:333] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.641327 8054 tablet_bootstrap.cc:492] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.643078 8054 tablet_bootstrap.cc:654] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.650943 9271 ts_tablet_manager.cc:1916] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.654599 8058 tablet_bootstrap.cc:492] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.654768 8058 ts_tablet_manager.cc:1403] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.007s
I20260505 20:13:47.655516 8058 raft_consensus.cc:359] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.655714 8058 raft_consensus.cc:385] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.655781 8058 raft_consensus.cc:740] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.655952 9121 raft_consensus.cc:2243] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.639570 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b6895af5f55b4bc183065626417090a4 (table default.Table_db181a51dd2c430ca2792b4bef5cd912 [id=9c1ec1b20693456f9645c8f8f55af83f]) successfully deleted
I20260505 20:13:47.656399 9121 raft_consensus.cc:2272] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.656672 8058 consensus_queue.cc:260] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.657349 8058 ts_tablet_manager.cc:1434] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260505 20:13:47.657662 8058 tablet_bootstrap.cc:492] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:47.657997 10086 consensus_queue.cc:1175] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "974ed93a43c54ccbb58e60bfdae7c546" status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260505 20:13:47.659148 8058 tablet_bootstrap.cc:654] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.659946 9270 tablet_replica.cc:333] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.660434 9121 ts_tablet_manager.cc:1916] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.660849 9270 raft_consensus.cc:2243] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.661962 9270 raft_consensus.cc:2272] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.664744 9270 ts_tablet_manager.cc:1916] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.666512 9121 ts_tablet_manager.cc:1929] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.666630 9121 log.cc:1199] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/feef367085954816b312d4f1cdd80b1d
I20260505 20:13:47.667050 9121 ts_tablet_manager.cc:1950] T feef367085954816b312d4f1cdd80b1d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.667845 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 138) took 11806 ms. Trace:
I20260505 20:13:47.667938 9121 rpcz_store.cc:276] 0505 20:13:35.861734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.861838 (+ 104us) service_pool.cc:224] Handling call
0505 20:13:47.624228 (+11762390us) ts_tablet_manager.cc:1151] Deleting tablet feef367085954816b312d4f1cdd80b1d
0505 20:13:47.641063 (+ 16835us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.656299 (+ 15236us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x616000102754. stack: 00007fb17c941086 00007fb17c940e40 00007fb17b8fa3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fb1888927e0 00007fb189be6283 00007fb18c7aba77 00007fb18c7deb44 00007fb18c7bf560 00007fb18c7bf2ed 0000000000aa4cac 00007fb17c986f6f 00007fb17c98a28b 00007fb17c98a108
0505 20:13:47.663558 (+ 7259us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.666447 (+ 2889us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.667824 (+ 1377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33595264,"tablet-delete.queue_time_us":11762179}
I20260505 20:13:47.668503 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet feef367085954816b312d4f1cdd80b1d (table default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e [id=bb29d0a7cf114a8296a5af3e56dddf0c]) successfully deleted
I20260505 20:13:47.678200 9429 raft_consensus.cc:493] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.678387 9429 raft_consensus.cc:515] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.678959 9429 leader_election.cc:290] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.680603 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.680797 7663 raft_consensus.cc:2468] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:47.681674 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.681782 7870 leader_election.cc:304] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:47.682152 7869 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.682227 9619 raft_consensus.cc:2804] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.682921 9619 raft_consensus.cc:493] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.682996 9619 raft_consensus.cc:3060] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.682011 9121 tablet_replica.cc:333] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.683216 9121 raft_consensus.cc:2243] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.683369 9121 raft_consensus.cc:2272] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.683895 9121 ts_tablet_manager.cc:1916] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.685995 9619 raft_consensus.cc:515] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.686709 9619 leader_election.cc:290] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.687119 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
W20260505 20:13:47.687603 7869 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.690066 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:47.690272 7663 raft_consensus.cc:3060] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.692942 7663 raft_consensus.cc:2468] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:47.694382 8058 tablet_bootstrap.cc:492] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.694518 8058 ts_tablet_manager.cc:1403] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260505 20:13:47.695263 8058 raft_consensus.cc:359] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.695407 8058 raft_consensus.cc:385] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.695448 8058 raft_consensus.cc:740] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.695616 8058 consensus_queue.cc:260] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.696054 8058 ts_tablet_manager.cc:1434] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:47.697007 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:47.698319 7870 leader_election.cc:304] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:47.698859 9429 raft_consensus.cc:2804] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.698987 9429 raft_consensus.cc:697] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:47.699209 9429 consensus_queue.cc:237] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.700654 10031 raft_consensus.cc:493] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.700824 10031 raft_consensus.cc:515] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.701350 10031 leader_election.cc:290] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.702903 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a30738cb354b2c839f76b5d3b3be96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.703136 7663 raft_consensus.cc:2468] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:47.703665 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a30738cb354b2c839f76b5d3b3be96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.703842 7790 raft_consensus.cc:2468] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:47.704311 7870 leader_election.cc:304] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.704809 9619 raft_consensus.cc:2804] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.704932 9619 raft_consensus.cc:493] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.705050 9619 raft_consensus.cc:3060] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.708174 9619 raft_consensus.cc:515] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.709368 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a30738cb354b2c839f76b5d3b3be96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.709574 7790 raft_consensus.cc:3060] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.712970 9121 ts_tablet_manager.cc:1929] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.713084 9121 log.cc:1199] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/c720fc66db36402a83a7690d70a40353
I20260505 20:13:47.713403 9121 ts_tablet_manager.cc:1950] T c720fc66db36402a83a7690d70a40353 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.713373 7790 raft_consensus.cc:2468] T 71a30738cb354b2c839f76b5d3b3be96 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:47.713871 7869 leader_election.cc:304] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:47.714234 10031 raft_consensus.cc:2804] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.718147 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a30738cb354b2c839f76b5d3b3be96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:47.718430 7663 raft_consensus.cc:3060] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.718413 10031 raft_consensus.cc:697] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:47.718710 10031 consensus_queue.cc:237] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.719631 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 134) took 11863 ms. Trace:
I20260505 20:13:47.719726 9121 rpcz_store.cc:276] 0505 20:13:35.856190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.862117 (+ 5927us) service_pool.cc:224] Handling call
0505 20:13:47.681958 (+11819841us) ts_tablet_manager.cc:1151] Deleting tablet c720fc66db36402a83a7690d70a40353
0505 20:13:47.681969 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.702482 (+ 20513us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.712908 (+ 10426us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.719611 (+ 6703us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11819647}
I20260505 20:13:47.720182 9619 leader_election.cc:290] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.720214 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet c720fc66db36402a83a7690d70a40353 (table default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]) successfully deleted
I20260505 20:13:47.721154 7663 raft_consensus.cc:2468] T 71a30738cb354b2c839f76b5d3b3be96 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:47.727537 9270 ts_tablet_manager.cc:1929] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.734033 9121 tablet_replica.cc:333] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.734270 9121 raft_consensus.cc:2243] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.734644 9121 raft_consensus.cc:2272] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.735224 9121 ts_tablet_manager.cc:1916] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.741127 9121 ts_tablet_manager.cc:1929] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.741245 9121 log.cc:1199] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/d138d27f444f45d28acdc7d72a9649f5
I20260505 20:13:47.741613 9121 ts_tablet_manager.cc:1950] T d138d27f444f45d28acdc7d72a9649f5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.762429 10031 raft_consensus.cc:493] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.762676 10031 raft_consensus.cc:515] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.763628 10031 leader_election.cc:290] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.764202 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.764705 7869 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.766592 8054 tablet_bootstrap.cc:492] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.767436 8054 ts_tablet_manager.cc:1403] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.002s
I20260505 20:13:47.768275 8054 raft_consensus.cc:359] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.768595 8054 raft_consensus.cc:385] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.768672 8054 raft_consensus.cc:740] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.762074 8058 tablet_bootstrap.cc:492] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.771065 8058 tablet_bootstrap.cc:654] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.763968 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.765568 7661 raft_consensus.cc:3060] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:47.775218 7870 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.775389 7870 leader_election.cc:304] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.776005 9429 raft_consensus.cc:2749] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.776193 9429 consensus_queue.cc:1048] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.779775 9270 log.cc:1199] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/0d5ed062508b411eb0fa5a14637830ea
I20260505 20:13:47.780872 9270 ts_tablet_manager.cc:1950] T 0d5ed062508b411eb0fa5a14637830ea P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.781169 8054 consensus_queue.cc:260] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.786293 8054 ts_tablet_manager.cc:1434] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260505 20:13:47.794531 10031 raft_consensus.cc:493] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.794783 10031 raft_consensus.cc:515] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:47.795467 7737 consensus_peers.cc:597] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0d4e198c91c4a0e99d8b798a1dd3433. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.796298 10031 leader_election.cc:290] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.796748 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2fb4e615c4486b9d071b2366f85471" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:47.797341 7870 leader_election.cc:343] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.797405 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2fb4e615c4486b9d071b2366f85471" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.797894 7869 leader_election.cc:343] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.798007 7869 leader_election.cc:304] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.798243 10031 raft_consensus.cc:2749] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.799714 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 124) took 10521 ms. Trace:
I20260505 20:13:47.799854 9270 rpcz_store.cc:276] 0505 20:13:37.278349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278536 (+ 187us) service_pool.cc:224] Handling call
0505 20:13:47.659891 (+10381355us) ts_tablet_manager.cc:1151] Deleting tablet 0d5ed062508b411eb0fa5a14637830ea
0505 20:13:47.659902 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.713228 (+ 53326us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.727469 (+ 14241us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.799663 (+ 72194us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10381228}
I20260505 20:13:47.800349 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 0d5ed062508b411eb0fa5a14637830ea (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]) successfully deleted
I20260505 20:13:47.804656 9270 tablet_replica.cc:333] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.805306 9270 raft_consensus.cc:2243] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.805958 9270 raft_consensus.cc:2272] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.806599 9270 ts_tablet_manager.cc:1916] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.806622 8053 tablet_bootstrap.cc:492] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:47.806774 8053 ts_tablet_manager.cc:1403] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.182s user 0.011s sys 0.009s
I20260505 20:13:47.807602 8053 raft_consensus.cc:359] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.810297 8053 raft_consensus.cc:385] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.810415 8053 raft_consensus.cc:740] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.810688 8053 consensus_queue.cc:260] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.811290 8053 ts_tablet_manager.cc:1434] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260505 20:13:47.811630 8053 tablet_bootstrap.cc:492] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.812722 8058 tablet_bootstrap.cc:492] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.812947 8058 ts_tablet_manager.cc:1403] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.012s
I20260505 20:13:47.813889 8058 raft_consensus.cc:359] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.814190 8058 raft_consensus.cc:385] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.814321 8058 raft_consensus.cc:740] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.814697 8058 consensus_queue.cc:260] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.815531 8058 ts_tablet_manager.cc:1434] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:47.816075 8058 tablet_bootstrap.cc:492] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.819864 8053 tablet_bootstrap.cc:654] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.820643 9619 consensus_queue.cc:1048] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.830302 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 132) took 11977 ms. Trace:
I20260505 20:13:47.830426 9121 rpcz_store.cc:276] 0505 20:13:35.853259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.862793 (+ 9534us) service_pool.cc:224] Handling call
0505 20:13:47.733978 (+11871185us) ts_tablet_manager.cc:1151] Deleting tablet d138d27f444f45d28acdc7d72a9649f5
0505 20:13:47.733989 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.738280 (+ 4291us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.741077 (+ 2797us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.830280 (+ 89203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11870972}
I20260505 20:13:47.830775 9121 tablet_replica.cc:333] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.830981 9121 raft_consensus.cc:2243] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.831316 9121 raft_consensus.cc:2272] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.831879 9121 ts_tablet_manager.cc:1916] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.834192 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet d138d27f444f45d28acdc7d72a9649f5 (table default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]) successfully deleted
I20260505 20:13:47.834681 8054 tablet_bootstrap.cc:492] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.836052 8054 tablet_bootstrap.cc:654] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.847617 9619 raft_consensus.cc:493] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.847868 9619 raft_consensus.cc:515] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.848973 10031 raft_consensus.cc:493] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.849094 10031 raft_consensus.cc:515] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.849342 9619 leader_election.cc:290] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.849565 10031 leader_election.cc:290] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.850257 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed62f9b81e48459c6d55664ddf1cc6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.850525 7663 raft_consensus.cc:2468] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:47.851014 7870 leader_election.cc:304] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.851270 10031 raft_consensus.cc:2804] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.851358 10031 raft_consensus.cc:493] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.851428 10031 raft_consensus.cc:3060] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.852072 9121 ts_tablet_manager.cc:1929] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.852183 9121 log.cc:1199] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/79ce82aca20d44819f28785322e935ae
I20260505 20:13:47.852547 9121 ts_tablet_manager.cc:1950] T 79ce82aca20d44819f28785322e935ae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.854085 10031 raft_consensus.cc:515] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.854497 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.854645 10031 leader_election.cc:290] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.855103 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed62f9b81e48459c6d55664ddf1cc6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:47.855671 7663 raft_consensus.cc:3060] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.855840 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 139) took 11992 ms. Trace:
I20260505 20:13:47.855914 9121 rpcz_store.cc:276] 0505 20:13:35.863403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.863625 (+ 222us) service_pool.cc:224] Handling call
0505 20:13:47.830711 (+11967086us) ts_tablet_manager.cc:1151] Deleting tablet 79ce82aca20d44819f28785322e935ae
0505 20:13:47.830725 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.843519 (+ 12794us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.852014 (+ 8495us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.855821 (+ 3807us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11966881}
I20260505 20:13:47.856334 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 79ce82aca20d44819f28785322e935ae (table default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]) successfully deleted
I20260505 20:13:47.858500 7663 raft_consensus.cc:2468] T 92ed62f9b81e48459c6d55664ddf1cc6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:47.859050 7870 leader_election.cc:304] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.859126 8058 tablet_bootstrap.cc:654] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.859314 10031 raft_consensus.cc:2804] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.859444 10031 raft_consensus.cc:697] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:47.859490 7661 raft_consensus.cc:2468] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:47.859694 10031 consensus_queue.cc:237] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.860006 7870 leader_election.cc:304] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.860424 10091 raft_consensus.cc:2804] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.860507 10091 raft_consensus.cc:493] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.860579 10091 raft_consensus.cc:3060] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:47.834961 7736 consensus_peers.cc:597] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19720f3a29f34515a952e50f4fec9f97. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:47.862939 9121 tablet_replica.cc:333] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.863108 10091 raft_consensus.cc:515] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.863571 8058 tablet_bootstrap.cc:492] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.863716 8058 ts_tablet_manager.cc:1403] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.003s
I20260505 20:13:47.863747 10091 leader_election.cc:290] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.838132 9271 ts_tablet_manager.cc:1929] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:47.864244 9271 log.cc:1199] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/bd01314146a34257b444a622829b2fe4
I20260505 20:13:47.864522 8058 raft_consensus.cc:359] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.864740 8058 raft_consensus.cc:385] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.864827 8058 raft_consensus.cc:740] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.865054 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.865046 8058 consensus_queue.cc:260] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.865612 8058 ts_tablet_manager.cc:1434] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:47.865947 8058 tablet_bootstrap.cc:492] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.865954 9271 ts_tablet_manager.cc:1950] T bd01314146a34257b444a622829b2fe4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:47.866303 7869 leader_election.cc:343] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.866493 9121 raft_consensus.cc:2243] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.866806 9121 raft_consensus.cc:2272] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.867384 9121 ts_tablet_manager.cc:1916] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.867530 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:47.867743 7663 raft_consensus.cc:3060] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.869690 8054 tablet_bootstrap.cc:492] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.869838 8054 ts_tablet_manager.cc:1403] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.002s
I20260505 20:13:47.870460 7663 raft_consensus.cc:2468] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:47.870664 8054 raft_consensus.cc:359] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.870818 8054 raft_consensus.cc:385] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.870868 8054 raft_consensus.cc:740] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.870891 7870 leader_election.cc:304] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:47.871047 8054 consensus_queue.cc:260] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.871302 9619 raft_consensus.cc:2804] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.871446 9619 raft_consensus.cc:697] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:47.871556 8054 ts_tablet_manager.cc:1434] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:47.871654 9619 consensus_queue.cc:237] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.871863 8054 tablet_bootstrap.cc:492] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.853931 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.873221 8054 tablet_bootstrap.cc:654] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.854182 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed62f9b81e48459c6d55664ddf1cc6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.855482 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ed62f9b81e48459c6d55664ddf1cc6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.873101 8053 tablet_bootstrap.cc:492] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:47.873579 7869 leader_election.cc:343] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.873664 7790 raft_consensus.cc:3060] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.873710 8053 ts_tablet_manager.cc:1403] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.002s
I20260505 20:13:47.874804 8053 raft_consensus.cc:359] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.874965 8053 raft_consensus.cc:385] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.875025 8053 raft_consensus.cc:740] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.875730 8053 consensus_queue.cc:260] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.876245 8053 ts_tablet_manager.cc:1434] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:47.876310 7790 raft_consensus.cc:2468] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:47.876551 8053 tablet_bootstrap.cc:492] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:47.876746 7785 raft_consensus.cc:2376] T 92ed62f9b81e48459c6d55664ddf1cc6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1. Re-sending same reply.
I20260505 20:13:47.878017 8053 tablet_bootstrap.cc:654] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.882719 10091 raft_consensus.cc:493] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.882864 10091 raft_consensus.cc:515] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.883459 10091 leader_election.cc:290] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.883766 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a96ed0d53064aa480d93420c6b41bc2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.884177 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a96ed0d53064aa480d93420c6b41bc2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:47.884268 7869 leader_election.cc:343] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:47.884668 7870 leader_election.cc:343] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.884778 7870 leader_election.cc:304] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:47.885159 10091 raft_consensus.cc:2749] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:47.900197 9270 ts_tablet_manager.cc:1929] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.900454 9270 log.cc:1199] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/249cad23ecfe4b9dbbd34f2a1fa899e3
I20260505 20:13:47.900889 9270 ts_tablet_manager.cc:1950] T 249cad23ecfe4b9dbbd34f2a1fa899e3 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.901690 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 125) took 10622 ms. Trace:
I20260505 20:13:47.905902 8054 tablet_bootstrap.cc:492] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.906049 8054 ts_tablet_manager.cc:1403] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.002s
I20260505 20:13:47.906734 8054 raft_consensus.cc:359] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.906900 8054 raft_consensus.cc:385] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.906962 8054 raft_consensus.cc:740] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.907160 8054 consensus_queue.cc:260] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.907387 9270 rpcz_store.cc:276] 0505 20:13:37.278857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278976 (+ 119us) service_pool.cc:224] Handling call
0505 20:13:47.801035 (+10522059us) ts_tablet_manager.cc:1151] Deleting tablet 249cad23ecfe4b9dbbd34f2a1fa899e3
0505 20:13:47.804159 (+ 3124us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.882530 (+ 78371us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.900090 (+ 17560us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.901647 (+ 1557us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10521102}
I20260505 20:13:47.911609 8054 ts_tablet_manager.cc:1434] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:47.911893 8054 tablet_bootstrap.cc:492] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.867776 8058 tablet_bootstrap.cc:654] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.912284 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 249cad23ecfe4b9dbbd34f2a1fa899e3 (table default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]) successfully deleted
I20260505 20:13:47.913306 8054 tablet_bootstrap.cc:654] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.913285 9270 tablet_replica.cc:333] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.913618 9270 raft_consensus.cc:2243] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:47.914043 9270 pending_rounds.cc:70] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:47.914170 9270 pending_rounds.cc:77] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7282737245543735296 op_type: NO_OP noop_request { }
I20260505 20:13:47.914331 9270 raft_consensus.cc:2889] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:47.914470 9270 raft_consensus.cc:2272] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.915033 9270 ts_tablet_manager.cc:1916] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.916304 9121 ts_tablet_manager.cc:1929] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.916412 9121 log.cc:1199] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e041ebc882b14484a51fe3a6589cddd6
I20260505 20:13:47.916739 9121 ts_tablet_manager.cc:1950] T e041ebc882b14484a51fe3a6589cddd6 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.923484 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 142) took 12018 ms. Trace:
I20260505 20:13:47.923594 9121 rpcz_store.cc:276] 0505 20:13:35.904886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.904983 (+ 97us) service_pool.cc:224] Handling call
0505 20:13:47.862885 (+11957902us) ts_tablet_manager.cc:1151] Deleting tablet e041ebc882b14484a51fe3a6589cddd6
0505 20:13:47.862896 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.902197 (+ 39301us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.916253 (+ 14056us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.923462 (+ 7209us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11870291}
I20260505 20:13:47.924080 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e041ebc882b14484a51fe3a6589cddd6 (table default.Table_90124bd7f0774a3ab49bcd90a3ec3733 [id=d4a0d51cd26f49eab032102e2064e622]) successfully deleted
I20260505 20:13:47.927942 9758 raft_consensus.cc:493] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.928122 9758 raft_consensus.cc:515] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.928334 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 121) took 10653 ms. Trace:
I20260505 20:13:47.928745 9758 leader_election.cc:290] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.930168 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.930094 8058 tablet_bootstrap.cc:492] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.930359 9121 tablet_replica.cc:333] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.930505 8058 ts_tablet_manager.cc:1403] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.001s
I20260505 20:13:47.930567 9121 raft_consensus.cc:2243] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.930686 7787 raft_consensus.cc:2468] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.930743 9121 raft_consensus.cc:2272] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.931231 9121 ts_tablet_manager.cc:1916] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.931259 7596 leader_election.cc:304] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.931299 8058 raft_consensus.cc:359] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.931469 8058 raft_consensus.cc:385] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.931543 8058 raft_consensus.cc:740] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.931772 9758 raft_consensus.cc:2804] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.931774 8058 consensus_queue.cc:260] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.931932 9758 raft_consensus.cc:493] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.932042 9758 raft_consensus.cc:3060] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.935698 8058 ts_tablet_manager.cc:1434] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:47.935793 9758 raft_consensus.cc:515] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.936005 8058 tablet_bootstrap.cc:492] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:47.936906 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.937099 7785 raft_consensus.cc:3060] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.937516 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.937669 7921 raft_consensus.cc:3060] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.937919 9906 raft_consensus.cc:493] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.938055 9906 raft_consensus.cc:515] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.938617 9906 leader_election.cc:290] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.939473 9758 leader_election.cc:290] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.939777 7785 raft_consensus.cc:2468] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.939741 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.939965 7930 raft_consensus.cc:2468] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.940052 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:47.940237 7921 raft_consensus.cc:2468] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.940941 7596 leader_election.cc:304] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:47.941351 7596 leader_election.cc:343] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.942281 9758 raft_consensus.cc:2804] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.942466 9758 raft_consensus.cc:697] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.942884 9758 consensus_queue.cc:237] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.943086 7598 leader_election.cc:304] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:47.943939 9906 raft_consensus.cc:2804] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.944067 9906 raft_consensus.cc:493] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.944202 9906 raft_consensus.cc:3060] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.948141 9906 raft_consensus.cc:515] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.949637 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.950335 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.950542 7921 raft_consensus.cc:3060] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:47.950553 7596 leader_election.cc:343] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.950873 9906 leader_election.cc:290] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.952200 9894 consensus_queue.cc:1048] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.953172 7921 raft_consensus.cc:2468] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:47.953482 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010c399e14624550bf02ea248d653538" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.954149 7598 leader_election.cc:304] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:47.954229 8054 tablet_bootstrap.cc:492] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.954344 8054 ts_tablet_manager.cc:1403] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.000s
I20260505 20:13:47.955042 8054 raft_consensus.cc:359] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.955200 8054 raft_consensus.cc:385] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.955253 8054 raft_consensus.cc:740] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.955449 8054 consensus_queue.cc:260] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.955518 7931 raft_consensus.cc:2376] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1. Re-sending same reply.
I20260505 20:13:47.955749 9495 raft_consensus.cc:2804] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.955907 9495 raft_consensus.cc:697] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:47.956091 8054 ts_tablet_manager.cc:1434] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:47.956177 9495 consensus_queue.cc:237] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.956334 8054 tablet_bootstrap.cc:492] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.956739 8058 tablet_bootstrap.cc:654] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.957890 8054 tablet_bootstrap.cc:654] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.963153 9906 raft_consensus.cc:493] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.963442 9906 raft_consensus.cc:515] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.964295 9906 leader_election.cc:290] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:47.964771 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.965070 7931 raft_consensus.cc:2468] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:47.965639 7598 leader_election.cc:304] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:47.965981 9906 raft_consensus.cc:2804] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.966084 9906 raft_consensus.cc:493] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.966183 9906 raft_consensus.cc:3060] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.966282 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:47.966841 7596 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.968938 9906 raft_consensus.cc:515] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.928550 9271 rpcz_store.cc:276] 0505 20:13:37.274972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.275235 (+ 263us) service_pool.cc:224] Handling call
0505 20:13:47.506191 (+10230956us) ts_tablet_manager.cc:1151] Deleting tablet bd01314146a34257b444a622829b2fe4
0505 20:13:47.506795 (+ 604us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.760883 (+254088us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.838067 (+ 77184us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.928308 (+ 90241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10230533}
I20260505 20:13:47.970902 9894 raft_consensus.cc:493] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:47.971030 9894 raft_consensus.cc:515] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.971908 9894 leader_election.cc:290] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.973075 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:47.973420 7931 raft_consensus.cc:2468] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:47.972424 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:47.973814 7661 raft_consensus.cc:2468] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:47.973951 7737 leader_election.cc:304] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:47.974629 9894 raft_consensus.cc:2804] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:47.974746 9894 raft_consensus.cc:493] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:47.974858 9894 raft_consensus.cc:3060] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.975246 9121 ts_tablet_manager.cc:1929] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:47.975387 9121 log.cc:1199] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/4628e33d204c452ab12acf76f754f2ad
I20260505 20:13:47.975955 9121 ts_tablet_manager.cc:1950] T 4628e33d204c452ab12acf76f754f2ad P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:47.976320 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 141) took 12071 ms. Trace:
I20260505 20:13:47.976464 9121 rpcz_store.cc:276] 0505 20:13:35.904783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.905792 (+ 1009us) service_pool.cc:224] Handling call
0505 20:13:47.930289 (+12024497us) ts_tablet_manager.cc:1151] Deleting tablet 4628e33d204c452ab12acf76f754f2ad
0505 20:13:47.930302 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.958908 (+ 28606us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.975159 (+ 16251us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.976283 (+ 1124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4,"tablet-delete.queue_time_us":11937683}
I20260505 20:13:47.976975 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 4628e33d204c452ab12acf76f754f2ad (table default.Table_6de073da4783421daab1910cc27d67f7 [id=607b2027efa648778bfe22e03371919e]) successfully deleted
I20260505 20:13:47.977877 9894 raft_consensus.cc:515] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.978108 8058 tablet_bootstrap.cc:492] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:47.978272 8058 ts_tablet_manager.cc:1403] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.001s
I20260505 20:13:47.979553 9121 tablet_replica.cc:333] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:47.979775 9121 raft_consensus.cc:2243] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.979964 9121 raft_consensus.cc:2272] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.980578 9121 ts_tablet_manager.cc:1916] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.980795 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.981038 7931 raft_consensus.cc:3060] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.981374 9270 ts_tablet_manager.cc:1929] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:47.981491 9270 log.cc:1199] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/949fecb197084426b5a6adb959f5c886
I20260505 20:13:47.982020 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25cb36420534396a0850aef61706ae1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:47.982198 7661 raft_consensus.cc:3060] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.982642 8054 tablet_bootstrap.cc:492] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:47.982698 9270 ts_tablet_manager.cc:1950] T 949fecb197084426b5a6adb959f5c886 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:47.982792 8054 ts_tablet_manager.cc:1403] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.002s
I20260505 20:13:47.983553 8054 raft_consensus.cc:359] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.983753 8054 raft_consensus.cc:385] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.983831 8054 raft_consensus.cc:740] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.984031 8054 consensus_queue.cc:260] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:47.984169 9894 leader_election.cc:290] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:47.984038 7931 raft_consensus.cc:2468] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:47.984782 7737 leader_election.cc:304] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters:
I20260505 20:13:47.984855 8054 ts_tablet_manager.cc:1434] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:47.984763 7661 raft_consensus.cc:2468] T a25cb36420534396a0850aef61706ae1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:47.985132 8054 tablet_bootstrap.cc:492] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:47.986272 9894 raft_consensus.cc:2804] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:47.986490 9894 raft_consensus.cc:697] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:47.986733 9894 consensus_queue.cc:237] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.987576 8054 tablet_bootstrap.cc:654] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:47.987840 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:47.988348 9906 leader_election.cc:290] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:47.988449 7596 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:47.989156 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:47.988677 8058 raft_consensus.cc:359] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.991161 8058 raft_consensus.cc:385] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:47.991278 8058 raft_consensus.cc:740] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:47.991493 8058 consensus_queue.cc:260] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:47.991559 9906 consensus_queue.cc:1048] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:47.991990 8058 ts_tablet_manager.cc:1434] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260505 20:13:47.993009 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet bd01314146a34257b444a622829b2fe4 (table default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]) successfully deleted
I20260505 20:13:47.993993 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 126) took 10714 ms. Trace:
I20260505 20:13:47.994131 9270 rpcz_store.cc:276] 0505 20:13:37.279263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.279443 (+ 180us) service_pool.cc:224] Handling call
0505 20:13:47.913212 (+10633769us) ts_tablet_manager.cc:1151] Deleting tablet 949fecb197084426b5a6adb959f5c886
0505 20:13:47.913223 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:47.963216 (+ 49993us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.981298 (+ 18082us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:47.993945 (+ 12647us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10633628}
I20260505 20:13:47.994751 9270 tablet_replica.cc:333] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:47.995018 9270 raft_consensus.cc:2243] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:47.995226 9270 raft_consensus.cc:2272] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:47.993803 7931 raft_consensus.cc:3060] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:47.996013 9270 ts_tablet_manager.cc:1916] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:47.996749 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 949fecb197084426b5a6adb959f5c886 (table default.Table_5e2133ac533b4b6084978252a3244509 [id=db04ad55e6964d88bb71e0eab4cc4f65]) successfully deleted
I20260505 20:13:47.998497 8058 tablet_bootstrap.cc:492] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:48.001922 7598 consensus_peers.cc:597] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41fdaa9781ef4331bf3f0a7f8db4c1a0. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.002346 9495 consensus_queue.cc:1048] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.005537 7787 raft_consensus.cc:1275] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Refusing update from remote peer cab133462c2f46309dc8f0792122bad9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260505 20:13:48.006198 9758 consensus_queue.cc:1048] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260505 20:13:48.010782 8058 tablet_bootstrap.cc:654] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.016866 8053 tablet_bootstrap.cc:492] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.017045 8053 ts_tablet_manager.cc:1403] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.141s user 0.014s sys 0.040s
I20260505 20:13:48.017802 8053 raft_consensus.cc:359] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.018153 8053 raft_consensus.cc:385] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.018222 8053 raft_consensus.cc:740] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.018476 8053 consensus_queue.cc:260] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.018972 8053 ts_tablet_manager.cc:1434] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260505 20:13:48.020543 7598 consensus_peers.cc:597] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bde33085759f4fd8a130d80878d1e564. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.021152 9948 consensus_queue.cc:1048] T 5b3595eb9b1144d9b802f1f563d01461 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.023411 9121 ts_tablet_manager.cc:1929] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.023561 9121 log.cc:1199] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/4816f1ccb82e4641b2dcfe9ce9b55fae
I20260505 20:13:48.023957 9121 ts_tablet_manager.cc:1950] T 4816f1ccb82e4641b2dcfe9ce9b55fae P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.024186 9948 raft_consensus.cc:493] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.024323 9948 raft_consensus.cc:515] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.024364 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 143) took 12119 ms. Trace:
I20260505 20:13:48.024487 9121 rpcz_store.cc:276] 0505 20:13:35.904991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.905987 (+ 996us) service_pool.cc:224] Handling call
0505 20:13:47.979243 (+12073256us) ts_tablet_manager.cc:1151] Deleting tablet 4816f1ccb82e4641b2dcfe9ce9b55fae
0505 20:13:47.979251 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.000979 (+ 21728us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.023307 (+ 22328us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.024317 (+ 1010us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11986556}
I20260505 20:13:48.024852 9948 leader_election.cc:290] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.024983 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 4816f1ccb82e4641b2dcfe9ce9b55fae (table default.Table_6407eb94904a4c3db461964a5e97fe89 [id=131ffbf3ae28484d9a4f408397dbe11a]) successfully deleted
I20260505 20:13:48.025506 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.026332 7736 leader_election.cc:343] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.026480 8054 tablet_bootstrap.cc:492] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.026633 8054 ts_tablet_manager.cc:1403] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.004s
I20260505 20:13:48.026132 7710 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:48.027417 8054 raft_consensus.cc:359] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.027611 8054 raft_consensus.cc:385] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.027688 8054 raft_consensus.cc:740] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.027920 8054 consensus_queue.cc:260] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.028453 8054 ts_tablet_manager.cc:1434] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.028764 8054 tablet_bootstrap.cc:492] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.033926 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.034153 7921 raft_consensus.cc:2468] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:48.034883 7737 leader_election.cc:304] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.035317 8054 tablet_bootstrap.cc:654] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.035737 9944 raft_consensus.cc:2804] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.035831 9944 raft_consensus.cc:493] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.035907 9944 raft_consensus.cc:3060] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.036795 9121 tablet_replica.cc:333] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.037000 9121 raft_consensus.cc:2243] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.037178 9121 raft_consensus.cc:2272] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.037698 9121 ts_tablet_manager.cc:1916] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.002578 9271 tablet_replica.cc:333] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.038002 9271 raft_consensus.cc:2243] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.038349 8053 tablet_bootstrap.cc:492] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.038578 9944 raft_consensus.cc:515] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.039130 9944 leader_election.cc:290] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.040201 8053 tablet_bootstrap.cc:654] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.040971 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:48.041285 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9845d42fafa14457bd6c54d7477786aa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:48.041479 7921 raft_consensus.cc:3060] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.041766 9944 raft_consensus.cc:493] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:48.041908 9944 raft_consensus.cc:515] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.043186 9944 leader_election.cc:290] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.045037 7921 raft_consensus.cc:2468] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:48.045323 7736 leader_election.cc:343] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.045764 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.046578 9944 consensus_queue.cc:1048] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:48.047586 7596 consensus_peers.cc:597] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41fdaa9781ef4331bf3f0a7f8db4c1a0. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.049957 7737 leader_election.cc:304] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.050623 9944 raft_consensus.cc:2804] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.050861 9944 raft_consensus.cc:697] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:48.051177 9944 consensus_queue.cc:237] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.053516 8058 tablet_bootstrap.cc:492] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.053670 8058 ts_tablet_manager.cc:1403] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.055s user 0.006s sys 0.000s
I20260505 20:13:48.054672 8058 raft_consensus.cc:359] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.054857 8058 raft_consensus.cc:385] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.054926 8058 raft_consensus.cc:740] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.055186 8058 consensus_queue.cc:260] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.055411 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:48.055677 8058 ts_tablet_manager.cc:1434] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:48.057595 9271 raft_consensus.cc:2272] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.058732 9271 ts_tablet_manager.cc:1916] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.064723 8053 tablet_bootstrap.cc:492] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.064889 8053 ts_tablet_manager.cc:1403] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260505 20:13:48.065686 8053 raft_consensus.cc:359] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.065912 8053 raft_consensus.cc:385] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.065979 8053 raft_consensus.cc:740] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.066179 8053 consensus_queue.cc:260] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.066710 8053 ts_tablet_manager.cc:1434] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.067006 8053 tablet_bootstrap.cc:492] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.068423 8053 tablet_bootstrap.cc:654] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.072238 9270 ts_tablet_manager.cc:1929] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.072388 9270 log.cc:1199] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/1ed44127b4c848bf9ed4a49ad8b106fb
I20260505 20:13:48.072402 8054 tablet_bootstrap.cc:492] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.072574 8054 ts_tablet_manager.cc:1403] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.004s
I20260505 20:13:48.072789 9270 ts_tablet_manager.cc:1950] T 1ed44127b4c848bf9ed4a49ad8b106fb P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:48.073509 8054 raft_consensus.cc:359] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.073704 8054 raft_consensus.cc:385] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.073802 8054 raft_consensus.cc:740] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.074002 8054 consensus_queue.cc:260] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.074473 8054 ts_tablet_manager.cc:1434] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.074790 8054 tablet_bootstrap.cc:492] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.076435 8054 tablet_bootstrap.cc:654] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.045157 7931 raft_consensus.cc:2468] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.080662 9121 ts_tablet_manager.cc:1929] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.080825 9121 log.cc:1199] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/944eaa335fcf49be975baee21c715642
I20260505 20:13:48.080824 7598 leader_election.cc:304] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters: c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:48.081140 9758 raft_consensus.cc:2804] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.081171 9121 ts_tablet_manager.cc:1950] T 944eaa335fcf49be975baee21c715642 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.081410 9758 raft_consensus.cc:697] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:48.081727 9758 consensus_queue.cc:237] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:48.084393 7598 consensus_peers.cc:597] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e98c0e648c98488e8c5509b296824bea. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.090582 10091 raft_consensus.cc:493] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.090764 10091 raft_consensus.cc:515] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.091424 10091 leader_election.cc:290] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.098946 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 140) took 12194 ms. Trace:
I20260505 20:13:48.099113 9121 rpcz_store.cc:276] 0505 20:13:35.904593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.917955 (+ 13362us) service_pool.cc:224] Handling call
0505 20:13:48.036721 (+12118766us) ts_tablet_manager.cc:1151] Deleting tablet 944eaa335fcf49be975baee21c715642
0505 20:13:48.036731 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.055936 (+ 19205us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.080562 (+ 24626us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.098886 (+ 18324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12043981}
I20260505 20:13:48.099630 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 944eaa335fcf49be975baee21c715642 (table default.Table_1954f3a3b7034c16b51824755e5e357f [id=20fc114e5acb483c98a375c3eacc59e9]) successfully deleted
I20260505 20:13:48.100886 9121 tablet_replica.cc:333] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.110394 8058 tablet_bootstrap.cc:492] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:48.110306 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.110885 7870 leader_election.cc:343] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.110996 9121 raft_consensus.cc:2243] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.111447 9121 raft_consensus.cc:2272] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.112056 9121 ts_tablet_manager.cc:1916] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.112674 8058 tablet_bootstrap.cc:654] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.114573 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 127) took 10834 ms. Trace:
I20260505 20:13:48.114738 9270 rpcz_store.cc:276] 0505 20:13:37.280230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.280363 (+ 133us) service_pool.cc:224] Handling call
0505 20:13:47.994660 (+10714297us) ts_tablet_manager.cc:1151] Deleting tablet 1ed44127b4c848bf9ed4a49ad8b106fb
0505 20:13:47.994674 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.031323 (+ 36649us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.072154 (+ 40831us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.114532 (+ 42378us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10714143}
I20260505 20:13:48.115343 9270 tablet_replica.cc:333] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:48.115322 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 1ed44127b4c848bf9ed4a49ad8b106fb (table default.Table_c1015d9a8a7a49cba428a699afd14df2 [id=4137f9cb4fb646c4b7cd33fae3e93ebf]) successfully deleted
I20260505 20:13:48.115599 9270 raft_consensus.cc:2243] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.115959 9270 raft_consensus.cc:2272] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.116571 9270 ts_tablet_manager.cc:1916] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.126752 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.144490 8058 tablet_bootstrap.cc:492] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.144845 8058 ts_tablet_manager.cc:1403] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.001s
W20260505 20:13:48.152767 7737 leader_election.cc:343] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f2b2e40635b141c59d3789aca81efba7
I20260505 20:13:48.153090 7737 leader_election.cc:304] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.154381 9894 raft_consensus.cc:2749] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:48.155818 7737 consensus_peers.cc:597] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.162598 9121 ts_tablet_manager.cc:1929] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.162747 9121 log.cc:1199] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1ed44127b4c848bf9ed4a49ad8b106fb
I20260505 20:13:48.163127 9121 ts_tablet_manager.cc:1950] T 1ed44127b4c848bf9ed4a49ad8b106fb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.168258 8053 tablet_bootstrap.cc:492] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.168406 8053 ts_tablet_manager.cc:1403] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.010s
I20260505 20:13:48.169034 8053 raft_consensus.cc:359] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.169222 8053 raft_consensus.cc:385] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.169283 8053 raft_consensus.cc:740] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.169472 8053 consensus_queue.cc:260] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.170220 8054 tablet_bootstrap.cc:492] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.170387 8054 ts_tablet_manager.cc:1403] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.009s
I20260505 20:13:48.171057 8054 raft_consensus.cc:359] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.171255 8054 raft_consensus.cc:385] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.171362 8054 raft_consensus.cc:740] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.171602 8054 consensus_queue.cc:260] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.172199 8054 ts_tablet_manager.cc:1434] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.172528 8054 tablet_bootstrap.cc:492] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.173347 8053 ts_tablet_manager.cc:1434] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:48.173617 8053 tablet_bootstrap.cc:492] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:48.173722 7869 leader_election.cc:343] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.173880 7869 leader_election.cc:304] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.174301 10091 raft_consensus.cc:2749] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.174917 8053 tablet_bootstrap.cc:654] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.180191 8054 tablet_bootstrap.cc:654] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:48.181348 7736 consensus_peers.cc:597] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b393bfc209b6461aab958ebf49014d25. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.181861 8058 raft_consensus.cc:359] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.182407 8058 raft_consensus.cc:385] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.182773 9271 ts_tablet_manager.cc:1929] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.183670 8058 raft_consensus.cc:740] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.184233 9271 log.cc:1199] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/cdda1cc266cd47c993b5d1a0a78c7df9
I20260505 20:13:48.186712 8058 consensus_queue.cc:260] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.190095 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 144) took 12285 ms. Trace:
I20260505 20:13:48.190212 9121 rpcz_store.cc:276] 0505 20:13:35.905094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.966647 (+ 61553us) service_pool.cc:224] Handling call
0505 20:13:48.100786 (+12134139us) ts_tablet_manager.cc:1151] Deleting tablet 1ed44127b4c848bf9ed4a49ad8b106fb
0505 20:13:48.100802 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.139895 (+ 39093us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.162515 (+ 22620us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.190053 (+ 27538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9756,"tablet-delete.queue_time_us":12080834}
I20260505 20:13:48.190747 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1ed44127b4c848bf9ed4a49ad8b106fb (table default.Table_c1015d9a8a7a49cba428a699afd14df2 [id=4137f9cb4fb646c4b7cd33fae3e93ebf]) successfully deleted
I20260505 20:13:48.191097 9121 tablet_replica.cc:333] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.191323 9121 raft_consensus.cc:2243] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.191547 8058 ts_tablet_manager.cc:1434] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.046s user 0.002s sys 0.002s
I20260505 20:13:48.191653 9121 raft_consensus.cc:2272] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.192224 9121 ts_tablet_manager.cc:1916] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.193097 8053 tablet_bootstrap.cc:492] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.193231 8053 ts_tablet_manager.cc:1403] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260505 20:13:48.194097 9906 raft_consensus.cc:493] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:48.194303 9906 raft_consensus.cc:515] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.194001 9271 ts_tablet_manager.cc:1950] T cdda1cc266cd47c993b5d1a0a78c7df9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:48.195978 7598 leader_election.cc:343] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 98af33c2cdb24937858efdc7b638418f
I20260505 20:13:48.196238 9906 leader_election.cc:290] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.198731 10091 raft_consensus.cc:493] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.198127 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 122) took 10922 ms. Trace:
I20260505 20:13:48.198887 10091 raft_consensus.cc:515] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.199563 10091 leader_election.cc:290] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.201150 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b143e4943343d5b151f2804cccecfb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.199277 9271 rpcz_store.cc:276] 0505 20:13:37.275482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.275518 (+ 36us) service_pool.cc:224] Handling call
0505 20:13:47.996154 (+10720636us) ts_tablet_manager.cc:1151] Deleting tablet cdda1cc266cd47c993b5d1a0a78c7df9
0505 20:13:47.996170 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.084241 (+ 88071us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.156802 (+ 72561us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.197796 (+ 40994us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10719757}
I20260505 20:13:48.203897 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet cdda1cc266cd47c993b5d1a0a78c7df9 (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:48.204844 8053 raft_consensus.cc:359] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.205024 8053 raft_consensus.cc:385] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.205085 8053 raft_consensus.cc:740] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.205263 8053 consensus_queue.cc:260] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.205767 8053 ts_tablet_manager.cc:1434] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260505 20:13:48.206336 8053 tablet_bootstrap.cc:492] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.207787 8053 tablet_bootstrap.cc:654] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.209364 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 123) took 10933 ms. Trace:
I20260505 20:13:48.209487 9271 rpcz_store.cc:276] 0505 20:13:37.275820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.275856 (+ 36us) service_pool.cc:224] Handling call
0505 20:13:48.203885 (+10928029us) ts_tablet_manager.cc:1151] Deleting tablet f3b3c646af9843048382e77b138aea44
0505 20:13:48.205795 (+ 1910us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.209336 (+ 3541us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10927514}
I20260505 20:13:48.209919 9271 tablet_replica.cc:333] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.210170 9271 raft_consensus.cc:2243] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.210412 9271 raft_consensus.cc:2272] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.211087 9271 ts_tablet_manager.cc:1916] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:48.211359 7397 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f3b3c646af9843048382e77b138aea44 because the tablet was not found. No further retry: Not found: Tablet not found: f3b3c646af9843048382e77b138aea44
W20260505 20:13:48.214444 7870 leader_election.cc:343] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.215425 9944 raft_consensus.cc:493] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.215632 9944 raft_consensus.cc:515] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.216962 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.217206 7663 raft_consensus.cc:2468] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:48.217777 7736 leader_election.cc:304] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.218071 9894 raft_consensus.cc:2804] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.218140 9894 raft_consensus.cc:493] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.218199 9894 raft_consensus.cc:3060] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.220945 9894 raft_consensus.cc:515] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.221565 9894 leader_election.cc:290] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.223956 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:48.224172 7663 raft_consensus.cc:3060] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.227185 7663 raft_consensus.cc:2468] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:48.228459 10091 raft_consensus.cc:493] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.228629 10091 raft_consensus.cc:515] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.229353 10091 leader_election.cc:290] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.230227 9944 leader_election.cc:290] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.231982 7736 leader_election.cc:304] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.232750 9975 raft_consensus.cc:2804] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.232872 9975 raft_consensus.cc:697] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:48.233124 9975 consensus_queue.cc:237] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.234861 8054 tablet_bootstrap.cc:492] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.235025 8054 ts_tablet_manager.cc:1403] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.002s
I20260505 20:13:48.235239 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.235765 8054 raft_consensus.cc:359] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.235944 8054 raft_consensus.cc:385] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:48.235819 7870 leader_election.cc:343] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.236029 8054 raft_consensus.cc:740] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.239998 8054 consensus_queue.cc:260] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.242463 9758 consensus_queue.cc:1048] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.244571 8054 ts_tablet_manager.cc:1434] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260505 20:13:48.244910 8054 tablet_bootstrap.cc:492] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.246608 8054 tablet_bootstrap.cc:654] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.249397 8053 tablet_bootstrap.cc:492] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.249536 8053 ts_tablet_manager.cc:1403] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.008s
I20260505 20:13:48.250250 8053 raft_consensus.cc:359] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.250456 8053 raft_consensus.cc:385] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.250509 8053 raft_consensus.cc:740] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.250684 8053 consensus_queue.cc:260] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.251165 8053 ts_tablet_manager.cc:1434] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:48.251461 8053 tablet_bootstrap.cc:492] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.252862 8053 tablet_bootstrap.cc:654] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.253007 9975 raft_consensus.cc:493] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.253193 9975 raft_consensus.cc:515] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.254176 9975 leader_election.cc:290] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.254948 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ca8cc557674992b88f3379cc1db652" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.255216 7663 raft_consensus.cc:2468] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:48.255621 7736 leader_election.cc:304] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.255995 9894 raft_consensus.cc:2804] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.256071 9894 raft_consensus.cc:493] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.256132 9894 raft_consensus.cc:3060] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.257841 9758 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:48.257983 9758 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.258927 9758 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:48.261234 7598 leader_election.cc:343] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 20c24f9f26c84ba7b2ce85f9da4bccf8
I20260505 20:13:48.264776 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:48.270612 9894 raft_consensus.cc:515] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.271425 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:48.273450 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ca8cc557674992b88f3379cc1db652" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:48.273725 7663 raft_consensus.cc:3060] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.273435 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:48.275974 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:48.278021 9121 ts_tablet_manager.cc:1929] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:48.278182 9121 log.cc:1199] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/7766caea43904162a2c289b7b17405d4
I20260505 20:13:48.278645 9121 ts_tablet_manager.cc:1950] T 7766caea43904162a2c289b7b17405d4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.279510 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 146) took 12312 ms. Trace:
I20260505 20:13:48.279632 9121 rpcz_store.cc:276] 0505 20:13:35.967155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.967232 (+ 77us) service_pool.cc:224] Handling call
0505 20:13:48.191008 (+12223776us) ts_tablet_manager.cc:1151] Deleting tablet 7766caea43904162a2c289b7b17405d4
0505 20:13:48.191018 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.219901 (+ 28883us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.238851 (+ 18950us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.279470 (+ 40619us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12170985}
I20260505 20:13:48.280270 9121 tablet_replica.cc:333] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.280112 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]) successfully deleted
I20260505 20:13:48.280709 9121 raft_consensus.cc:2243] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.280879 9121 raft_consensus.cc:2272] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.280071 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:48.281330 10091 raft_consensus.cc:493] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.281423 9121 ts_tablet_manager.cc:1916] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.281507 10091 raft_consensus.cc:515] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.282249 10091 leader_election.cc:290] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.283032 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ec070a0196451c9564fa24b806516c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.283584 7870 leader_election.cc:343] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.282812 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:48.271375 9271 ts_tablet_manager.cc:1929] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.284798 9271 log.cc:1199] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/bcd289ce979940ae96554d5756d140d7
I20260505 20:13:48.285238 9271 ts_tablet_manager.cc:1950] T bcd289ce979940ae96554d5756d140d7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.285575 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 124) took 11009 ms. Trace:
I20260505 20:13:48.285666 9271 rpcz_store.cc:276] 0505 20:13:37.276090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.276129 (+ 39us) service_pool.cc:224] Handling call
0505 20:13:48.209855 (+10933726us) ts_tablet_manager.cc:1151] Deleting tablet bcd289ce979940ae96554d5756d140d7
0505 20:13:48.209869 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.247761 (+ 37892us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.271310 (+ 23549us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.285559 (+ 14249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10933588}
I20260505 20:13:48.286063 9271 tablet_replica.cc:333] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.286221 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet bcd289ce979940ae96554d5756d140d7 (table default.Table_471e002676d8465fb3a2af7b858cd2c0 [id=3fa488eaad8a4777bfb3ff65aa8b15f2]) successfully deleted
I20260505 20:13:48.286288 9271 raft_consensus.cc:2243] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.286623 9271 raft_consensus.cc:2272] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.287184 9271 ts_tablet_manager.cc:1916] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.288264 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1]). Expected version 1 got 0
I20260505 20:13:48.290369 8054 tablet_bootstrap.cc:492] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.290625 8054 ts_tablet_manager.cc:1403] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.003s
I20260505 20:13:48.292122 9758 raft_consensus.cc:493] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:48.292281 9758 raft_consensus.cc:515] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.292806 9758 leader_election.cc:290] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.293653 8054 raft_consensus.cc:359] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.295473 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:48.296159 9894 leader_election.cc:290] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.298906 7663 raft_consensus.cc:2468] T f0ca8cc557674992b88f3379cc1db652 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:48.299454 7736 leader_election.cc:304] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.299988 9894 raft_consensus.cc:2804] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.300155 9894 raft_consensus.cc:697] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:48.300436 9894 consensus_queue.cc:237] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.302172 8053 tablet_bootstrap.cc:492] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.302312 8053 ts_tablet_manager.cc:1403] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.001s
I20260505 20:13:48.303033 8053 raft_consensus.cc:359] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.303211 8053 raft_consensus.cc:385] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.303262 8053 raft_consensus.cc:740] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.303436 8053 consensus_queue.cc:260] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.303891 8053 ts_tablet_manager.cc:1434] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.304229 8053 tablet_bootstrap.cc:492] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.305840 8053 tablet_bootstrap.cc:654] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.306123 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_2add910ed16e4806844c4179947d54e2 [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 4 got 3
I20260505 20:13:48.306905 8054 raft_consensus.cc:385] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.307118 8054 raft_consensus.cc:740] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.307356 8054 consensus_queue.cc:260] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.308066 8054 ts_tablet_manager.cc:1434] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
W20260505 20:13:48.308328 7598 leader_election.cc:343] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f2b2e40635b141c59d3789aca81efba7
I20260505 20:13:48.308383 8054 tablet_bootstrap.cc:492] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.309013 9975 raft_consensus.cc:493] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.309186 9975 raft_consensus.cc:515] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.310213 8054 tablet_bootstrap.cc:654] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.310371 9975 leader_election.cc:290] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.310727 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.311831 9270 ts_tablet_manager.cc:1929] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.312016 9270 log.cc:1199] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/d2676078f47c4bc19391227d9643c15f
I20260505 20:13:48.313715 9270 ts_tablet_manager.cc:1950] T d2676078f47c4bc19391227d9643c15f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:48.315392 7983 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:48.315387 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b143e4943343d5b151f2804cccecfb" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.315757 9271 ts_tablet_manager.cc:1929] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.315864 9271 log.cc:1199] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:48.315970 10091 raft_consensus.cc:493] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.316118 10091 raft_consensus.cc:515] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.316213 9271 ts_tablet_manager.cc:1950] T a4a42f0b6dc74cbd8d72ae36410f9d35 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.316497 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 125) took 11040 ms. Trace:
I20260505 20:13:48.316715 10091 leader_election.cc:290] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:48.318504 8058 tablet_bootstrap.cc:492] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:48.320233 8058 tablet_bootstrap.cc:654] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.316587 9271 rpcz_store.cc:276] 0505 20:13:37.276377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.276417 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:48.286016 (+11009599us) ts_tablet_manager.cc:1151] Deleting tablet a4a42f0b6dc74cbd8d72ae36410f9d35
0505 20:13:48.286027 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.301551 (+ 15524us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.315694 (+ 14143us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.316480 (+ 786us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11009454}
I20260505 20:13:48.322543 9271 tablet_replica.cc:333] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.322690 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet a4a42f0b6dc74cbd8d72ae36410f9d35 (table default.Table_8b4013ec119f4c35aef190778e2fa5c6 [id=8ac7668d8df2475098e86492dd431fb2]) successfully deleted
I20260505 20:13:48.322803 9271 raft_consensus.cc:2243] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.325537 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663d16be712b40859aa92277eab0c4a2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.325803 7663 raft_consensus.cc:2468] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:48.326318 7870 leader_election.cc:304] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.326553 9619 raft_consensus.cc:493] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.326680 9619 raft_consensus.cc:515] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.327250 9619 leader_election.cc:290] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.327407 9619 raft_consensus.cc:2804] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.327482 9619 raft_consensus.cc:493] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.327576 9619 raft_consensus.cc:3060] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.330169 8054 tablet_bootstrap.cc:492] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.330286 8054 ts_tablet_manager.cc:1403] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.000s
I20260505 20:13:48.330709 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97a8c35af23454a9cf63193f763381e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.330860 8054 raft_consensus.cc:359] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.331003 8054 raft_consensus.cc:385] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.331043 8054 raft_consensus.cc:740] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.331218 8054 consensus_queue.cc:260] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.331488 9271 raft_consensus.cc:2272] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.331660 8054 ts_tablet_manager.cc:1434] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260505 20:13:48.331629 7870 leader_election.cc:343] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.331902 8054 tablet_bootstrap.cc:492] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.332077 9271 ts_tablet_manager.cc:1916] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.333029 9619 raft_consensus.cc:515] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.333487 8054 tablet_bootstrap.cc:654] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.334105 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663d16be712b40859aa92277eab0c4a2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:48.334267 7661 raft_consensus.cc:3060] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.337009 7661 raft_consensus.cc:2468] T 663d16be712b40859aa92277eab0c4a2 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:48.336508 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:48.337608 7870 leader_election.cc:304] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.338176 10031 raft_consensus.cc:493] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.338286 10031 raft_consensus.cc:515] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.338842 10031 leader_election.cc:290] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.338989 10031 raft_consensus.cc:2804] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.339087 10031 raft_consensus.cc:697] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:48.339320 10031 consensus_queue.cc:237] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.340628 9619 leader_election.cc:290] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:48.341770 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93512b85b764438aeb7bca9fe339442" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.342276 7870 leader_election.cc:343] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.343734 8053 tablet_bootstrap.cc:492] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.344234 8053 ts_tablet_manager.cc:1403] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.006s
I20260505 20:13:48.344633 9495 consensus_queue.cc:1048] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.344911 8053 raft_consensus.cc:359] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.345058 8053 raft_consensus.cc:385] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.345106 8053 raft_consensus.cc:740] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.345309 8053 consensus_queue.cc:260] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.345841 8053 ts_tablet_manager.cc:1434] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.346104 8053 tablet_bootstrap.cc:492] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.345391 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:48.347702 8053 tablet_bootstrap.cc:654] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.349869 8058 tablet_bootstrap.cc:492] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.350226 8058 ts_tablet_manager.cc:1403] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.009s
I20260505 20:13:48.350869 10031 raft_consensus.cc:493] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.351007 10031 raft_consensus.cc:515] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.351643 10031 leader_election.cc:290] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.351924 8058 raft_consensus.cc:359] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.352280 8058 raft_consensus.cc:385] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.352473 8058 raft_consensus.cc:740] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.352653 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0943621b2d14346ad79d1b7a74e4d47" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.353166 7870 leader_election.cc:343] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.353029 8058 consensus_queue.cc:260] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.358384 9271 ts_tablet_manager.cc:1929] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.358536 9271 log.cc:1199] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/54becbd4690c403e803a7a79f12cb6d5
I20260505 20:13:48.359906 8053 tablet_bootstrap.cc:492] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.360054 8053 ts_tablet_manager.cc:1403] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s
I20260505 20:13:48.360759 8053 raft_consensus.cc:359] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.360946 8053 raft_consensus.cc:385] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.361002 8053 raft_consensus.cc:740] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.361195 8053 consensus_queue.cc:260] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.361685 8053 ts_tablet_manager.cc:1434] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.362007 8053 tablet_bootstrap.cc:492] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.363372 10031 raft_consensus.cc:493] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.363502 10031 raft_consensus.cc:515] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.363873 8053 tablet_bootstrap.cc:654] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.364262 10031 leader_election.cc:290] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.365104 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.365337 7661 raft_consensus.cc:2393] T ab52fb4e7c73420fa58cb6da23372adc P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:48.365341 8054 tablet_bootstrap.cc:492] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.365455 8054 ts_tablet_manager.cc:1403] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.003s
I20260505 20:13:48.365607 9271 ts_tablet_manager.cc:1950] T 54becbd4690c403e803a7a79f12cb6d5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.366021 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 126) took 11089 ms. Trace:
I20260505 20:13:48.366169 9271 rpcz_store.cc:276] 0505 20:13:37.276756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.276800 (+ 44us) service_pool.cc:224] Handling call
0505 20:13:48.322486 (+11045686us) ts_tablet_manager.cc:1151] Deleting tablet 54becbd4690c403e803a7a79f12cb6d5
0505 20:13:48.322500 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.345390 (+ 22890us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.358132 (+ 12742us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.365997 (+ 7865us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11045547}
I20260505 20:13:48.366281 8054 raft_consensus.cc:359] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.366425 8054 raft_consensus.cc:385] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.366474 8054 raft_consensus.cc:740] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.366509 9271 tablet_replica.cc:333] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.366619 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.366700 9271 raft_consensus.cc:2243] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.366665 8054 consensus_queue.cc:260] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.366778 7921 raft_consensus.cc:2468] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:48.367022 9271 raft_consensus.cc:2272] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.367199 8054 ts_tablet_manager.cc:1434] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.367223 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 54becbd4690c403e803a7a79f12cb6d5 (table default.Table_98748ee269264963be11b33de38e1d1e [id=46cde0b7c30d4eae8254a080cb8caac8]) successfully deleted
I20260505 20:13:48.367452 8054 tablet_bootstrap.cc:492] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.367584 9271 ts_tablet_manager.cc:1916] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.368206 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:48.368359 7921 raft_consensus.cc:3060] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.368865 8054 tablet_bootstrap.cc:654] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.370957 7921 raft_consensus.cc:2468] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:48.371642 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:48.373582 8058 ts_tablet_manager.cc:1434] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.023s user 0.000s sys 0.003s
I20260505 20:13:48.373525 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:48.374498 8053 tablet_bootstrap.cc:492] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.374632 8053 ts_tablet_manager.cc:1403] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.002s
I20260505 20:13:48.375370 8053 raft_consensus.cc:359] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.375533 8053 raft_consensus.cc:385] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.375589 8053 raft_consensus.cc:740] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.375797 8053 consensus_queue.cc:260] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.375922 8058 tablet_bootstrap.cc:492] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:48.376235 8053 ts_tablet_manager.cc:1434] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.376499 8053 tablet_bootstrap.cc:492] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.378162 8053 tablet_bootstrap.cc:654] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.378559 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:48.380332 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:48.388257 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f34a3f1f30b4165a0c60fab482dce36" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:48.388926 7869 leader_election.cc:343] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.389048 7869 leader_election.cc:304] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.389433 10031 raft_consensus.cc:2749] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.391222 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67]). Expected version 1 got 0
I20260505 20:13:48.392838 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:48.394140 8058 tablet_bootstrap.cc:654] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.395270 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:48.396523 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:48.398494 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:48.399073 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 128) took 11118 ms. Trace:
I20260505 20:13:48.399224 9270 rpcz_store.cc:276] 0505 20:13:37.280813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.280987 (+ 174us) service_pool.cc:224] Handling call
0505 20:13:48.115273 (+10834286us) ts_tablet_manager.cc:1151] Deleting tablet d2676078f47c4bc19391227d9643c15f
0505 20:13:48.115284 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.120275 (+ 4991us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.311744 (+191469us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.399027 (+ 87283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10834155}
I20260505 20:13:48.399647 9271 ts_tablet_manager.cc:1929] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.399801 9271 log.cc:1199] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/2c12a95b0ed445c7b598db136f6ac05c
I20260505 20:13:48.399794 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet d2676078f47c4bc19391227d9643c15f (table default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]) successfully deleted
I20260505 20:13:48.400278 9271 ts_tablet_manager.cc:1950] T 2c12a95b0ed445c7b598db136f6ac05c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.400692 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 127) took 11123 ms. Trace:
I20260505 20:13:48.400802 9271 rpcz_store.cc:276] 0505 20:13:37.277116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.277156 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:48.366459 (+11089303us) ts_tablet_manager.cc:1151] Deleting tablet 2c12a95b0ed445c7b598db136f6ac05c
0505 20:13:48.366470 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.386482 (+ 20012us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.399566 (+ 13084us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.400670 (+ 1104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11089162}
I20260505 20:13:48.400887 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:48.401243 9271 tablet_replica.cc:333] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.401393 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 2c12a95b0ed445c7b598db136f6ac05c (table default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]) successfully deleted
I20260505 20:13:48.401505 9271 raft_consensus.cc:2243] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.402772 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:48.403859 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:48.406489 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:48.407549 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:48.411007 8053 tablet_bootstrap.cc:492] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.411159 8053 ts_tablet_manager.cc:1403] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.000s
I20260505 20:13:48.410589 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:48.411878 9121 ts_tablet_manager.cc:1929] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.412017 9121 log.cc:1199] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/8e650b297603425184ad97ddf99ec36d
I20260505 20:13:48.411993 8053 raft_consensus.cc:359] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.412204 8053 raft_consensus.cc:385] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.412282 8053 raft_consensus.cc:740] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.412426 9121 ts_tablet_manager.cc:1950] T 8e650b297603425184ad97ddf99ec36d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.412511 8053 consensus_queue.cc:260] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.412815 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 147) took 12445 ms. Trace:
I20260505 20:13:48.412372 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:48.412928 9121 rpcz_store.cc:276] 0505 20:13:35.967330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.967407 (+ 77us) service_pool.cc:224] Handling call
0505 20:13:48.280202 (+12312795us) ts_tablet_manager.cc:1151] Deleting tablet 8e650b297603425184ad97ddf99ec36d
0505 20:13:48.280211 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.391853 (+111642us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.411800 (+ 19947us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.412774 (+ 974us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12260141}
I20260505 20:13:48.413084 8053 ts_tablet_manager.cc:1434] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.413383 8053 tablet_bootstrap.cc:492] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.413421 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 8e650b297603425184ad97ddf99ec36d (table default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]) successfully deleted
I20260505 20:13:48.411164 9271 raft_consensus.cc:2272] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.415369 9271 ts_tablet_manager.cc:1916] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.416985 10031 raft_consensus.cc:493] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.417114 10031 raft_consensus.cc:515] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.417804 10031 leader_election.cc:290] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.418731 9121 tablet_replica.cc:333] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.418835 8058 tablet_bootstrap.cc:492] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.419044 9121 raft_consensus.cc:2243] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.419162 8058 ts_tablet_manager.cc:1403] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.004s
I20260505 20:13:48.419344 9121 pending_rounds.cc:70] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Trying to abort 1 pending ops.
I20260505 20:13:48.419413 9121 pending_rounds.cc:77] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737265458601984 op_type: NO_OP noop_request { }
I20260505 20:13:48.419543 9121 raft_consensus.cc:2889] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:48.419664 9121 raft_consensus.cc:2272] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.419672 9975 raft_consensus.cc:493] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.419832 9975 raft_consensus.cc:515] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.420964 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.420805 8058 raft_consensus.cc:359] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.421171 8058 raft_consensus.cc:385] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.421362 8058 raft_consensus.cc:740] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.421626 9975 leader_election.cc:290] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.421844 8058 consensus_queue.cc:260] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.422598 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1425e08c7c342e3bc05074645969b2c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.423240 7870 leader_election.cc:343] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.424816 8058 ts_tablet_manager.cc:1434] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260505 20:13:48.421648 8053 tablet_bootstrap.cc:654] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.426898 8058 tablet_bootstrap.cc:492] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:48.427908 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:48.430233 9121 ts_tablet_manager.cc:1916] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.433614 9906 consensus_queue.cc:1048] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.434585 8053 tablet_bootstrap.cc:492] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.434710 8053 ts_tablet_manager.cc:1403] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260505 20:13:48.431207 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:48.435385 8053 raft_consensus.cc:359] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.435539 8053 raft_consensus.cc:385] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.435593 8053 raft_consensus.cc:740] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.435788 8053 consensus_queue.cc:260] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.436048 9121 ts_tablet_manager.cc:1929] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.436136 9121 log.cc:1199] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/e32ff17c39f04bc2b1c9c37a1165399b
I20260505 20:13:48.436355 8053 ts_tablet_manager.cc:1434] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.436611 8053 tablet_bootstrap.cc:492] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.436339 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:48.443215 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:48.443676 9271 ts_tablet_manager.cc:1929] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.443794 9271 log.cc:1199] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/a0d4e198c91c4a0e99d8b798a1dd3433
I20260505 20:13:48.444378 8053 tablet_bootstrap.cc:654] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.444337 8058 tablet_bootstrap.cc:654] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.445814 10031 raft_consensus.cc:493] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.445955 10031 raft_consensus.cc:515] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.446547 10031 leader_election.cc:290] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.447296 10031 raft_consensus.cc:493] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.447409 10031 raft_consensus.cc:515] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.448100 10031 leader_election.cc:290] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.448719 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54b7c83e66c473db8470e5c4c4decab" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.448913 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3374a8f51d4c1a94dbd24d4a9da0af" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.449520 7870 leader_election.cc:343] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:48.449725 7870 leader_election.cc:343] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.451139 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:48.451830 8053 tablet_bootstrap.cc:492] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.451946 8053 ts_tablet_manager.cc:1403] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260505 20:13:48.452419 9758 raft_consensus.cc:493] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.452564 9758 raft_consensus.cc:515] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.453199 9758 leader_election.cc:290] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.454232 9271 ts_tablet_manager.cc:1950] T a0d4e198c91c4a0e99d8b798a1dd3433 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.454782 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.454552 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 128) took 11177 ms. Trace:
I20260505 20:13:48.454967 7931 raft_consensus.cc:2468] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.454916 9271 rpcz_store.cc:276] 0505 20:13:37.277452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.277574 (+ 122us) service_pool.cc:224] Handling call
0505 20:13:48.401182 (+11123608us) ts_tablet_manager.cc:1151] Deleting tablet a0d4e198c91c4a0e99d8b798a1dd3433
0505 20:13:48.401195 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.424255 (+ 23060us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.443607 (+ 19352us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.454537 (+ 10930us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11123481}
I20260505 20:13:48.455318 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 129) took 11177 ms. Trace:
I20260505 20:13:48.455410 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet a0d4e198c91c4a0e99d8b798a1dd3433 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]) successfully deleted
I20260505 20:13:48.455389 9271 rpcz_store.cc:276] 0505 20:13:37.277531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.277724 (+ 193us) service_pool.cc:224] Handling call
0505 20:13:48.455205 (+11177481us) ts_tablet_manager.cc:1151] Deleting tablet f4d78ebf153640e4b2f518fb215f1bf1
0505 20:13:48.455214 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.455303 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11177315}
I20260505 20:13:48.455662 9271 tablet_replica.cc:333] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
W20260505 20:13:48.455858 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet f4d78ebf153640e4b2f518fb215f1bf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4d78ebf153640e4b2f518fb215f1bf1 already in progress: creating tablet
I20260505 20:13:48.455947 9271 raft_consensus.cc:2243] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.456259 9271 raft_consensus.cc:2272] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.457796 7598 leader_election.cc:304] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.458016 9121 ts_tablet_manager.cc:1950] T e32ff17c39f04bc2b1c9c37a1165399b P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.458037 10029 raft_consensus.cc:2804] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.458129 10029 raft_consensus.cc:493] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.458209 10029 raft_consensus.cc:3060] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.458323 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 145) took 12491 ms. Trace:
I20260505 20:13:48.458406 9121 rpcz_store.cc:276] 0505 20:13:35.967036 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.967473 (+ 437us) service_pool.cc:224] Handling call
0505 20:13:48.418655 (+12451182us) ts_tablet_manager.cc:1151] Deleting tablet e32ff17c39f04bc2b1c9c37a1165399b
0505 20:13:48.418672 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.433174 (+ 14502us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.435998 (+ 2824us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.458306 (+ 22308us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12392077}
I20260505 20:13:48.458703 9121 tablet_replica.cc:333] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.458880 9121 raft_consensus.cc:2243] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.459013 9121 raft_consensus.cc:2272] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.459486 9121 ts_tablet_manager.cc:1916] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.460937 10029 raft_consensus.cc:515] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.461529 10029 leader_election.cc:290] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.462119 9948 raft_consensus.cc:493] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.462236 9948 raft_consensus.cc:515] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.462827 9948 leader_election.cc:290] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.463124 8053 raft_consensus.cc:359] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.463258 8053 raft_consensus.cc:385] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.463297 8053 raft_consensus.cc:740] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.463455 8053 consensus_queue.cc:260] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.463692 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet e32ff17c39f04bc2b1c9c37a1165399b (table default.Table_18b6a5de2149454d876ffde71ee2f43e [id=7c8b32a27dad4b07b76e53e77fbfa282]) successfully deleted
I20260505 20:13:48.463923 8053 ts_tablet_manager.cc:1434] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260505 20:13:48.464195 8053 tablet_bootstrap.cc:492] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.464363 9271 ts_tablet_manager.cc:1916] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.464758 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5cfc700aff4082ae089476e2af044f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.465240 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8e190c973c984ec080178efa39b2def0 (table default.Table_ba3b733a40ce48589c0b347147da20c5 [id=d52c9e2e31b34773959865aaa6f1833a]). Expected version 1 got 0
W20260505 20:13:48.465884 7736 leader_election.cc:343] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.466897 7404 catalog_manager.cc:5671] T b53f88d2e8b34b69bd12f53b046ed4de P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:48.468451 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:48.468631 7931 raft_consensus.cc:3060] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.468843 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:48.472509 7931 raft_consensus.cc:2468] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.473968 9944 raft_consensus.cc:493] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.474095 9944 raft_consensus.cc:515] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.474730 9944 leader_election.cc:290] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.475505 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.476187 7404 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:48.477083 7598 leader_election.cc:304] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.477367 9758 raft_consensus.cc:2804] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.477512 9758 raft_consensus.cc:697] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:48.477823 9758 consensus_queue.cc:237] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.478565 8053 tablet_bootstrap.cc:654] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.485245 9121 ts_tablet_manager.cc:1929] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.485381 9121 log.cc:1199] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1aaff49cb0ff4298be24603b2015c8a4
I20260505 20:13:48.489499 9271 ts_tablet_manager.cc:1929] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:48.489634 9271 log.cc:1199] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:48.490125 9271 ts_tablet_manager.cc:1950] T 4e91e29eb2e6462a975adcf9a379c421 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.490448 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 130) took 11212 ms. Trace:
I20260505 20:13:48.490533 9271 rpcz_store.cc:276] 0505 20:13:37.277995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278031 (+ 36us) service_pool.cc:224] Handling call
0505 20:13:48.455609 (+11177578us) ts_tablet_manager.cc:1151] Deleting tablet 4e91e29eb2e6462a975adcf9a379c421
0505 20:13:48.455620 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.473230 (+ 17610us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.489443 (+ 16213us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.490429 (+ 986us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11177451}
I20260505 20:13:48.490887 9271 tablet_replica.cc:333] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.491077 9271 raft_consensus.cc:2243] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.491091 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 4e91e29eb2e6462a975adcf9a379c421 (table default.Table_0f5f9bf433a14811882fb1e5a2f93aba [id=6cdd177b6b79450ea461ad6a2ae78aa4]) successfully deleted
W20260505 20:13:48.493690 7598 consensus_peers.cc:597] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e650b297603425184ad97ddf99ec36d. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.485721 9121 ts_tablet_manager.cc:1950] T 1aaff49cb0ff4298be24603b2015c8a4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.496351 8053 tablet_bootstrap.cc:492] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.496481 8053 ts_tablet_manager.cc:1403] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.003s
I20260505 20:13:48.497232 8053 raft_consensus.cc:359] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.497388 8053 raft_consensus.cc:385] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.497433 8053 raft_consensus.cc:740] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.497605 8053 consensus_queue.cc:260] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.498080 8053 ts_tablet_manager.cc:1434] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.498322 8053 tablet_bootstrap.cc:492] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.494196 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 148) took 12526 ms. Trace:
I20260505 20:13:48.501770 9121 rpcz_store.cc:276] 0505 20:13:35.967429 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:35.968566 (+ 1137us) service_pool.cc:224] Handling call
0505 20:13:48.458661 (+12490095us) ts_tablet_manager.cc:1151] Deleting tablet 1aaff49cb0ff4298be24603b2015c8a4
0505 20:13:48.458670 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.481923 (+ 23253us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.485183 (+ 3260us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.494175 (+ 8992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274,"tablet-delete.queue_time_us":12432100}
I20260505 20:13:48.502493 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1aaff49cb0ff4298be24603b2015c8a4 (table default.Table_d6c96dbb361b457684823113cd6727ea [id=5b2af32ce8704ee4b48ebeb114130d6b]) successfully deleted
I20260505 20:13:48.502962 9121 tablet_replica.cc:333] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.503170 9121 raft_consensus.cc:2243] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.503311 9121 raft_consensus.cc:2272] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.503729 10031 raft_consensus.cc:493] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.503789 9121 ts_tablet_manager.cc:1916] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.503895 10031 raft_consensus.cc:515] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.504631 10031 leader_election.cc:290] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.505657 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.506176 9271 pending_rounds.cc:70] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:48.506253 9271 pending_rounds.cc:77] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737231724908544 op_type: NO_OP noop_request { }
W20260505 20:13:48.506268 7870 leader_election.cc:343] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.506361 9271 raft_consensus.cc:2889] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:48.506490 9271 raft_consensus.cc:2272] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.507161 9271 ts_tablet_manager.cc:1916] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.515573 8053 tablet_bootstrap.cc:654] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.523061 9894 raft_consensus.cc:493] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.523278 9894 raft_consensus.cc:515] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.523554 9121 ts_tablet_manager.cc:1929] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.523680 9121 log.cc:1199] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/cb5cfc700aff4082ae089476e2af044f
I20260505 20:13:48.524258 9121 ts_tablet_manager.cc:1950] T cb5cfc700aff4082ae089476e2af044f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.525382 10031 raft_consensus.cc:493] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.525516 10031 raft_consensus.cc:515] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.526163 10031 leader_election.cc:290] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.527050 9270 tablet_replica.cc:333] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:48.527313 9270 raft_consensus.cc:2243] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.527539 9270 raft_consensus.cc:2272] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.528206 9270 ts_tablet_manager.cc:1916] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.524624 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 150) took 11287 ms. Trace:
I20260505 20:13:48.534046 9121 rpcz_store.cc:276] 0505 20:13:37.237240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.237990 (+ 750us) service_pool.cc:224] Handling call
0505 20:13:48.502887 (+11264897us) ts_tablet_manager.cc:1151] Deleting tablet cb5cfc700aff4082ae089476e2af044f
0505 20:13:48.502904 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.515926 (+ 13022us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.523490 (+ 7564us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.524609 (+ 1119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11264522}
I20260505 20:13:48.534538 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet cb5cfc700aff4082ae089476e2af044f (table default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3]) successfully deleted
I20260505 20:13:48.537704 10031 raft_consensus.cc:493] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.537873 10031 raft_consensus.cc:515] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.538810 10031 leader_election.cc:290] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:48.539300 7398 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8da300a3c6a743829936ecbfcd9439b5 consensus state has no leader
I20260505 20:13:48.540035 9121 tablet_replica.cc:333] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.540316 9121 raft_consensus.cc:2243] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.540508 9121 raft_consensus.cc:2272] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.541141 9121 ts_tablet_manager.cc:1916] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.568089 9121 ts_tablet_manager.cc:1929] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.568212 9121 log.cc:1199] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ae8bd19470294a1db91855afe49be6a5
I20260505 20:13:48.568481 9121 ts_tablet_manager.cc:1950] T ae8bd19470294a1db91855afe49be6a5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.574744 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 151) took 11329 ms. Trace:
I20260505 20:13:48.574873 9121 rpcz_store.cc:276] 0505 20:13:37.245586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.246217 (+ 631us) service_pool.cc:224] Handling call
0505 20:13:48.539962 (+11293745us) ts_tablet_manager.cc:1151] Deleting tablet ae8bd19470294a1db91855afe49be6a5
0505 20:13:48.539979 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.551367 (+ 11388us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.568025 (+ 16658us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.574723 (+ 6698us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11293534}
I20260505 20:13:48.575438 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]) successfully deleted
I20260505 20:13:48.523610 8053 tablet_bootstrap.cc:492] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.533838 9271 ts_tablet_manager.cc:1929] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.575824 9271 log.cc:1199] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/0ec5c094e2bb4a4481825df17becde52
I20260505 20:13:48.575856 8053 ts_tablet_manager.cc:1403] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.001s
I20260505 20:13:48.576323 9271 ts_tablet_manager.cc:1950] T 0ec5c094e2bb4a4481825df17becde52 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.576655 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 131) took 11298 ms. Trace:
I20260505 20:13:48.576730 9271 rpcz_store.cc:276] 0505 20:13:37.278292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278335 (+ 43us) service_pool.cc:224] Handling call
0505 20:13:48.490840 (+11212505us) ts_tablet_manager.cc:1151] Deleting tablet 0ec5c094e2bb4a4481825df17becde52
0505 20:13:48.490849 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.510422 (+ 19573us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.513704 (+ 3282us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.576632 (+ 62928us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14904,"tablet-delete.queue_time_us":11212364}
I20260505 20:13:48.576853 8053 raft_consensus.cc:359] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.577032 8053 raft_consensus.cc:385] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.577087 8053 raft_consensus.cc:740] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.577132 9271 tablet_replica.cc:333] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.577349 9271 raft_consensus.cc:2243] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.577302 8053 consensus_queue.cc:260] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.577507 9271 raft_consensus.cc:2272] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.577860 8053 ts_tablet_manager.cc:1434] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:48.578176 9271 ts_tablet_manager.cc:1916] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.578485 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 0ec5c094e2bb4a4481825df17becde52 (table default.Table_fc6387e9fab644e7a4d3a7bf30e9cd71 [id=467d9ffe912a4ef29ee93138ef0a5d9d]) successfully deleted
I20260505 20:13:48.579636 9894 leader_election.cc:290] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.578174 8053 tablet_bootstrap.cc:492] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.581709 8053 tablet_bootstrap.cc:654] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.586522 8053 tablet_bootstrap.cc:492] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.586652 8053 ts_tablet_manager.cc:1403] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260505 20:13:48.587415 8053 raft_consensus.cc:359] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.587592 8053 raft_consensus.cc:385] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.587639 8053 raft_consensus.cc:740] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.587805 8053 consensus_queue.cc:260] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.588236 8053 ts_tablet_manager.cc:1434] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:48.588485 8053 tablet_bootstrap.cc:492] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.589926 8053 tablet_bootstrap.cc:654] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.592433 9121 tablet_replica.cc:333] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.592653 9121 raft_consensus.cc:2243] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.592832 9121 raft_consensus.cc:2272] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.593498 9121 ts_tablet_manager.cc:1916] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.601213 8053 tablet_bootstrap.cc:492] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.601375 8053 ts_tablet_manager.cc:1403] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.002s
I20260505 20:13:48.602344 8053 raft_consensus.cc:359] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.602530 8053 raft_consensus.cc:385] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.602582 8053 raft_consensus.cc:740] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.602917 8053 consensus_queue.cc:260] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.607337 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.539335 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1315273f76db4405bb2c82a8164bc325" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.567163 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc695d3e3f941bbbe0d208c9f3572ee" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.580684 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 51491.5us
I20260505 20:13:48.610438 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.610612 7787 raft_consensus.cc:2468] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.610684 10167 raft_consensus.cc:493] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.610985 10167 raft_consensus.cc:515] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.613983 8053 ts_tablet_manager.cc:1434] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260505 20:13:48.613979 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.614265 7663 raft_consensus.cc:2393] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:48.614281 8053 tablet_bootstrap.cc:492] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.615299 10167 leader_election.cc:290] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.615648 8053 tablet_bootstrap.cc:654] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.615882 10159 tablet.cc:1724] T f2b0dd5d7870453bb1b771405daeb22f P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:48.617543 9975 raft_consensus.cc:493] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.617710 9975 raft_consensus.cc:515] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.619053 9975 leader_election.cc:290] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.619156 9121 ts_tablet_manager.cc:1929] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.619262 9121 log.cc:1199] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/296494f478244052971e12a09f0b15b4
I20260505 20:13:48.619536 9121 ts_tablet_manager.cc:1950] T 296494f478244052971e12a09f0b15b4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.621505 8053 tablet_bootstrap.cc:492] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.621634 8053 ts_tablet_manager.cc:1403] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:48.622284 8053 raft_consensus.cc:359] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.622417 8053 raft_consensus.cc:385] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.622457 8053 raft_consensus.cc:740] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.622624 8053 consensus_queue.cc:260] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.623039 8053 ts_tablet_manager.cc:1434] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260505 20:13:48.623265 8053 tablet_bootstrap.cc:492] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.625890 10031 raft_consensus.cc:493] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.626022 10031 raft_consensus.cc:515] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.627003 10031 leader_election.cc:290] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.627964 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 155) took 11359 ms. Trace:
I20260505 20:13:48.628063 9121 rpcz_store.cc:276] 0505 20:13:37.268000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.268186 (+ 186us) service_pool.cc:224] Handling call
0505 20:13:48.592368 (+11324182us) ts_tablet_manager.cc:1151] Deleting tablet 296494f478244052971e12a09f0b15b4
0505 20:13:48.592380 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.597592 (+ 5212us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.619101 (+ 21509us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.627944 (+ 8843us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11323970}
I20260505 20:13:48.628381 9121 tablet_replica.cc:333] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.628556 9121 raft_consensus.cc:2243] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.628574 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 296494f478244052971e12a09f0b15b4 (table default.Table_3f1f3578e45142bd8308041182d62265 [id=629d3a81e86945f48e462550aa1b1fee]) successfully deleted
I20260505 20:13:48.628684 9121 raft_consensus.cc:2272] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.629164 9121 ts_tablet_manager.cc:1916] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.630100 7787 raft_consensus.cc:3060] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:48.632939 7870 leader_election.cc:343] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:48.633263 7870 leader_election.cc:343] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.640151 7787 raft_consensus.cc:3060] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.640214 9270 ts_tablet_manager.cc:1929] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.641119 9271 ts_tablet_manager.cc:1929] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.641227 9271 log.cc:1199] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/84fb3dcea55d4b348cbf92c3c4581dda
I20260505 20:13:48.641563 9271 ts_tablet_manager.cc:1950] T 84fb3dcea55d4b348cbf92c3c4581dda P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.642545 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 132) took 11364 ms. Trace:
I20260505 20:13:48.642668 9271 rpcz_store.cc:276] 0505 20:13:37.278591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278629 (+ 38us) service_pool.cc:224] Handling call
0505 20:13:48.577086 (+11298457us) ts_tablet_manager.cc:1151] Deleting tablet 84fb3dcea55d4b348cbf92c3c4581dda
0505 20:13:48.577096 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.631260 (+ 54164us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.641069 (+ 9809us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.642518 (+ 1449us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11298314}
I20260505 20:13:48.643050 9271 tablet_replica.cc:333] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.643232 9271 raft_consensus.cc:2243] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.643251 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 84fb3dcea55d4b348cbf92c3c4581dda (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
I20260505 20:13:48.643532 9271 raft_consensus.cc:2272] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.644068 9271 ts_tablet_manager.cc:1916] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.646423 8053 tablet_bootstrap.cc:654] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.654737 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.654942 7785 raft_consensus.cc:2468] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.656103 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b7c02a4bd84e788d9fc92781c161a1" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:48.656236 7785 raft_consensus.cc:3060] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.656585 9121 ts_tablet_manager.cc:1929] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.656728 9121 log.cc:1199] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/faf3775c154742c5804daf8ade2ad854
I20260505 20:13:48.657059 9121 ts_tablet_manager.cc:1950] T faf3775c154742c5804daf8ade2ad854 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.658731 7785 raft_consensus.cc:2468] T 22b7c02a4bd84e788d9fc92781c161a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.660832 9271 ts_tablet_manager.cc:1929] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.661430 10161 tablet.cc:1724] T f2b0dd5d7870453bb1b771405daeb22f P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:48.665436 8054 tablet_bootstrap.cc:492] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:48.665640 8054 ts_tablet_manager.cc:1403] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.298s user 0.026s sys 0.030s
I20260505 20:13:48.665899 10031 consensus_queue.cc:1048] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.667454 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 156) took 11271 ms. Trace:
I20260505 20:13:48.667546 9121 rpcz_store.cc:276] 0505 20:13:37.396030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.396091 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:48.628336 (+11232245us) ts_tablet_manager.cc:1151] Deleting tablet faf3775c154742c5804daf8ade2ad854
0505 20:13:48.628346 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.640124 (+ 11778us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.656528 (+ 16404us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.667434 (+ 10906us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11231478}
I20260505 20:13:48.666922 8054 raft_consensus.cc:359] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.668798 8054 raft_consensus.cc:385] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.661715 8053 tablet_bootstrap.cc:492] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.671586 8053 ts_tablet_manager.cc:1403] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.003s
I20260505 20:13:48.672777 8053 raft_consensus.cc:359] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.672995 8053 raft_consensus.cc:385] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.673077 8053 raft_consensus.cc:740] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.673300 8053 consensus_queue.cc:260] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.669217 8054 raft_consensus.cc:740] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.673836 8053 ts_tablet_manager.cc:1434] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.674096 8053 tablet_bootstrap.cc:492] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.675392 8053 tablet_bootstrap.cc:654] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.676081 9271 log.cc:1199] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:48.674940 8054 consensus_queue.cc:260] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.677562 9271 ts_tablet_manager.cc:1950] T 2540ed5144664ec0bfe0b548a5386176 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.678385 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 133) took 11399 ms. Trace:
I20260505 20:13:48.681839 9271 rpcz_store.cc:276] 0505 20:13:37.278868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.278904 (+ 36us) service_pool.cc:224] Handling call
0505 20:13:48.643004 (+11364100us) ts_tablet_manager.cc:1151] Deleting tablet 2540ed5144664ec0bfe0b548a5386176
0505 20:13:48.643014 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.653241 (+ 10227us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.660769 (+ 7528us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.678365 (+ 17596us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11363959}
I20260505 20:13:48.682351 9271 tablet_replica.cc:333] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.682525 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.682804 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 2540ed5144664ec0bfe0b548a5386176 (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]) successfully deleted
I20260505 20:13:48.683063 7787 raft_consensus.cc:2468] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.683451 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 157) took 11285 ms. Trace:
I20260505 20:13:48.683665 9121 rpcz_store.cc:276] 0505 20:13:37.397589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.397637 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:48.683327 (+11285690us) ts_tablet_manager.cc:1151] Deleting tablet 506b421a774c4929813205dba0fac32b
0505 20:13:48.683340 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.683429 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11285460}
I20260505 20:13:48.684590 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 159) took 11284 ms. Trace:
I20260505 20:13:48.684208 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet faf3775c154742c5804daf8ade2ad854 (table default.Table_8595c29834684cbd83e7b51b31b8b82b [id=ebd38b39f1d2484ca108560964693461]) successfully deleted
I20260505 20:13:48.686733 9121 rpcz_store.cc:276] 0505 20:13:37.399909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.399953 (+ 44us) service_pool.cc:224] Handling call
0505 20:13:48.684486 (+11284533us) ts_tablet_manager.cc:1151] Deleting tablet 0112c04befa14c48bb5b2e7dfb60dac7
0505 20:13:48.684498 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.684571 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11284323}
W20260505 20:13:48.687186 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 506b421a774c4929813205dba0fac32b because the tablet was not found. No further retry: Not found: Tablet not found: 506b421a774c4929813205dba0fac32b
I20260505 20:13:48.687885 9121 tablet_replica.cc:333] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.688161 9121 raft_consensus.cc:2243] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.688410 9121 raft_consensus.cc:2272] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:48.690126 7399 catalog_manager.cc:4969] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): delete failed for tablet 0112c04befa14c48bb5b2e7dfb60dac7 because the tablet was not found. No further retry: Not found: Tablet not found: 0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:48.693210 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6d6129d75048948ff739eae5f3c0da (DEFAULT_TABLE table=default.Table_67ab8a39b85d4eadb14979ca489af75d [id=9dc82041815542f1859681693725c985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:48.693805 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6d6129d75048948ff739eae5f3c0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:48.698045 9121 ts_tablet_manager.cc:1916] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.702529 9894 raft_consensus.cc:493] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.702688 9894 raft_consensus.cc:515] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.703519 9894 leader_election.cc:290] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.704591 9271 raft_consensus.cc:2243] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.705196 9271 raft_consensus.cc:2272] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.705937 10031 raft_consensus.cc:493] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.706091 10031 raft_consensus.cc:515] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.706149 10185 tablet.cc:1724] T f2b0dd5d7870453bb1b771405daeb22f P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:48.706732 10031 leader_election.cc:290] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.710261 9271 ts_tablet_manager.cc:1916] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:48.709666 7737 consensus_peers.cc:597] T ee19f65120184eca9495513b68440b4f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee19f65120184eca9495513b68440b4f. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.717934 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6d6129d75048948ff739eae5f3c0da (DEFAULT_TABLE table=default.Table_67ab8a39b85d4eadb14979ca489af75d [id=9dc82041815542f1859681693725c985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:48.718362 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6d6129d75048948ff739eae5f3c0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:48.718647 9975 raft_consensus.cc:493] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.718892 9975 raft_consensus.cc:515] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.719766 9975 leader_election.cc:290] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:48.721457 7737 consensus_peers.cc:597] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c720fc66db36402a83a7690d70a40353. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:48.721864 7737 leader_election.cc:343] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f0ca8cc557674992b88f3379cc1db652
W20260505 20:13:48.724814 7737 leader_election.cc:343] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f0ca8cc557674992b88f3379cc1db652
I20260505 20:13:48.728453 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 707be9cf940d42beb0800958c130c848 (DEFAULT_TABLE table=default.Table_041ad38b90294db79ee22d0605448fef [id=8481511c8fcc4d5085161adab6899d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:48.728866 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707be9cf940d42beb0800958c130c848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:48.729367 9121 ts_tablet_manager.cc:1929] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.730026 9121 log.cc:1199] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/624398f68961440f8369a7859b0724c4
I20260505 20:13:48.727166 7737 leader_election.cc:304] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.732893 9121 ts_tablet_manager.cc:1950] T 624398f68961440f8369a7859b0724c4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.733347 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 160) took 11332 ms. Trace:
I20260505 20:13:48.733510 9121 rpcz_store.cc:276] 0505 20:13:37.400978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.401026 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:48.687836 (+11286810us) ts_tablet_manager.cc:1151] Deleting tablet 624398f68961440f8369a7859b0724c4
0505 20:13:48.687846 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.703523 (+ 15677us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.729313 (+ 25790us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.733328 (+ 4015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11286604}
I20260505 20:13:48.734017 9121 tablet_replica.cc:333] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.734151 9894 raft_consensus.cc:2749] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.730113 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 707be9cf940d42beb0800958c130c848 (DEFAULT_TABLE table=default.Table_041ad38b90294db79ee22d0605448fef [id=8481511c8fcc4d5085161adab6899d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:48.734745 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707be9cf940d42beb0800958c130c848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:48.734925 8053 tablet_bootstrap.cc:492] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.735064 8053 ts_tablet_manager.cc:1403] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.001s
I20260505 20:13:48.735764 8053 raft_consensus.cc:359] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.735929 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.736997 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ec070a0196451c9564fa24b806516c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.735929 8053 raft_consensus.cc:385] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.737512 8053 raft_consensus.cc:740] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.737717 8053 consensus_queue.cc:260] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.737907 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663d16be712b40859aa92277eab0c4a2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.738068 7785 raft_consensus.cc:2468] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:48.738222 8053 ts_tablet_manager.cc:1434] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:48.738464 8053 tablet_bootstrap.cc:492] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.738858 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97a8c35af23454a9cf63193f763381e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.739719 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663d16be712b40859aa92277eab0c4a2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:48.739797 8053 tablet_bootstrap.cc:654] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.739859 7785 raft_consensus.cc:3060] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.740042 9121 raft_consensus.cc:2243] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:48.742429 7785 raft_consensus.cc:2468] T 663d16be712b40859aa92277eab0c4a2 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:48.749177 8054 ts_tablet_manager.cc:1434] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
I20260505 20:13:48.749949 8054 tablet_bootstrap.cc:492] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:48.748299 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93512b85b764438aeb7bca9fe339442" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.756573 9121 raft_consensus.cc:2272] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:48.662386 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 49823.7us
I20260505 20:13:48.662755 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.757782 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0943621b2d14346ad79d1b7a74e4d47" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.759899 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.761145 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.761372 7654 raft_consensus.cc:2393] T 1d417bb8f3ac4343807e9ff4971eb2ad P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:48.761914 7654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede080523cb1482d8a531f4044164475" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.763458 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab52fb4e7c73420fa58cb6da23372adc" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.764396 9121 ts_tablet_manager.cc:1916] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.664549 9704 raft_consensus.cc:493] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.764580 9704 raft_consensus.cc:515] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.764968 7660 raft_consensus.cc:2468] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:48.765132 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1425e08c7c342e3bc05074645969b2c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.766000 9704 leader_election.cc:290] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.766891 9975 raft_consensus.cc:493] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.767027 9975 raft_consensus.cc:515] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.767781 9975 leader_election.cc:290] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.664738 9495 raft_consensus.cc:493] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.667172 8058 tablet_bootstrap.cc:492] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.768158 8058 ts_tablet_manager.cc:1403] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.342s user 0.014s sys 0.009s
I20260505 20:13:48.768085 9495 raft_consensus.cc:515] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.768615 9495 leader_election.cc:290] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.769032 8058 raft_consensus.cc:359] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.769192 8058 raft_consensus.cc:385] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.769263 8058 raft_consensus.cc:740] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.769459 8058 consensus_queue.cc:260] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.769984 8058 ts_tablet_manager.cc:1434] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:48.770272 8058 tablet_bootstrap.cc:492] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:48.771927 8058 tablet_bootstrap.cc:654] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.702378 10167 raft_consensus.cc:493] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.772851 10167 raft_consensus.cc:515] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.773008 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.773159 7926 raft_consensus.cc:2468] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.773365 10167 leader_election.cc:290] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.715062 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.717528 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6d6129d75048948ff739eae5f3c0da (DEFAULT_TABLE table=default.Table_67ab8a39b85d4eadb14979ca489af75d [id=9dc82041815542f1859681693725c985]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:48.773579 7661 raft_consensus.cc:2468] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:48.728049 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 707be9cf940d42beb0800958c130c848 (DEFAULT_TABLE table=default.Table_041ad38b90294db79ee22d0605448fef [id=8481511c8fcc4d5085161adab6899d93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:48.773953 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6d6129d75048948ff739eae5f3c0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:48.774214 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707be9cf940d42beb0800958c130c848. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:48.775056 7870 leader_election.cc:343] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.775815 7870 leader_election.cc:304] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.776063 10031 raft_consensus.cc:2804] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.776124 10031 raft_consensus.cc:493] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.776185 10031 raft_consensus.cc:3060] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.778800 10031 raft_consensus.cc:515] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.779704 10031 leader_election.cc:290] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.782562 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:48.782732 7661 raft_consensus.cc:3060] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.784504 7598 leader_election.cc:304] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.785475 10167 raft_consensus.cc:2804] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.785557 10167 raft_consensus.cc:493] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.785576 7661 raft_consensus.cc:2468] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:48.785619 10167 raft_consensus.cc:3060] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.787145 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3374a8f51d4c1a94dbd24d4a9da0af" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.788527 10167 raft_consensus.cc:515] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.789399 10167 leader_election.cc:290] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.789951 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54b7c83e66c473db8470e5c4c4decab" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.790537 7870 leader_election.cc:304] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.748507 9271 ts_tablet_manager.cc:1929] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:48.751966 8053 tablet_bootstrap.cc:492] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.791924 8053 ts_tablet_manager.cc:1403] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260505 20:13:48.792011 10031 raft_consensus.cc:2804] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.792284 10031 raft_consensus.cc:697] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:48.792644 10031 consensus_queue.cc:237] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.792601 8053 raft_consensus.cc:359] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.793119 8053 raft_consensus.cc:385] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.793181 8053 raft_consensus.cc:740] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.793378 8053 consensus_queue.cc:260] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.793983 8053 ts_tablet_manager.cc:1434] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:48.794273 8053 tablet_bootstrap.cc:492] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.797150 9121 ts_tablet_manager.cc:1929] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.797345 9121 log.cc:1199] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1f27847d940e46778ad10a2f4cf40d27
I20260505 20:13:48.797940 9121 ts_tablet_manager.cc:1950] T 1f27847d940e46778ad10a2f4cf40d27 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.799378 8053 tablet_bootstrap.cc:654] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:48.799640 7736 leader_election.cc:343] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.800072 7736 leader_election.cc:304] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.800395 9894 raft_consensus.cc:2804] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.800479 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 161) took 11370 ms. Trace:
I20260505 20:13:48.800509 9894 raft_consensus.cc:493] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.800599 9894 raft_consensus.cc:3060] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.800699 9121 rpcz_store.cc:276] 0505 20:13:37.429758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.430078 (+ 320us) service_pool.cc:224] Handling call
0505 20:13:48.733960 (+11303882us) ts_tablet_manager.cc:1151] Deleting tablet 1f27847d940e46778ad10a2f4cf40d27
0505 20:13:48.733970 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.767513 (+ 33543us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.797068 (+ 29555us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.800463 (+ 3395us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11303643}
I20260505 20:13:48.803324 9894 raft_consensus.cc:515] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.803563 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1f27847d940e46778ad10a2f4cf40d27 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]) successfully deleted
I20260505 20:13:48.804212 9894 leader_election.cc:290] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.792455 9271 log.cc:1199] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e98c0e648c98488e8c5509b296824bea
I20260505 20:13:48.806541 9429 consensus_queue.cc:1048] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.808414 9121 tablet_replica.cc:333] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.808657 9121 raft_consensus.cc:2243] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.814713 9121 raft_consensus.cc:2272] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.815524 9121 ts_tablet_manager.cc:1916] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.815418 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.816247 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3535f0c31ad5451ea5bceeb50f756eef" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.816493 7921 raft_consensus.cc:2468] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.816483 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc695d3e3f941bbbe0d208c9f3572ee" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.816844 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.819371 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:48.819576 7926 raft_consensus.cc:3060] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.819588 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1315273f76db4405bb2c82a8164bc325" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.821089 9271 ts_tablet_manager.cc:1950] T e98c0e648c98488e8c5509b296824bea P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.822224 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.822409 7787 raft_consensus.cc:2468] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:48.822616 7926 raft_consensus.cc:2468] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.792846 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.826709 9429 raft_consensus.cc:493] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.826840 9429 raft_consensus.cc:515] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.827515 9429 leader_election.cc:290] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.827859 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.828189 7785 raft_consensus.cc:2393] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:48.828337 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.829192 7870 leader_election.cc:343] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.830235 9270 log.cc:1199] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/98af33c2cdb24937858efdc7b638418f
I20260505 20:13:48.830730 9270 ts_tablet_manager.cc:1950] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:48.831108 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:48.831141 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 129) took 11549 ms. Trace:
I20260505 20:13:48.831214 9270 rpcz_store.cc:276] 0505 20:13:37.281231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.281384 (+ 153us) service_pool.cc:224] Handling call
0505 20:13:48.508579 (+11227195us) ts_tablet_manager.cc:1151] Deleting tablet 98af33c2cdb24937858efdc7b638418f
0505 20:13:48.526939 (+ 18360us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.637362 (+110423us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.640141 (+ 2779us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.831124 (+190983us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11118323}
I20260505 20:13:48.831360 7785 raft_consensus.cc:2393] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:48.831800 9270 tablet_replica.cc:333] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:48.831737 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 98af33c2cdb24937858efdc7b638418f (table default.Table_7aa09788a9b54cab8303f80b2237ee4e [id=e8647104c97e4b258208aedab9f5f35d]) successfully deleted
I20260505 20:13:48.832067 9270 raft_consensus.cc:2243] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.832314 9270 raft_consensus.cc:2272] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.836881 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.837159 7785 raft_consensus.cc:2468] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:48.839097 7736 leader_election.cc:343] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.844405 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 134) took 11565 ms. Trace:
I20260505 20:13:48.849570 9121 ts_tablet_manager.cc:1929] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.849682 9121 log.cc:1199] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/91496ff1e14e4cfdbaadb34d25ad8b68
I20260505 20:13:48.850019 9121 ts_tablet_manager.cc:1950] T 91496ff1e14e4cfdbaadb34d25ad8b68 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.851253 8053 tablet_bootstrap.cc:492] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.846896 9271 rpcz_store.cc:276] 0505 20:13:37.279208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.279248 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:48.682297 (+11403049us) ts_tablet_manager.cc:1151] Deleting tablet e98c0e648c98488e8c5509b296824bea
0505 20:13:48.682308 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.720780 (+ 38472us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.748453 (+ 27673us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.844381 (+ 95928us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11402903}
I20260505 20:13:48.853232 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 164) took 11413 ms. Trace:
I20260505 20:13:48.853329 9121 rpcz_store.cc:276] 0505 20:13:37.439478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.439528 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:48.808363 (+11368835us) ts_tablet_manager.cc:1151] Deleting tablet 91496ff1e14e4cfdbaadb34d25ad8b68
0505 20:13:48.808375 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.831147 (+ 22772us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.849521 (+ 18374us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.853214 (+ 3693us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11368659}
I20260505 20:13:48.853824 9121 tablet_replica.cc:333] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.853785 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 91496ff1e14e4cfdbaadb34d25ad8b68 (table default.Table_45bd1808371b4519abd37364b534e889 [id=b2f3204107ca4304b285cb53cba704b6]) successfully deleted
I20260505 20:13:48.854029 9121 raft_consensus.cc:2243] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.854192 9121 raft_consensus.cc:2272] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.854732 9121 ts_tablet_manager.cc:1916] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.854717 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e98c0e648c98488e8c5509b296824bea (table default.Table_2fea05446c6145fc9065f0db527efe94 [id=a812e64a033a470eaf1861fb213b4ceb]) successfully deleted
I20260505 20:13:48.854811 8053 ts_tablet_manager.cc:1403] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.003s
I20260505 20:13:48.858150 9271 tablet_replica.cc:333] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:48.859987 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "997f2f9cf76a4311ab233cb7d8bc8e3c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.838531 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:48.860476 7663 raft_consensus.cc:2393] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
W20260505 20:13:48.840616 7598 consensus_peers.cc:597] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4816f1ccb82e4641b2dcfe9ce9b55fae. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.861023 7598 leader_election.cc:304] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.861370 9758 raft_consensus.cc:2804] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:48.861491 9758 raft_consensus.cc:493] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:48.861616 9758 raft_consensus.cc:3060] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.864682 9758 raft_consensus.cc:515] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.865406 9758 leader_election.cc:290] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.865782 9429 raft_consensus.cc:493] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.865907 9429 raft_consensus.cc:515] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.866505 9429 leader_election.cc:290] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.865195 9271 raft_consensus.cc:2243] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:48.850880 7596 leader_election.cc:343] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 98af33c2cdb24937858efdc7b638418f
I20260505 20:13:48.867033 7596 leader_election.cc:304] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:48.867270 7596 raft_consensus.cc:2686] T 98af33c2cdb24937858efdc7b638418f P cab133462c2f46309dc8f0792122bad9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:48.868026 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaade50115e4ea69db6e50443cfea0e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.869369 9270 ts_tablet_manager.cc:1916] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.869917 9271 raft_consensus.cc:2272] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.870870 9944 raft_consensus.cc:493] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.871239 9944 raft_consensus.cc:515] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.871611 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fcaee384c440bcb3307cba455e2ffa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:48.871829 9944 leader_election.cc:290] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.871878 7926 raft_consensus.cc:2393] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate cab133462c2f46309dc8f0792122bad9 in this term.
I20260505 20:13:48.873229 9121 ts_tablet_manager.cc:1929] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.873339 9121 log.cc:1199] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/aa0b05546a4f47aea5fae1cf767b762d
I20260505 20:13:48.874794 8053 raft_consensus.cc:359] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.874941 8053 raft_consensus.cc:385] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.874984 8053 raft_consensus.cc:740] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.875131 8053 consensus_queue.cc:260] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.876077 9271 ts_tablet_manager.cc:1916] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.882046 9121 ts_tablet_manager.cc:1950] T aa0b05546a4f47aea5fae1cf767b762d P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.882459 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 166) took 11354 ms. Trace:
I20260505 20:13:48.882550 9121 rpcz_store.cc:276] 0505 20:13:37.528255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.529888 (+ 1633us) service_pool.cc:224] Handling call
0505 20:13:48.853771 (+11323883us) ts_tablet_manager.cc:1151] Deleting tablet aa0b05546a4f47aea5fae1cf767b762d
0505 20:13:48.853784 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.857657 (+ 3873us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.873176 (+ 15519us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.882440 (+ 9264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11323583}
I20260505 20:13:48.883069 9121 tablet_replica.cc:333] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.883038 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet aa0b05546a4f47aea5fae1cf767b762d (table default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]) successfully deleted
I20260505 20:13:48.890887 9121 raft_consensus.cc:2243] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.891120 9121 raft_consensus.cc:2272] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.891640 9121 ts_tablet_manager.cc:1916] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.894773 8054 tablet_bootstrap.cc:654] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:48.895936 7869 leader_election.cc:343] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.896060 7869 leader_election.cc:304] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.896307 9429 raft_consensus.cc:2749] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:48.896431 7869 leader_election.cc:343] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.896512 7869 leader_election.cc:304] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:48.896003 7598 leader_election.cc:343] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: ae8bd19470294a1db91855afe49be6a5
I20260505 20:13:48.897629 7598 leader_election.cc:304] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:48.898032 9495 raft_consensus.cc:2804] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:48.898159 9495 raft_consensus.cc:697] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:48.898413 9495 consensus_queue.cc:237] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.899179 8053 ts_tablet_manager.cc:1434] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.041s user 0.002s sys 0.001s
I20260505 20:13:48.901916 8053 tablet_bootstrap.cc:492] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:48.910526 8058 tablet_bootstrap.cc:492] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.910683 8058 ts_tablet_manager.cc:1403] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.141s user 0.012s sys 0.000s
I20260505 20:13:48.912362 8058 raft_consensus.cc:359] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.912536 8058 raft_consensus.cc:385] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.912588 8058 raft_consensus.cc:740] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.912767 8058 consensus_queue.cc:260] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.912962 9944 raft_consensus.cc:493] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.913084 9944 raft_consensus.cc:515] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.913228 8058 ts_tablet_manager.cc:1434] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:48.913463 8058 tablet_bootstrap.cc:492] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:48.913640 9944 leader_election.cc:290] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.915030 8058 tablet_bootstrap.cc:654] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:48.916025 7596 consensus_peers.cc:597] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bde33085759f4fd8a130d80878d1e564. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.917248 7596 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
W20260505 20:13:48.925414 7596 consensus_peers.cc:597] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bcd289ce979940ae96554d5756d140d7. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.925264 8053 tablet_bootstrap.cc:654] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:48.928716 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.928934 7785 raft_consensus.cc:2393] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:48.930024 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3535f0c31ad5451ea5bceeb50f756eef" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.930181 7785 raft_consensus.cc:2468] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.925665 9906 raft_consensus.cc:2749] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:48.931268 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8bd19470294a1db91855afe49be6a5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:48.931428 7785 raft_consensus.cc:2468] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:48.932657 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dbc2221555e4f598d65835ae640fe4a" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:48.932787 7785 raft_consensus.cc:3060] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.933034 9704 consensus_queue.cc:1048] T d5f27d918f0945208e780bd9583f529e P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.933561 7596 leader_election.cc:304] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:48.934478 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5dfabb36fa5499780b0d15c71404307" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.935604 7785 raft_consensus.cc:2468] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.936028 9894 raft_consensus.cc:493] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:48.936313 9894 raft_consensus.cc:515] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.937040 9894 leader_election.cc:290] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:48.939774 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3535f0c31ad5451ea5bceeb50f756eef" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:48.939990 7785 raft_consensus.cc:3060] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.942072 9704 raft_consensus.cc:2804] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:48.942203 9704 raft_consensus.cc:493] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:48.942333 9704 raft_consensus.cc:3060] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:48.943605 7785 raft_consensus.cc:2468] T 3535f0c31ad5451ea5bceeb50f756eef P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:48.945221 9704 raft_consensus.cc:515] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:48.945905 9704 leader_election.cc:290] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.947139 10167 consensus_queue.cc:1048] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.947606 10167 consensus_queue.cc:1048] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:48.949564 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaff49cb0ff4298be24603b2015c8a4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:48.954464 7736 leader_election.cc:343] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:48.955714 7736 leader_election.cc:343] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.959256 7654 raft_consensus.cc:3060] T 9845d42fafa14457bd6c54d7477786aa P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.961799 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4860b4f80ef34a799fa9f9607aac844a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:48.961997 7662 raft_consensus.cc:2468] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:48.964550 8053 tablet_bootstrap.cc:492] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:48.971498 8053 ts_tablet_manager.cc:1403] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.004s
I20260505 20:13:48.974416 8058 tablet_bootstrap.cc:492] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:48.974722 8058 ts_tablet_manager.cc:1403] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.003s
W20260505 20:13:48.974852 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 78454.1us
W20260505 20:13:48.975287 7869 leader_election.cc:343] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.975394 7869 leader_election.cc:304] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:48.975921 7869 leader_election.cc:343] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.976011 7869 leader_election.cc:304] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:48.976368 7869 leader_election.cc:343] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:48.976467 7869 leader_election.cc:304] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.976414 8058 raft_consensus.cc:359] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.976806 9429 raft_consensus.cc:2749] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.976824 8058 raft_consensus.cc:385] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.976979 9429 raft_consensus.cc:2749] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.976966 8058 raft_consensus.cc:740] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.977094 9429 raft_consensus.cc:2749] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.977200 9429 raft_consensus.cc:2749] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.978874 9894 raft_consensus.cc:493] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:48.979106 9894 raft_consensus.cc:515] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:48.980469 9894 leader_election.cc:290] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:48.980506 9121 ts_tablet_manager.cc:1929] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:48.980634 9121 log.cc:1199] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/d27febef8234419caa855dd7a180fe8f
I20260505 20:13:48.980912 9121 ts_tablet_manager.cc:1950] T d27febef8234419caa855dd7a180fe8f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:48.978324 9271 ts_tablet_manager.cc:1929] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:48.981344 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 168) took 11310 ms. Trace:
I20260505 20:13:48.981431 9121 rpcz_store.cc:276] 0505 20:13:37.670421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.670475 (+ 54us) service_pool.cc:224] Handling call
0505 20:13:48.883010 (+11212535us) ts_tablet_manager.cc:1151] Deleting tablet d27febef8234419caa855dd7a180fe8f
0505 20:13:48.883023 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.977176 (+ 94153us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.980452 (+ 3276us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.981328 (+ 876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7578,"tablet-delete.queue_time_us":11212289}
I20260505 20:13:48.981768 9121 tablet_replica.cc:333] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:48.981973 9121 raft_consensus.cc:2243] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:48.982146 9121 raft_consensus.cc:2272] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:48.977596 8058 consensus_queue.cc:260] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.981906 9271 log.cc:1199] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/d2676078f47c4bc19391227d9643c15f
I20260505 20:13:48.983307 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3535f0c31ad5451ea5bceeb50f756eef" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:48.983498 7926 raft_consensus.cc:3060] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:48.987389 7926 raft_consensus.cc:2468] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
W20260505 20:13:48.989104 7737 consensus_peers.cc:597] T b393bfc209b6461aab958ebf49014d25 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b393bfc209b6461aab958ebf49014d25. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:48.990326 9121 ts_tablet_manager.cc:1916] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:48.993247 9271 ts_tablet_manager.cc:1950] T d2676078f47c4bc19391227d9643c15f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:48.993129 7737 leader_election.cc:304] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:48.994205 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Bootstrap replayed 1/1 log segments. Stats: ops{read=603 overwritten=0 applied=602 ignored=0} inserts{seen=552 ignored=0} mutations{seen=691 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260505 20:13:48.994321 8058 ts_tablet_manager.cc:1434] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.019s user 0.000s sys 0.003s
I20260505 20:13:48.994952 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Bootstrap complete.
I20260505 20:13:48.995231 9894 raft_consensus.cc:2749] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:48.994200 8053 raft_consensus.cc:359] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:48.996428 8053 raft_consensus.cc:385] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:48.997321 8053 raft_consensus.cc:740] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:48.999796 8058 tablet_bootstrap.cc:492] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:49.001642 7737 leader_election.cc:343] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: cb5cfc700aff4082ae089476e2af044f
I20260505 20:13:49.001298 8053 consensus_queue.cc:260] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.005123 8054 tablet_bootstrap.cc:492] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.005267 8054 ts_tablet_manager.cc:1403] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.256s user 0.005s sys 0.000s
I20260505 20:13:49.008332 9948 raft_consensus.cc:493] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:49.008476 9948 raft_consensus.cc:515] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:49.009168 9948 leader_election.cc:290] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.002607 7737 leader_election.cc:304] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.018752 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 135) took 11739 ms. Trace:
I20260505 20:13:49.020030 9894 raft_consensus.cc:2749] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.020475 8054 raft_consensus.cc:359] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.020677 8054 raft_consensus.cc:385] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.020737 8054 raft_consensus.cc:740] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.021047 9271 rpcz_store.cc:276] 0505 20:13:37.279490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.279573 (+ 83us) service_pool.cc:224] Handling call
0505 20:13:48.857367 (+11577794us) ts_tablet_manager.cc:1151] Deleting tablet d2676078f47c4bc19391227d9643c15f
0505 20:13:48.857389 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.919119 (+ 61730us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:48.972409 (+ 53290us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.018715 (+ 46306us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11575613}
I20260505 20:13:49.025619 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet d2676078f47c4bc19391227d9643c15f (table default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]) successfully deleted
I20260505 20:13:49.026356 8053 ts_tablet_manager.cc:1434] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.054s user 0.003s sys 0.000s
W20260505 20:13:49.026877 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 50536.7us
I20260505 20:13:49.027132 7869 leader_election.cc:304] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:49.027541 7869 leader_election.cc:343] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.028134 10031 raft_consensus.cc:2749] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.027662 7869 leader_election.cc:304] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.026953 7737 leader_election.cc:304] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.028065 9271 tablet_replica.cc:333] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.028981 10091 raft_consensus.cc:2749] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:49.029680 7869 leader_election.cc:343] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.029870 7869 leader_election.cc:304] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.029929 9894 raft_consensus.cc:3060] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.030140 10091 raft_consensus.cc:2749] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:49.030515 7869 leader_election.cc:343] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.030668 7869 leader_election.cc:304] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.030891 10091 raft_consensus.cc:2749] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:49.031740 7869 leader_election.cc:343] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.031991 7869 leader_election.cc:304] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.032428 10091 raft_consensus.cc:2749] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.032713 9894 raft_consensus.cc:2749] T a5fcaee384c440bcb3307cba455e2ffa P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:49.033232 7869 leader_election.cc:343] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.033542 7869 leader_election.cc:304] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.034112 10091 raft_consensus.cc:2749] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.034139 8053 tablet_bootstrap.cc:492] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.033869 9617 raft_consensus.cc:359] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:49.034282 9271 raft_consensus.cc:2243] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.035514 7736 leader_election.cc:304] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.035789 9894 raft_consensus.cc:2804] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.036031 9894 raft_consensus.cc:493] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.036314 9894 raft_consensus.cc:3060] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.036245 9975 consensus_queue.cc:1048] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:49.039350 7598 leader_election.cc:343] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f2b2e40635b141c59d3789aca81efba7
W20260505 20:13:49.039134 7737 consensus_peers.cc:597] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: feef367085954816b312d4f1cdd80b1d. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.038786 9271 raft_consensus.cc:2272] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:49.040176 7598 consensus_peers.cc:597] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 624398f68961440f8369a7859b0724c4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.040697 7598 leader_election.cc:304] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.041275 10167 raft_consensus.cc:2804] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.041518 10167 raft_consensus.cc:697] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:49.041872 10167 consensus_queue.cc:237] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.026108 8054 consensus_queue.cc:260] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.043599 8054 ts_tablet_manager.cc:1434] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.038s user 0.003s sys 0.000s
I20260505 20:13:49.044986 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaade50115e4ea69db6e50443cfea0e" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.053841 9271 ts_tablet_manager.cc:1916] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.055303 8058 tablet_bootstrap.cc:654] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.057837 9617 raft_consensus.cc:740] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73028cd481e446daa9432a35522a7967, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.058714 9617 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 602, Last appended: 1.603, Last appended by leader: 603, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:49.060230 8053 tablet_bootstrap.cc:654] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.066167 9270 ts_tablet_manager.cc:1929] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.066586 9270 log.cc:1199] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f62626fb4f8445e3a6e2822277181762
W20260505 20:13:49.067279 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 95819.8us
W20260505 20:13:49.068461 7596 consensus_peers.cc:597] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdda1cc266cd47c993b5d1a0a78c7df9. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:49.068931 7596 consensus_peers.cc:597] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54becbd4690c403e803a7a79f12cb6d5. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.070627 7596 leader_election.cc:304] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:49.076354 8054 tablet_bootstrap.cc:492] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.078939 7869 leader_election.cc:304] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.079308 9894 raft_consensus.cc:515] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.079618 10196 raft_consensus.cc:2804] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.079698 10196 raft_consensus.cc:493] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.079779 10196 raft_consensus.cc:3060] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.080308 9906 raft_consensus.cc:2749] T 5bdd0cf6cefa43388b22cbd1cee820b6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.083001 8053 tablet_bootstrap.cc:492] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.083190 8053 ts_tablet_manager.cc:1403] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.002s
I20260505 20:13:49.084190 8053 raft_consensus.cc:359] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.084369 8053 raft_consensus.cc:385] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.084414 8053 raft_consensus.cc:740] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.084594 8053 consensus_queue.cc:260] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.085059 8053 ts_tablet_manager.cc:1434] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:49.085325 8053 tablet_bootstrap.cc:492] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.085467 7848 heartbeater.cc:344] Connected to a master server at 127.7.33.254:38755
I20260505 20:13:49.086759 9894 leader_election.cc:290] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.087184 8053 tablet_bootstrap.cc:654] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.087399 10167 raft_consensus.cc:493] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.087599 10167 raft_consensus.cc:515] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.088393 10167 leader_election.cc:290] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:49.089035 9270 ts_tablet_manager.cc:1950] T f62626fb4f8445e3a6e2822277181762 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.090988 8058 tablet_bootstrap.cc:492] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.091257 8058 ts_tablet_manager.cc:1403] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.094s user 0.002s sys 0.005s
I20260505 20:13:49.093061 8058 raft_consensus.cc:359] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.093449 8058 raft_consensus.cc:385] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.093581 8058 raft_consensus.cc:740] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.094522 10091 consensus_queue.cc:1048] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:49.095276 7869 leader_election.cc:343] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.095451 7869 leader_election.cc:304] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.095742 10091 raft_consensus.cc:2749] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.098217 9617 sys_catalog.cc:565] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: configured and running, proceeding with master startup.
I20260505 20:13:49.098264 9565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 787 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:49.098958 9565 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29603775b6d74153b21e0bbcc535ff98 in term 1.
W20260505 20:13:49.099215 9565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52628 (request call id 2) took 4925 ms (client timeout 632 ms). Trace:
W20260505 20:13:49.099366 9565 rpcz_store.cc:269] 0505 20:13:44.173814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:44.174375 (+ 561us) service_pool.cc:224] Handling call
0505 20:13:49.099144 (+4924769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:49.100458 9567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 760 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:49.100773 9567 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29603775b6d74153b21e0bbcc535ff98 in term 1.
W20260505 20:13:49.100946 9567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52628 (request call id 1) took 6923 ms (client timeout 744 ms). Trace:
W20260505 20:13:49.101076 9567 rpcz_store.cc:269] 0505 20:13:42.177159 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.177220 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:49.100882 (+6923662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:49.101431 9564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 787 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
W20260505 20:13:49.102063 9564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52628 (request call id 3) took 4276 ms (client timeout 632 ms). Trace:
I20260505 20:13:49.102201 8053 tablet_bootstrap.cc:492] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
W20260505 20:13:49.102216 9564 rpcz_store.cc:269] 0505 20:13:44.825950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:44.826012 (+ 62us) service_pool.cc:224] Handling call
0505 20:13:49.102019 (+4276007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:49.102350 8053 ts_tablet_manager.cc:1403] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.004s
I20260505 20:13:49.103004 7869 leader_election.cc:304] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.103154 8053 raft_consensus.cc:359] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.103277 10031 raft_consensus.cc:2804] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.103322 8053 raft_consensus.cc:385] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.103382 8053 raft_consensus.cc:740] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.103397 10031 raft_consensus.cc:493] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.103565 8053 consensus_queue.cc:260] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.103644 10031 raft_consensus.cc:3060] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.104060 8053 ts_tablet_manager.cc:1434] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:49.104337 8053 tablet_bootstrap.cc:492] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.104880 9569 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:49.105834 9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 760 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
W20260505 20:13:49.106163 9568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52628 (request call id 0) took 7293 ms (client timeout 744 ms). Trace:
W20260505 20:13:49.106289 9568 rpcz_store.cc:269] 0505 20:13:41.812893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:41.812953 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:49.106132 (+7293179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:49.106706 10031 raft_consensus.cc:515] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.107494 10031 leader_election.cc:290] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.094435 8058 consensus_queue.cc:260] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.109091 8058 ts_tablet_manager.cc:1434] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260505 20:13:49.109120 8053 tablet_bootstrap.cc:654] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.110502 9121 ts_tablet_manager.cc:1929] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.110661 9121 log.cc:1199] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/7f34a3f1f30b4165a0c60fab482dce36
I20260505 20:13:49.112618 9271 ts_tablet_manager.cc:1929] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.112743 9271 log.cc:1199] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1f27847d940e46778ad10a2f4cf40d27
I20260505 20:13:49.113155 9271 ts_tablet_manager.cc:1950] T 1f27847d940e46778ad10a2f4cf40d27 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.113523 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 136) took 11833 ms. Trace:
I20260505 20:13:49.094902 10200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:49.116757 10200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:49.093212 7596 leader_election.cc:304] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:49.118523 8058 tablet_bootstrap.cc:492] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.118880 9906 raft_consensus.cc:2804] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.118958 9906 raft_consensus.cc:493] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.119030 9906 raft_consensus.cc:3060] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.120291 8058 tablet_bootstrap.cc:654] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.121692 9906 raft_consensus.cc:515] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.091267 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 130) took 11809 ms. Trace:
I20260505 20:13:49.122864 9906 leader_election.cc:290] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.122889 9270 rpcz_store.cc:276] 0505 20:13:37.281639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.281770 (+ 131us) service_pool.cc:224] Handling call
0505 20:13:48.831750 (+11549980us) ts_tablet_manager.cc:1151] Deleting tablet f62626fb4f8445e3a6e2822277181762
0505 20:13:48.831761 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:48.939982 (+108221us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.066000 (+126018us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.091246 (+ 25246us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11549844}
I20260505 20:13:49.125017 9569 pending_rounds.cc:85] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Aborting all ops after (but not including) 602
I20260505 20:13:49.125626 9569 pending_rounds.cc:107] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: Aborting uncommitted WRITE_OP operation due to leader change: 1.603
I20260505 20:13:49.125658 10196 raft_consensus.cc:515] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.126866 9121 ts_tablet_manager.cc:1950] T 7f34a3f1f30b4165a0c60fab482dce36 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:49.129904 7870 leader_election.cc:343] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.132300 10196 leader_election.cc:290] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.113603 9271 rpcz_store.cc:276] 0505 20:13:37.279817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.279850 (+ 33us) service_pool.cc:224] Handling call
0505 20:13:49.026879 (+11747029us) ts_tablet_manager.cc:1151] Deleting tablet 1f27847d940e46778ad10a2f4cf40d27
0505 20:13:49.027402 (+ 523us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.109298 (+ 81896us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.112553 (+ 3255us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.113504 (+ 951us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11746490}
I20260505 20:13:49.134020 9271 tablet_replica.cc:333] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.134234 9271 raft_consensus.cc:2243] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:49.134431 9271 raft_consensus.cc:2272] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.134991 9271 ts_tablet_manager.cc:1916] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.137424 8054 tablet_bootstrap.cc:654] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.138298 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 170) took 11299 ms. Trace:
W20260505 20:13:49.139580 7869 leader_election.cc:343] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.139746 7869 leader_election.cc:304] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.140139 9619 raft_consensus.cc:2749] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.141430 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.145495 8053 tablet_bootstrap.cc:492] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.145642 8053 ts_tablet_manager.cc:1403] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.022s
I20260505 20:13:49.146466 8053 raft_consensus.cc:359] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.146641 8053 raft_consensus.cc:385] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.146690 8053 raft_consensus.cc:740] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.146883 8053 consensus_queue.cc:260] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.147361 8053 ts_tablet_manager.cc:1434] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.147447 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4860b4f80ef34a799fa9f9607aac844a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.147605 7660 raft_consensus.cc:3060] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.147629 8053 tablet_bootstrap.cc:492] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.149360 8053 tablet_bootstrap.cc:654] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.150215 7660 raft_consensus.cc:2468] T 4860b4f80ef34a799fa9f9607aac844a P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.150645 9270 tablet_replica.cc:333] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.150838 9270 raft_consensus.cc:2243] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:49.151158 9270 raft_consensus.cc:2272] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.151710 9270 ts_tablet_manager.cc:1916] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.162667 8058 tablet_bootstrap.cc:492] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.162892 8058 ts_tablet_manager.cc:1403] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260505 20:13:49.164113 8058 raft_consensus.cc:359] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.164330 8058 raft_consensus.cc:385] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.164413 8058 raft_consensus.cc:740] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.164649 8058 consensus_queue.cc:260] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.165201 8058 ts_tablet_manager.cc:1434] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:49.165500 8058 tablet_bootstrap.cc:492] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.175009 10196 raft_consensus.cc:493] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.175144 8053 tablet_bootstrap.cc:492] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.175272 8053 ts_tablet_manager.cc:1403] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.008s
I20260505 20:13:49.175184 10196 raft_consensus.cc:515] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.176074 8053 raft_consensus.cc:359] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.176227 8053 raft_consensus.cc:385] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.176270 8053 raft_consensus.cc:740] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.176443 8053 consensus_queue.cc:260] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.176909 8053 ts_tablet_manager.cc:1434] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:49.177109 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b2e40635b141c59d3789aca81efba7" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.177182 8053 tablet_bootstrap.cc:492] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.177273 7787 raft_consensus.cc:3060] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:49.177233 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d417bb8f3ac4343807e9ff4971eb2ad" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.179339 8053 tablet_bootstrap.cc:654] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.182754 7787 raft_consensus.cc:2468] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 2.
I20260505 20:13:49.183437 9906 raft_consensus.cc:493] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.183952 9906 raft_consensus.cc:515] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.185102 9906 leader_election.cc:290] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:49.187645 8053 tablet_bootstrap.cc:492] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.187851 8053 ts_tablet_manager.cc:1403] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260505 20:13:49.188838 8053 raft_consensus.cc:359] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.189061 8053 raft_consensus.cc:385] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.189172 8053 raft_consensus.cc:740] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.189713 8053 consensus_queue.cc:260] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.190423 8053 ts_tablet_manager.cc:1434] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260505 20:13:49.190811 8053 tablet_bootstrap.cc:492] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.190824 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede080523cb1482d8a531f4044164475" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.191009 7926 raft_consensus.cc:2468] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.192739 9948 raft_consensus.cc:493] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.193030 8053 tablet_bootstrap.cc:654] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.192910 9948 raft_consensus.cc:515] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.193857 9948 leader_election.cc:290] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:49.195406 7598 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.33.254:38755, user_credentials={real_user=slave}} blocked reactor thread for 49209.7us
I20260505 20:13:49.195981 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.196234 7926 raft_consensus.cc:2468] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.197009 10196 leader_election.cc:290] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.138433 9121 rpcz_store.cc:276] 0505 20:13:37.839058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.839108 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:48.981702 (+11142594us) ts_tablet_manager.cc:1151] Deleting tablet 7f34a3f1f30b4165a0c60fab482dce36
0505 20:13:48.981712 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.015227 (+ 33515us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.110448 (+ 95221us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.138280 (+ 27832us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11142372}
I20260505 20:13:49.198848 9121 tablet_replica.cc:333] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:49.199120 9121 raft_consensus.cc:2243] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.199313 9121 raft_consensus.cc:2272] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.200088 9121 ts_tablet_manager.cc:1916] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:49.201432 7736 leader_election.cc:343] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 172cd9f38dd8491ea3ecf42b680d398f
I20260505 20:13:49.203648 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.203878 7787 raft_consensus.cc:2468] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:49.205843 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8bd19470294a1db91855afe49be6a5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.206030 7787 raft_consensus.cc:3060] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:49.206368 7736 leader_election.cc:343] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: e69bdfc75a494635837178cb16c08c1c
I20260505 20:13:49.208892 7787 raft_consensus.cc:2468] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:49.218703 9270 ts_tablet_manager.cc:1929] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.221692 8058 tablet_bootstrap.cc:654] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.222049 9270 log.cc:1199] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/b91ccd9761ee4386b9e80cb9c9cfa975
I20260505 20:13:49.222499 9270 ts_tablet_manager.cc:1950] T b91ccd9761ee4386b9e80cb9c9cfa975 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.224294 8053 tablet_bootstrap.cc:492] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.224478 8053 ts_tablet_manager.cc:1403] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.015s
I20260505 20:13:49.225472 8053 raft_consensus.cc:359] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.225723 8053 raft_consensus.cc:385] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.226420 8053 raft_consensus.cc:740] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.226373 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 131) took 11944 ms. Trace:
I20260505 20:13:49.226536 9270 rpcz_store.cc:276] 0505 20:13:37.281716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.282125 (+ 409us) service_pool.cc:224] Handling call
0505 20:13:49.125261 (+11843136us) ts_tablet_manager.cc:1151] Deleting tablet b91ccd9761ee4386b9e80cb9c9cfa975
0505 20:13:49.147100 (+ 21839us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.155128 (+ 8028us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.218628 (+ 63500us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.226351 (+ 7723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11843000}
I20260505 20:13:49.226709 8053 consensus_queue.cc:260] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.226958 9270 tablet_replica.cc:333] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.227195 9270 raft_consensus.cc:2243] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:49.227424 8053 ts_tablet_manager.cc:1434] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260505 20:13:49.227775 8053 tablet_bootstrap.cc:492] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.229863 7736 leader_election.cc:304] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.230101 8053 tablet_bootstrap.cc:654] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.230150 9944 raft_consensus.cc:2804] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.230283 9944 raft_consensus.cc:697] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:49.230540 9944 consensus_queue.cc:237] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.239547 8053 tablet_bootstrap.cc:492] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.239732 8053 ts_tablet_manager.cc:1403] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260505 20:13:49.240648 9270 raft_consensus.cc:2272] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.240630 8053 raft_consensus.cc:359] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.240870 8053 raft_consensus.cc:385] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.240970 8053 raft_consensus.cc:740] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.241225 8053 consensus_queue.cc:260] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.241585 9270 ts_tablet_manager.cc:1916] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.242074 8053 ts_tablet_manager.cc:1434] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260505 20:13:49.242440 8053 tablet_bootstrap.cc:492] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.242995 10213 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4615fa5639440fc820498f897adf17d)
I20260505 20:13:49.243162 10213 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:49.243754 9271 ts_tablet_manager.cc:1929] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.244004 9271 log.cc:1199] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/608bffbbc10141e8bd19f475b95bdc65
I20260505 20:13:49.245201 10196 raft_consensus.cc:493] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.245362 10196 raft_consensus.cc:515] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.246090 10196 leader_election.cc:290] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.249436 9271 ts_tablet_manager.cc:1950] T 608bffbbc10141e8bd19f475b95bdc65 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.244761 8053 tablet_bootstrap.cc:654] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.258682 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.258921 7928 raft_consensus.cc:2393] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:49.259688 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.259863 7919 raft_consensus.cc:2393] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:49.260006 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bdd0cf6cefa43388b22cbd1cee820b6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:49.266691 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 137) took 11879 ms. Trace:
I20260505 20:13:49.266901 9271 rpcz_store.cc:276] 0505 20:13:37.386918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.386981 (+ 63us) service_pool.cc:224] Handling call
0505 20:13:49.133965 (+11746984us) ts_tablet_manager.cc:1151] Deleting tablet 608bffbbc10141e8bd19f475b95bdc65
0505 20:13:49.133974 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.209837 (+ 75863us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.243626 (+ 33789us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.266647 (+ 23021us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11746791}
I20260505 20:13:49.267551 9271 tablet_replica.cc:333] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.267829 9271 raft_consensus.cc:2243] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.268055 9271 raft_consensus.cc:2272] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.268652 9271 ts_tablet_manager.cc:1916] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.281955 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4860b4f80ef34a799fa9f9607aac844a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.282164 7931 raft_consensus.cc:2468] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.286412 8058 tablet_bootstrap.cc:492] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.286648 8058 ts_tablet_manager.cc:1403] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.121s user 0.007s sys 0.000s
I20260505 20:13:49.287405 8058 raft_consensus.cc:359] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.287652 8058 raft_consensus.cc:385] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.287761 8058 raft_consensus.cc:740] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.288012 8058 consensus_queue.cc:260] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.288627 8058 ts_tablet_manager.cc:1434] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.290386 9270 ts_tablet_manager.cc:1929] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.292394 9270 log.cc:1199] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/17acb52d6cde4ced988506cee48eb040
I20260505 20:13:49.292865 9270 ts_tablet_manager.cc:1950] T 17acb52d6cde4ced988506cee48eb040 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.294155 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.294328 7662 raft_consensus.cc:3060] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.294629 9271 ts_tablet_manager.cc:1929] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.294754 9271 log.cc:1199] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/56bd0f4254424c979f90da0400e0ec70
I20260505 20:13:49.295091 9271 ts_tablet_manager.cc:1950] T 56bd0f4254424c979f90da0400e0ec70 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.295390 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 140) took 11908 ms. Trace:
I20260505 20:13:49.295475 9271 rpcz_store.cc:276] 0505 20:13:37.387180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.387227 (+ 47us) service_pool.cc:224] Handling call
0505 20:13:49.267478 (+11880251us) ts_tablet_manager.cc:1151] Deleting tablet 56bd0f4254424c979f90da0400e0ec70
0505 20:13:49.267488 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.290576 (+ 23088us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.294553 (+ 3977us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.295358 (+ 805us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11880116}
I20260505 20:13:49.295951 9271 tablet_replica.cc:333] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.296294 9271 raft_consensus.cc:2243] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.297024 7662 raft_consensus.cc:2468] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.297775 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.297993 7662 raft_consensus.cc:3060] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.300597 7662 raft_consensus.cc:2468] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.301903 10213 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:49.302624 9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 818 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:49.304714 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e116486fb4b34e88b564fbb46e8b0faf" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.305455 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9bd035b077474294d274a8f8cb38fd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.310868 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296494f478244052971e12a09f0b15b4" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.316927 9271 raft_consensus.cc:2272] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.317870 9271 ts_tablet_manager.cc:1916] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.324672 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4860b4f80ef34a799fa9f9607aac844a" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:49.324841 7926 raft_consensus.cc:3060] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.325721 9271 ts_tablet_manager.cc:1929] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.325873 9271 log.cc:1199] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/624398f68961440f8369a7859b0724c4
I20260505 20:13:49.326202 9271 ts_tablet_manager.cc:1950] T 624398f68961440f8369a7859b0724c4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.326952 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 143) took 11939 ms. Trace:
I20260505 20:13:49.327045 9271 rpcz_store.cc:276] 0505 20:13:37.387413 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.387450 (+ 37us) service_pool.cc:224] Handling call
0505 20:13:49.295886 (+11908436us) ts_tablet_manager.cc:1151] Deleting tablet 624398f68961440f8369a7859b0724c4
0505 20:13:49.295896 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.321475 (+ 25579us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.325655 (+ 4180us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.326930 (+ 1275us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11908282}
I20260505 20:13:49.327515 9271 tablet_replica.cc:333] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.327724 9271 raft_consensus.cc:2243] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:49.327986 9271 raft_consensus.cc:2272] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.328523 9271 ts_tablet_manager.cc:1916] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.330865 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.331177 7785 raft_consensus.cc:2468] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:49.333490 8058 tablet_bootstrap.cc:492] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.333663 10196 raft_consensus.cc:493] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.333871 10196 raft_consensus.cc:515] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.334909 10196 leader_election.cc:290] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.335281 8058 tablet_bootstrap.cc:654] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.336690 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 132) took 12054 ms. Trace:
I20260505 20:13:49.336793 9270 rpcz_store.cc:276] 0505 20:13:37.282375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.282525 (+ 150us) service_pool.cc:224] Handling call
0505 20:13:49.226874 (+11944349us) ts_tablet_manager.cc:1151] Deleting tablet 17acb52d6cde4ced988506cee48eb040
0505 20:13:49.226884 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.252216 (+ 25332us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.290330 (+ 38114us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.336660 (+ 46330us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11944230}
I20260505 20:13:49.337185 9270 tablet_replica.cc:333] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.337383 9270 raft_consensus.cc:2243] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.337527 9270 raft_consensus.cc:2272] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.338081 9270 ts_tablet_manager.cc:1916] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.341876 7926 raft_consensus.cc:2468] T 4860b4f80ef34a799fa9f9607aac844a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.347990 9270 ts_tablet_manager.cc:1929] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:49.354295 9270 log.cc:1199] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/7766caea43904162a2c289b7b17405d4
I20260505 20:13:49.354995 9270 ts_tablet_manager.cc:1950] T 7766caea43904162a2c289b7b17405d4 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.363730 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 133) took 12081 ms. Trace:
I20260505 20:13:49.364934 9270 rpcz_store.cc:276] 0505 20:13:37.282741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.282872 (+ 131us) service_pool.cc:224] Handling call
0505 20:13:49.337133 (+12054261us) ts_tablet_manager.cc:1151] Deleting tablet 7766caea43904162a2c289b7b17405d4
0505 20:13:49.337145 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.342216 (+ 5071us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.347922 (+ 5706us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.363704 (+ 15782us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12054130}
I20260505 20:13:49.365520 10031 consensus_queue.cc:1048] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.366086 9271 ts_tablet_manager.cc:1929] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.366212 9271 log.cc:1199] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:49.366566 9271 ts_tablet_manager.cc:1950] T 096ca710e3564d4b8db50f29dd56a5d4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.367216 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 134) took 12084 ms. Trace:
I20260505 20:13:49.367682 9270 rpcz_store.cc:276] 0505 20:13:37.283114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.283260 (+ 146us) service_pool.cc:224] Handling call
0505 20:13:49.367064 (+12083804us) ts_tablet_manager.cc:1151] Deleting tablet cb5cfc700aff4082ae089476e2af044f
0505 20:13:49.367075 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.367195 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12083674}
I20260505 20:13:49.368355 9270 tablet_replica.cc:333] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.368755 9270 raft_consensus.cc:2243] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.369262 9270 raft_consensus.cc:2272] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.370131 9270 ts_tablet_manager.cc:1916] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:49.370859 7736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 120318us
I20260505 20:13:49.371070 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 145) took 11983 ms. Trace:
I20260505 20:13:49.371146 9271 rpcz_store.cc:276] 0505 20:13:37.387618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.387647 (+ 29us) service_pool.cc:224] Handling call
0505 20:13:49.327469 (+11939822us) ts_tablet_manager.cc:1151] Deleting tablet 096ca710e3564d4b8db50f29dd56a5d4
0505 20:13:49.327479 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.332194 (+ 4715us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.366015 (+ 33821us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.371055 (+ 5040us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11939695}
I20260505 20:13:49.375525 9271 tablet_replica.cc:333] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.375748 9271 raft_consensus.cc:2243] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:49.376039 9271 raft_consensus.cc:2272] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.126053 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f62626fb4f8445e3a6e2822277181762 (table default.Table_0f694abaae6f4ded97efb1bba5f767bc [id=acd5c466110345a981cdc7846420f8ce]) successfully deleted
W20260505 20:13:49.376437 7398 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 250523us
I20260505 20:13:49.134248 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1f27847d940e46778ad10a2f4cf40d27 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]) successfully deleted
W20260505 20:13:49.376993 7397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 242860us
I20260505 20:13:49.377219 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 608bffbbc10141e8bd19f475b95bdc65 (table default.Table_1612c41337614a9c9edcd92892fd1c68 [id=79032ad4a3c549559bc0ec51b54172d5]) successfully deleted
I20260505 20:13:49.377449 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 56bd0f4254424c979f90da0400e0ec70 (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
I20260505 20:13:49.377698 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 096ca710e3564d4b8db50f29dd56a5d4 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:49.378021 8054 tablet_bootstrap.cc:492] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.378240 8054 ts_tablet_manager.cc:1403] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.302s user 0.009s sys 0.000s
I20260505 20:13:49.379292 8054 raft_consensus.cc:359] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.117710 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8e190c973c984ec080178efa39b2def0 (table default.Table_ba3b733a40ce48589c0b347147da20c5 [id=d52c9e2e31b34773959865aaa6f1833a]). Expected version 1 got 0
I20260505 20:13:49.380036 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:49.380887 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:49.381592 9975 raft_consensus.cc:493] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.381716 9975 raft_consensus.cc:515] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.382483 9975 leader_election.cc:290] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.384783 8058 tablet_bootstrap.cc:492] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.384938 8058 ts_tablet_manager.cc:1403] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.003s
I20260505 20:13:49.385883 8058 raft_consensus.cc:359] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.386049 8058 raft_consensus.cc:385] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.386116 8058 raft_consensus.cc:740] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.386355 8058 consensus_queue.cc:260] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.386905 8058 ts_tablet_manager.cc:1434] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:49.387185 8058 tablet_bootstrap.cc:492] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.388975 8058 tablet_bootstrap.cc:654] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.389199 7789 raft_consensus.cc:3060] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.390975 9271 ts_tablet_manager.cc:1916] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.404034 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet d27febef8234419caa855dd7a180fe8f (table default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]) successfully deleted
I20260505 20:13:49.408041 7787 raft_consensus.cc:3060] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.409135 7596 leader_election.cc:304] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:49.409363 9906 raft_consensus.cc:2804] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:49.409543 9906 raft_consensus.cc:697] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:49.409792 9906 consensus_queue.cc:237] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.411566 8053 tablet_bootstrap.cc:492] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.411753 8053 ts_tablet_manager.cc:1403] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.169s user 0.011s sys 0.019s
I20260505 20:13:49.412137 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3ebd96dc184e0db04b3e063d5b9b2d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.412294 7787 raft_consensus.cc:3060] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.412533 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38822ad83f51454f9203fc17ed93a32f" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.412652 7785 raft_consensus.cc:3060] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.412600 8053 raft_consensus.cc:359] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.412803 8053 raft_consensus.cc:385] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.412863 8053 raft_consensus.cc:740] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.413094 8053 consensus_queue.cc:260] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.413770 8053 ts_tablet_manager.cc:1434] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260505 20:13:49.414080 8053 tablet_bootstrap.cc:492] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.414978 7787 raft_consensus.cc:2468] T 8b3ebd96dc184e0db04b3e063d5b9b2d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.415964 8053 tablet_bootstrap.cc:654] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.420866 7785 raft_consensus.cc:2468] T 38822ad83f51454f9203fc17ed93a32f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.421221 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 818 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:49.421861 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet b91ccd9761ee4386b9e80cb9c9cfa975 (table default.Table_1ed5779651c64985885b1277795cd799 [id=f4476ccbe29347268a55ffd8ad600189]) successfully deleted
I20260505 20:13:49.422109 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 17acb52d6cde4ced988506cee48eb040 (table default.Table_e11454be890e45bc9d2ba2cd319f2c93 [id=8dc245508fd34445bb94f647505e20d9]) successfully deleted
I20260505 20:13:49.422326 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 7766caea43904162a2c289b7b17405d4 (table default.Table_f32414ac94684234ab3a25f46213b70b [id=e0c72c789d9547febc28afe78bab3ad1]) successfully deleted
I20260505 20:13:49.422514 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]) successfully deleted
W20260505 20:13:49.422566 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet cb5cfc700aff4082ae089476e2af044f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb5cfc700aff4082ae089476e2af044f already in progress: creating tablet
I20260505 20:13:49.423094 8260 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98; no voters: 73028cd481e446daa9432a35522a7967, f4615fa5639440fc820498f897adf17d
I20260505 20:13:49.424849 10213 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260505 20:13:49.427474 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:49.427845 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:49.428138 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:49.430806 9270 ts_tablet_manager.cc:1929] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:49.387110 7870 leader_election.cc:304] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.432008 8054 raft_consensus.cc:385] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.432209 10196 raft_consensus.cc:2804] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:49.432175 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 45136.8us
I20260505 20:13:49.432169 8058 tablet_bootstrap.cc:492] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.432430 10196 raft_consensus.cc:697] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:49.432471 8058 ts_tablet_manager.cc:1403] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.003s
I20260505 20:13:49.432473 7870 leader_election.cc:304] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.432718 10031 raft_consensus.cc:2804] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
W20260505 20:13:49.432879 7870 leader_election.cc:343] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.432858 10091 consensus_queue.cc:1048] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.433007 10031 raft_consensus.cc:697] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
W20260505 20:13:49.433030 7870 leader_election.cc:343] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.433328 8058 raft_consensus.cc:359] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.433223 10031 consensus_queue.cc:237] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.433475 8058 raft_consensus.cc:385] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.433521 8058 raft_consensus.cc:740] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.433703 8058 consensus_queue.cc:260] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.434357 8058 ts_tablet_manager.cc:1434] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.434650 8058 tablet_bootstrap.cc:492] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.435036 10196 consensus_queue.cc:237] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.436259 8058 tablet_bootstrap.cc:654] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.436776 9270 log.cc:1199] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/0112c04befa14c48bb5b2e7dfb60dac7
I20260505 20:13:49.437263 9270 ts_tablet_manager.cc:1950] T 0112c04befa14c48bb5b2e7dfb60dac7 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.439086 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 135) took 12155 ms. Trace:
I20260505 20:13:49.439759 9270 rpcz_store.cc:276] 0505 20:13:37.283557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.283769 (+ 212us) service_pool.cc:224] Handling call
0505 20:13:49.368307 (+12084538us) ts_tablet_manager.cc:1151] Deleting tablet 0112c04befa14c48bb5b2e7dfb60dac7
0505 20:13:49.368318 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.395758 (+ 27440us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.430738 (+ 34980us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.439061 (+ 8323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12084412}
I20260505 20:13:49.440506 9270 tablet_replica.cc:333] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.440961 9270 raft_consensus.cc:2243] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.445204 9569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52620 (request call id 0) took 7632 ms. Trace:
I20260505 20:13:49.444887 9270 raft_consensus.cc:2272] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.432097 8054 raft_consensus.cc:740] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.446257 9270 ts_tablet_manager.cc:1916] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.446379 8054 consensus_queue.cc:260] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.447028 8054 ts_tablet_manager.cc:1434] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260505 20:13:49.447300 8054 tablet_bootstrap.cc:492] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.447484 10031 raft_consensus.cc:493] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.447651 10031 raft_consensus.cc:515] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.448218 10031 leader_election.cc:290] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.449239 10200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4615fa5639440fc820498f897adf17d. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:49.449523 10200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: FOLLOWER
I20260505 20:13:49.449335 10237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:49.449690 10237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [sys.catalog]: This master's current role is: FOLLOWER
W20260505 20:13:49.452767 7598 leader_election.cc:343] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: ae8bd19470294a1db91855afe49be6a5
I20260505 20:13:49.453389 10167 consensus_queue.cc:1048] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.453861 7596 leader_election.cc:304] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:49.454718 9495 raft_consensus.cc:2764] T 8b3ebd96dc184e0db04b3e063d5b9b2d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260505 20:13:49.455255 7596 leader_election.cc:304] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:49.455560 9495 raft_consensus.cc:2804] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.455660 9495 raft_consensus.cc:697] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:49.455888 9495 consensus_queue.cc:237] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:49.421677 7737 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e32ff17c39f04bc2b1c9c37a1165399b
I20260505 20:13:49.461902 7737 leader_election.cc:304] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.462296 9975 raft_consensus.cc:3060] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.465137 9975 raft_consensus.cc:2749] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.465163 9270 ts_tablet_manager.cc:1929] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.465253 9270 log.cc:1199] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/1e453fdf9a424fe8974076fac3ad74bf
I20260505 20:13:49.426651 8053 tablet_bootstrap.cc:492] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.465605 9270 ts_tablet_manager.cc:1950] T 1e453fdf9a424fe8974076fac3ad74bf P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.465605 8053 ts_tablet_manager.cc:1403] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260505 20:13:49.466379 8053 raft_consensus.cc:359] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.466526 8053 raft_consensus.cc:385] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.466571 8053 raft_consensus.cc:740] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.466820 8058 tablet_bootstrap.cc:492] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.466743 8053 consensus_queue.cc:260] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.466925 8058 ts_tablet_manager.cc:1403] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.002s
I20260505 20:13:49.467212 8053 ts_tablet_manager.cc:1434] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:49.467487 8053 tablet_bootstrap.cc:492] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.468802 8053 tablet_bootstrap.cc:654] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:49.469842 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 48199us
I20260505 20:13:49.470739 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9bd035b077474294d274a8f8cb38fd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.470994 7795 raft_consensus.cc:2468] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:49.471398 7737 leader_election.cc:304] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.471808 7737 leader_election.cc:304] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.472055 9894 raft_consensus.cc:2749] T 1d417bb8f3ac4343807e9ff4971eb2ad P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.472195 9894 raft_consensus.cc:2804] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.472249 9894 raft_consensus.cc:493] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.472302 9894 raft_consensus.cc:3060] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.475188 9894 raft_consensus.cc:515] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.475770 9894 leader_election.cc:290] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.476048 9894 raft_consensus.cc:493] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.476161 9894 raft_consensus.cc:515] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.476733 9894 leader_election.cc:290] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.471166 8058 raft_consensus.cc:359] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.477173 8058 raft_consensus.cc:385] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.477241 8058 raft_consensus.cc:740] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.477854 7737 leader_election.cc:304] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.430612 10221 raft_consensus.cc:493] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.438920 9271 ts_tablet_manager.cc:1929] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260505 20:13:49.478657 9271 log.cc:1199] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:49.478679 10221 raft_consensus.cc:515] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.479043 9271 ts_tablet_manager.cc:1950] T 50c1f63c849c48438abdaa965ab051f9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.479422 10221 leader_election.cc:290] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.479593 10221 raft_consensus.cc:2804] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.479694 10221 raft_consensus.cc:493] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.479817 10221 raft_consensus.cc:3060] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.480000 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 147) took 12092 ms. Trace:
I20260505 20:13:49.480086 9271 rpcz_store.cc:276] 0505 20:13:37.387769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.387801 (+ 32us) service_pool.cc:224] Handling call
0505 20:13:49.375475 (+11987674us) ts_tablet_manager.cc:1151] Deleting tablet 50c1f63c849c48438abdaa965ab051f9
0505 20:13:49.375485 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.427239 (+ 51754us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.438841 (+ 11602us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.479982 (+ 41141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11987550}
I20260505 20:13:49.480779 9271 tablet_replica.cc:333] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.480974 9271 raft_consensus.cc:2243] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.481117 9271 raft_consensus.cc:2272] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.481768 9271 ts_tablet_manager.cc:1916] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.482671 10221 raft_consensus.cc:515] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.442184 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 0112c04befa14c48bb5b2e7dfb60dac7 (table default.Table_54ae8ffe8e9a482daae20d9283315d37 [id=aade90edb7b74390b229a6d8cc95f2db]) successfully deleted
W20260505 20:13:49.486199 7398 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 44059.4us
I20260505 20:13:49.486263 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:49.480551 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 50c1f63c849c48438abdaa965ab051f9 (table default.Table_f9e3face23974d6ba5012aaa1d677869 [id=bbe541cae6d84762803eb4314c63ac7c]) successfully deleted
I20260505 20:13:49.486938 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:49.487562 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:49.492070 8058 consensus_queue.cc:260] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.495154 9906 raft_consensus.cc:493] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.495340 9906 raft_consensus.cc:515] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.496022 9906 leader_election.cc:290] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:49.395823 9121 ts_tablet_manager.cc:1929] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260505 20:13:49.496881 7598 consensus_peers.cc:597] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 296494f478244052971e12a09f0b15b4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.497103 9121 log.cc:1199] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/1f317f62391b422db2bf2a97ef928f99
I20260505 20:13:49.498700 8058 ts_tablet_manager.cc:1434] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
W20260505 20:13:49.500820 7596 consensus_peers.cc:597] T 624398f68961440f8369a7859b0724c4 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 624398f68961440f8369a7859b0724c4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.502033 8054 tablet_bootstrap.cc:654] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.503057 9121 ts_tablet_manager.cc:1950] T 1f317f62391b422db2bf2a97ef928f99 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:49.483114 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e116486fb4b34e88b564fbb46e8b0faf" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.504206 10221 leader_election.cc:290] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.485486 7737 leader_election.cc:304] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.505625 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 436489e0e72945f689ebd653804e7723 (table default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1]). Expected version 1 got 0
I20260505 20:13:49.506353 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:49.506820 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:49.507072 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:49.507246 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:49.507536 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:49.508108 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67]). Expected version 1 got 0
I20260505 20:13:49.508296 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:49.508581 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:49.508726 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:49.508888 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:49.509021 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:49.509215 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:49.509639 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
W20260505 20:13:49.510099 7596 consensus_peers.cc:597] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56bd0f4254424c979f90da0400e0ec70. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.510257 7596 leader_election.cc:304] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:49.510907 9704 raft_consensus.cc:2764] T 38822ad83f51454f9203fc17ed93a32f P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260505 20:13:49.511271 9704 consensus_queue.cc:1048] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.511636 9704 consensus_queue.cc:1048] T 296494f478244052971e12a09f0b15b4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.512308 9619 raft_consensus.cc:493] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.512437 9619 raft_consensus.cc:515] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.512594 10091 raft_consensus.cc:493] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.512712 10091 raft_consensus.cc:515] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.512954 9619 leader_election.cc:290] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.513180 10091 leader_election.cc:290] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.513244 8058 tablet_bootstrap.cc:492] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.514988 8058 tablet_bootstrap.cc:654] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:49.515146 7737 leader_election.cc:343] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f5dfabb36fa5499780b0d15c71404307
I20260505 20:13:49.487809 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.515497 7785 raft_consensus.cc:2468] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:49.515805 7737 leader_election.cc:304] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.516405 9975 raft_consensus.cc:2749] T 5bdd0cf6cefa43388b22cbd1cee820b6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.516551 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 136) took 12232 ms. Trace:
I20260505 20:13:49.516584 9975 consensus_queue.cc:1048] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.516657 9270 rpcz_store.cc:276] 0505 20:13:37.283999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.284137 (+ 138us) service_pool.cc:224] Handling call
0505 20:13:49.440442 (+12156305us) ts_tablet_manager.cc:1151] Deleting tablet 1e453fdf9a424fe8974076fac3ad74bf
0505 20:13:49.440456 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.460185 (+ 19729us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.465111 (+ 4926us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.516528 (+ 51417us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12156184}
I20260505 20:13:49.517040 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 137) took 12232 ms. Trace:
I20260505 20:13:49.517112 9270 rpcz_store.cc:276] 0505 20:13:37.284408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.284601 (+ 193us) service_pool.cc:224] Handling call
0505 20:13:49.516916 (+12232315us) ts_tablet_manager.cc:1151] Deleting tablet f5dfabb36fa5499780b0d15c71404307
0505 20:13:49.516926 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.517025 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12232191}
I20260505 20:13:49.517175 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 1e453fdf9a424fe8974076fac3ad74bf (table default.Table_e3ca739fcb4a4c14aad90227aeb7ba2f [id=ec71e6a4ae4d45d48362262a5d2bf526]) successfully deleted
I20260505 20:13:49.517385 9270 tablet_replica.cc:333] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.449203 9569 rpcz_store.cc:276] 0505 20:13:41.812572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:41.812645 (+ 73us) service_pool.cc:224] Handling call
0505 20:13:49.101246 (+7288601us) raft_consensus.cc:1471] Updating replica for 158 ops
0505 20:13:49.126491 (+ 25245us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.126496 (+ 5us) write_op.cc:454] Released schema lock
0505 20:13:49.127266 (+ 770us) raft_consensus.cc:1534] Early marking committed up to index 0
0505 20:13:49.127274 (+ 8us) raft_consensus.cc:1539] Triggering prepare for 158 ops
0505 20:13:49.127649 (+ 375us) write_op.cc:270] Start()
0505 20:13:49.127704 (+ 55us) write_op.cc:276] Timestamp: P: 1778012013292768 usec, L: 0
0505 20:13:49.127978 (+ 274us) write_op.cc:270] Start()
0505 20:13:49.128001 (+ 23us) write_op.cc:276] Timestamp: P: 1778012013311606 usec, L: 0
0505 20:13:49.157576 (+ 29575us) write_op.cc:270] Start()
0505 20:13:49.157646 (+ 70us) write_op.cc:276] Timestamp: P: 1778012013312435 usec, L: 0
0505 20:13:49.157945 (+ 299us) write_op.cc:270] Start()
0505 20:13:49.157971 (+ 26us) write_op.cc:276] Timestamp: P: 1778012013313115 usec, L: 0
0505 20:13:49.158110 (+ 139us) write_op.cc:270] Start()
0505 20:13:49.158128 (+ 18us) write_op.cc:276] Timestamp: P: 1778012013313809 usec, L: 0
0505 20:13:49.159573 (+ 1445us) write_op.cc:270] Start()
0505 20:13:49.159605 (+ 32us) write_op.cc:276] Timestamp: P: 1778012013316086 usec, L: 0
0505 20:13:49.159816 (+ 211us) write_op.cc:270] Start()
0505 20:13:49.159846 (+ 30us) write_op.cc:276] Timestamp: P: 1778012013354023 usec, L: 0
0505 20:13:49.159991 (+ 145us) write_op.cc:270] Start()
0505 20:13:49.160011 (+ 20us) write_op.cc:276] Timestamp: P: 1778012013433077 usec, L: 0
0505 20:13:49.160136 (+ 125us) write_op.cc:270] Start()
0505 20:13:49.160173 (+ 37us) write_op.cc:276] Timestamp: P: 1778012013451273 usec, L: 0
0505 20:13:49.160351 (+ 178us) write_op.cc:270] Start()
0505 20:13:49.160370 (+ 19us) write_op.cc:276] Timestamp: P: 1778012013452272 usec, L: 0
0505 20:13:49.160501 (+ 131us) write_op.cc:270] Start()
0505 20:13:49.160520 (+ 19us) write_op.cc:276] Timestamp: P: 1778012013457596 usec, L: 0
0505 20:13:49.160643 (+ 123us) write_op.cc:270] Start()
0505 20:13:49.160660 (+ 17us) write_op.cc:276] Timestamp: P: 1778012013458736 usec, L: 0
0505 20:13:49.160815 (+ 155us) write_op.cc:270] Start()
0505 20:13:49.160834 (+ 19us) write_op.cc:276] Timestamp: P: 1778012013459892 usec, L: 0
0505 20:13:49.160950 (+ 116us) write_op.cc:270] Start()
0505 20:13:49.160966 (+ 16us) write_op.cc:276] Timestamp: P: 1778012013460779 usec, L: 0
0505 20:13:49.161103 (+ 137us) write_op.cc:270] Start()
0505 20:13:49.161122 (+ 19us) write_op.cc:276] Timestamp: P: 1778012013619065 usec, L: 0
0505 20:13:49.161234 (+ 112us) write_op.cc:270] Start()
0505 20:13:49.161252 (+ 18us) write_op.cc:276] Timestamp: P: 1778012013619706 usec, L: 0
0505 20:13:49.161378 (+ 126us) write_op.cc:270] Start()
0505 20:13:49.161402 (+ 24us) write_op.cc:276] Timestamp: P: 1778012013634558 usec, L: 0
0505 20:13:49.161515 (+ 113us) write_op.cc:270] Start()
0505 20:13:49.161533 (+ 18us) write_op.cc:276] Timestamp: P: 1778012013641942 usec, L: 0
0505 20:13:49.161666 (+ 133us) write_op.cc:270] Start()
0505 20:13:49.161683 (+ 17us) write_op.cc:276] Timestamp: P: 1778012013645056 usec, L: 0
0505 20:13:49.204336 (+ 42653us) write_op.cc:270] Start()
0505 20:13:49.204389 (+ 53us) write_op.cc:276] Timestamp: P: 1778012013653949 usec, L: 0
0505 20:13:49.204675 (+ 286us) write_op.cc:270] Start()
0505 20:13:49.204707 (+ 32us) write_op.cc:276] Timestamp: P: 1778012013654654 usec, L: 0
0505 20:13:49.204902 (+ 195us) write_op.cc:270] Start()
0505 20:13:49.204927 (+ 25us) write_op.cc:276] Timestamp: P: 1778012013655326 usec, L: 0
0505 20:13:49.205068 (+ 141us) write_op.cc:270] Start()
0505 20:13:49.212970 (+ 7902us) write_op.cc:276] Timestamp: P: 1778012013667329 usec, L: 0
0505 20:13:49.213290 (+ 320us) write_op.cc:270] Start()
0505 20:13:49.213335 (+ 45us) write_op.cc:276] Timestamp: P: 1778012013694167 usec, L: 0
0505 20:13:49.213551 (+ 216us) write_op.cc:270] Start()
0505 20:13:49.213587 (+ 36us) write_op.cc:276] Timestamp: P: 1778012013704073 usec, L: 0
0505 20:13:49.213822 (+ 235us) write_op.cc:270] Start()
0505 20:13:49.213848 (+ 26us) write_op.cc:276] Timestamp: P: 1778012013707835 usec, L: 0
0505 20:13:49.214013 (+ 165us) write_op.cc:270] Start()
0505 20:13:49.214041 (+ 28us) write_op.cc:276] Timestamp: P: 1778012013708752 usec, L: 0
0505 20:13:49.214195 (+ 154us) write_op.cc:270] Start()
0505 20:13:49.214218 (+ 23us) write_op.cc:276] Timestamp: P: 1778012013725070 usec, L: 0
0505 20:13:49.214393 (+ 175us) write_op.cc:270] Start()
0505 20:13:49.214416 (+ 23us) write_op.cc:276] Timestamp: P: 1778012013734448 usec, L: 0
0505 20:13:49.214592 (+ 176us) write_op.cc:270] Start()
0505 20:13:49.214616 (+ 24us) write_op.cc:276] Timestamp: P: 1778012013753244 usec, L: 0
0505 20:13:49.214782 (+ 166us) write_op.cc:270] Start()
0505 20:13:49.214805 (+ 23us) write_op.cc:276] Timestamp: P: 1778012013774124 usec, L: 0
0505 20:13:49.214948 (+ 143us) write_op.cc:270] Start()
0505 20:13:49.214969 (+ 21us) write_op.cc:276] Timestamp: P: 1778012013796334 usec, L: 0
0505 20:13:49.215147 (+ 178us) write_op.cc:270] Start()
0505 20:13:49.215178 (+ 31us) write_op.cc:276] Timestamp: P: 1778012013808009 usec, L: 0
0505 20:13:49.215322 (+ 144us) write_op.cc:270] Start()
0505 20:13:49.215346 (+ 24us) write_op.cc:276] Timestamp: P: 1778012013881654 usec, L: 0
0505 20:13:49.244389 (+ 29043us) write_op.cc:270] Start()
0505 20:13:49.244436 (+ 47us) write_op.cc:276] Timestamp: P: 1778012014291322 usec, L: 0
0505 20:13:49.244672 (+ 236us) write_op.cc:270] Start()
0505 20:13:49.244721 (+ 49us) write_op.cc:276] Timestamp: P: 1778012014452612 usec, L: 0
0505 20:13:49.244876 (+ 155us) write_op.cc:270] Start()
0505 20:13:49.244919 (+ 43us) write_op.cc:276] Timestamp: P: 1778012014463179 usec, L: 0
0505 20:13:49.245088 (+ 169us) write_op.cc:270] Start()
0505 20:13:49.245110 (+ 22us) write_op.cc:276] Timestamp: P: 1778012014463832 usec, L: 0
0505 20:13:49.245274 (+ 164us) write_op.cc:270] Start()
0505 20:13:49.246210 (+ 936us) write_op.cc:276] Timestamp: P: 1778012014486507 usec, L: 0
0505 20:13:49.246443 (+ 233us) write_op.cc:270] Start()
0505 20:13:49.246473 (+ 30us) write_op.cc:276] Timestamp: P: 1778012014577047 usec, L: 0
0505 20:13:49.246633 (+ 160us) write_op.cc:270] Start()
0505 20:13:49.246655 (+ 22us) write_op.cc:276] Timestamp: P: 1778012014642350 usec, L: 0
0505 20:13:49.246818 (+ 163us) write_op.cc:270] Start()
0505 20:13:49.246839 (+ 21us) write_op.cc:276] Timestamp: P: 1778012014723729 usec, L: 0
0505 20:13:49.246972 (+ 133us) write_op.cc:270] Start()
0505 20:13:49.246991 (+ 19us) write_op.cc:276] Timestamp: P: 1778012014764985 usec, L: 0
0505 20:13:49.247127 (+ 136us) write_op.cc:270] Start()
0505 20:13:49.247146 (+ 19us) write_op.cc:276] Timestamp: P: 1778012014795179 usec, L: 0
0505 20:13:49.247305 (+ 159us) write_op.cc:270] Start()
0505 20:13:49.247326 (+ 21us) write_op.cc:276] Timestamp: P: 1778012014815433 usec, L: 0
0505 20:13:49.247470 (+ 144us) write_op.cc:270] Start()
0505 20:13:49.247490 (+ 20us) write_op.cc:276] Timestamp: P: 1778012014837473 usec, L: 0
0505 20:13:49.247632 (+ 142us) write_op.cc:270] Start()
0505 20:13:49.247654 (+ 22us) write_op.cc:276] Timestamp: P: 1778012014871405 usec, L: 0
0505 20:13:49.247852 (+ 198us) write_op.cc:270] Start()
0505 20:13:49.247874 (+ 22us) write_op.cc:276] Timestamp: P: 1778012014886960 usec, L: 0
0505 20:13:49.248014 (+ 140us) write_op.cc:270] Start()
0505 20:13:49.248034 (+ 20us) write_op.cc:276] Timestamp: P: 1778012014901207 usec, L: 0
0505 20:13:49.248327 (+ 293us) write_op.cc:270] Start()
0505 20:13:49.248354 (+ 27us) write_op.cc:276] Timestamp: P: 1778012014918682 usec, L: 0
0505 20:13:49.248490 (+ 136us) write_op.cc:270] Start()
0505 20:13:49.248510 (+ 20us) write_op.cc:276] Timestamp: P: 1778012014920025 usec, L: 0
0505 20:13:49.248681 (+ 171us) write_op.cc:270] Start()
0505 20:13:49.248716 (+ 35us) write_op.cc:276] Timestamp: P: 1778012014946622 usec, L: 0
0505 20:13:49.248866 (+ 150us) write_op.cc:270] Start()
0505 20:13:49.256469 (+ 7603us) write_op.cc:276] Timestamp: P: 1778012014954364 usec, L: 0
0505 20:13:49.266827 (+ 10358us) write_op.cc:270] Start()
0505 20:13:49.266869 (+ 42us) write_op.cc:276] Timestamp: P: 1778012014955080 usec, L: 0
0505 20:13:49.267041 (+ 172us) write_op.cc:270] Start()
0505 20:13:49.267062 (+ 21us) write_op.cc:276] Timestamp: P: 1778012014955618 usec, L: 0
0505 20:13:49.267185 (+ 123us) write_op.cc:270] Start()
0505 20:13:49.267203 (+ 18us) write_op.cc:276] Timestamp: P: 1778012015032115 usec, L: 0
0505 20:13:49.267317 (+ 114us) write_op.cc:270] Start()
0505 20:13:49.267336 (+ 19us) write_op.cc:276] Timestamp: P: 1778012015052725 usec, L: 0
0505 20:13:49.269412 (+ 2076us) write_op.cc:270] Start()
0505 20:13:49.269450 (+ 38us) write_op.cc:276] Timestamp: P: 1778012015378026 usec, L: 0
0505 20:13:49.269669 (+ 219us) write_op.cc:270] Start()
0505 20:13:49.269695 (+ 26us) write_op.cc:276] Timestamp: P: 1778012015852828 usec, L: 0
0505 20:13:49.269891 (+ 196us) write_op.cc:270] Start()
0505 20:13:49.269915 (+ 24us) write_op.cc:276] Timestamp: P: 1778012015908348 usec, L: 0
0505 20:13:49.270078 (+ 163us) write_op.cc:270] Start()
0505 20:13:49.270101 (+ 23us) write_op.cc:276] Timestamp: P: 1778012016161083 usec, L: 0
0505 20:13:49.270253 (+ 152us) write_op.cc:270] Start()
0505 20:13:49.270275 (+ 22us) write_op.cc:276] Timestamp: P: 1778012016177569 usec, L: 0
0505 20:13:49.270418 (+ 143us) write_op.cc:270] Start()
0505 20:13:49.270441 (+ 23us) write_op.cc:276] Timestamp: P: 1778012016190395 usec, L: 0
0505 20:13:49.270581 (+ 140us) write_op.cc:270] Start()
0505 20:13:49.270603 (+ 22us) write_op.cc:276] Timestamp: P: 1778012016217705 usec, L: 0
0505 20:13:49.270788 (+ 185us) write_op.cc:270] Start()
0505 20:13:49.270810 (+ 22us) write_op.cc:276] Timestamp: P: 1778012016752346 usec, L: 0
0505 20:13:49.270988 (+ 178us) write_op.cc:270] Start()
0505 20:13:49.271011 (+ 23us) write_op.cc:276] Timestamp: P: 1778012017216430 usec, L: 0
0505 20:13:49.271193 (+ 182us) write_op.cc:270] Start()
0505 20:13:49.271218 (+ 25us) write_op.cc:276] Timestamp: P: 1778012017251551 usec, L: 0
0505 20:13:49.271365 (+ 147us) write_op.cc:270] Start()
0505 20:13:49.271388 (+ 23us) write_op.cc:276] Timestamp: P: 1778012017374555 usec, L: 0
0505 20:13:49.271531 (+ 143us) write_op.cc:270] Start()
0505 20:13:49.271552 (+ 21us) write_op.cc:276] Timestamp: P: 1778012017464226 usec, L: 0
0505 20:13:49.286215 (+ 14663us) write_op.cc:270] Start()
0505 20:13:49.286282 (+ 67us) write_op.cc:276] Timestamp: P: 1778012017496517 usec, L: 0
0505 20:13:49.286575 (+ 293us) write_op.cc:270] Start()
0505 20:13:49.286607 (+ 32us) write_op.cc:276] Timestamp: P: 1778012017499495 usec, L: 0
0505 20:13:49.286788 (+ 181us) write_op.cc:270] Start()
0505 20:13:49.286813 (+ 25us) write_op.cc:276] Timestamp: P: 1778012017512806 usec, L: 0
0505 20:13:49.286984 (+ 171us) write_op.cc:270] Start()
0505 20:13:49.287007 (+ 23us) write_op.cc:276] Timestamp: P: 1778012017513699 usec, L: 0
0505 20:13:49.287149 (+ 142us) write_op.cc:270] Start()
0505 20:13:49.287173 (+ 24us) write_op.cc:276] Timestamp: P: 1778012017524026 usec, L: 0
0505 20:13:49.287325 (+ 152us) write_op.cc:270] Start()
0505 20:13:49.287348 (+ 23us) write_op.cc:276] Timestamp: P: 1778012017607911 usec, L: 0
0505 20:13:49.287521 (+ 173us) write_op.cc:270] Start()
0505 20:13:49.287545 (+ 24us) write_op.cc:276] Timestamp: P: 1778012017610170 usec, L: 0
0505 20:13:49.287752 (+ 207us) write_op.cc:270] Start()
0505 20:13:49.287778 (+ 26us) write_op.cc:276] Timestamp: P: 1778012017611353 usec, L: 0
0505 20:13:49.287922 (+ 144us) write_op.cc:270] Start()
0505 20:13:49.287943 (+ 21us) write_op.cc:276] Timestamp: P: 1778012017675932 usec, L: 0
0505 20:13:49.288091 (+ 148us) write_op.cc:270] Start()
0505 20:13:49.288140 (+ 49us) write_op.cc:276] Timestamp: P: 1778012017686357 usec, L: 0
0505 20:13:49.288334 (+ 194us) write_op.cc:270] Start()
0505 20:13:49.288356 (+ 22us) write_op.cc:276] Timestamp: P: 1778012017690105 usec, L: 0
0505 20:13:49.288487 (+ 131us) write_op.cc:270] Start()
0505 20:13:49.288509 (+ 22us) write_op.cc:276] Timestamp: P: 1778012017705751 usec, L: 0
0505 20:13:49.288653 (+ 144us) write_op.cc:270] Start()
0505 20:13:49.288675 (+ 22us) write_op.cc:276] Timestamp: P: 1778012017813343 usec, L: 0
0505 20:13:49.288819 (+ 144us) write_op.cc:270] Start()
0505 20:13:49.288840 (+ 21us) write_op.cc:276] Timestamp: P: 1778012017814664 usec, L: 0
0505 20:13:49.288998 (+ 158us) write_op.cc:270] Start()
0505 20:13:49.289020 (+ 22us) write_op.cc:276] Timestamp: P: 1778012017815283 usec, L: 0
0505 20:13:49.289163 (+ 143us) write_op.cc:270] Start()
0505 20:13:49.289179 (+ 16us) write_op.cc:276] Timestamp: P: 1778012017838733 usec, L: 0
0505 20:13:49.289313 (+ 134us) write_op.cc:270] Start()
0505 20:13:49.289336 (+ 23us) write_op.cc:276] Timestamp: P: 1778012017849240 usec, L: 0
0505 20:13:49.289475 (+ 139us) write_op.cc:270] Start()
0505 20:13:49.289498 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018098827 usec, L: 0
0505 20:13:49.289648 (+ 150us) write_op.cc:270] Start()
0505 20:13:49.289673 (+ 25us) write_op.cc:276] Timestamp: P: 1778012018150006 usec, L: 0
0505 20:13:49.306065 (+ 16392us) write_op.cc:270] Start()
0505 20:13:49.306117 (+ 52us) write_op.cc:276] Timestamp: P: 1778012018515114 usec, L: 0
0505 20:13:49.306350 (+ 233us) write_op.cc:270] Start()
0505 20:13:49.306376 (+ 26us) write_op.cc:276] Timestamp: P: 1778012018532658 usec, L: 0
0505 20:13:49.306541 (+ 165us) write_op.cc:270] Start()
0505 20:13:49.306566 (+ 25us) write_op.cc:276] Timestamp: P: 1778012018533304 usec, L: 0
0505 20:13:49.306748 (+ 182us) write_op.cc:270] Start()
0505 20:13:49.306770 (+ 22us) write_op.cc:276] Timestamp: P: 1778012018555669 usec, L: 0
0505 20:13:49.306971 (+ 201us) write_op.cc:270] Start()
0505 20:13:49.307001 (+ 30us) write_op.cc:276] Timestamp: P: 1778012018556311 usec, L: 0
0505 20:13:49.307160 (+ 159us) write_op.cc:270] Start()
0505 20:13:49.307221 (+ 61us) write_op.cc:276] Timestamp: P: 1778012018565841 usec, L: 0
0505 20:13:49.307363 (+ 142us) write_op.cc:270] Start()
0505 20:13:49.307386 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018641302 usec, L: 0
0505 20:13:49.307543 (+ 157us) write_op.cc:270] Start()
0505 20:13:49.307567 (+ 24us) write_op.cc:276] Timestamp: P: 1778012018642309 usec, L: 0
0505 20:13:49.307719 (+ 152us) write_op.cc:270] Start()
0505 20:13:49.307749 (+ 30us) write_op.cc:276] Timestamp: P: 1778012018643154 usec, L: 0
0505 20:13:49.307918 (+ 169us) write_op.cc:270] Start()
0505 20:13:49.307942 (+ 24us) write_op.cc:276] Timestamp: P: 1778012018818494 usec, L: 0
0505 20:13:49.308079 (+ 137us) write_op.cc:270] Start()
0505 20:13:49.308102 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018820679 usec, L: 0
0505 20:13:49.308237 (+ 135us) write_op.cc:270] Start()
0505 20:13:49.308259 (+ 22us) write_op.cc:276] Timestamp: P: 1778012018845286 usec, L: 0
0505 20:13:49.308430 (+ 171us) write_op.cc:270] Start()
0505 20:13:49.308450 (+ 20us) write_op.cc:276] Timestamp: P: 1778012018846917 usec, L: 0
0505 20:13:49.308615 (+ 165us) write_op.cc:270] Start()
0505 20:13:49.308638 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018879060 usec, L: 0
0505 20:13:49.308795 (+ 157us) write_op.cc:270] Start()
0505 20:13:49.308818 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018906387 usec, L: 0
0505 20:13:49.308957 (+ 139us) write_op.cc:270] Start()
0505 20:13:49.308980 (+ 23us) write_op.cc:276] Timestamp: P: 1778012018922444 usec, L: 0
0505 20:13:49.309112 (+ 132us) write_op.cc:270] Start()
0505 20:13:49.309154 (+ 42us) write_op.cc:276] Timestamp: P: 1778012018952002 usec, L: 0
0505 20:13:49.309303 (+ 149us) write_op.cc:270] Start()
0505 20:13:49.309339 (+ 36us) write_op.cc:276] Timestamp: P: 1778012019124432 usec, L: 0
0505 20:13:49.309496 (+ 157us) write_op.cc:270] Start()
0505 20:13:49.309520 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019156542 usec, L: 0
0505 20:13:49.309713 (+ 193us) write_op.cc:270] Start()
0505 20:13:49.325394 (+ 15681us) write_op.cc:276] Timestamp: P: 1778012019160194 usec, L: 0
0505 20:13:49.325761 (+ 367us) write_op.cc:270] Start()
0505 20:13:49.325809 (+ 48us) write_op.cc:276] Timestamp: P: 1778012019188182 usec, L: 0
0505 20:13:49.325986 (+ 177us) write_op.cc:270] Start()
0505 20:13:49.326013 (+ 27us) write_op.cc:276] Timestamp: P: 1778012019195576 usec, L: 0
0505 20:13:49.326174 (+ 161us) write_op.cc:270] Start()
0505 20:13:49.326197 (+ 23us) write_op.cc:276] Timestamp: P: 1778012019238286 usec, L: 0
0505 20:13:49.326366 (+ 169us) write_op.cc:270] Start()
0505 20:13:49.326401 (+ 35us) write_op.cc:276] Timestamp: P: 1778012019256227 usec, L: 0
0505 20:13:49.326580 (+ 179us) write_op.cc:270] Start()
0505 20:13:49.326604 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019258149 usec, L: 0
0505 20:13:49.326778 (+ 174us) write_op.cc:270] Start()
0505 20:13:49.326802 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019260906 usec, L: 0
0505 20:13:49.326945 (+ 143us) write_op.cc:270] Start()
0505 20:13:49.326968 (+ 23us) write_op.cc:276] Timestamp: P: 1778012019264914 usec, L: 0
0505 20:13:49.327123 (+ 155us) write_op.cc:270] Start()
0505 20:13:49.327147 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019344286 usec, L: 0
0505 20:13:49.327317 (+ 170us) write_op.cc:270] Start()
0505 20:13:49.327341 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019414613 usec, L: 0
0505 20:13:49.327530 (+ 189us) write_op.cc:270] Start()
0505 20:13:49.327555 (+ 25us) write_op.cc:276] Timestamp: P: 1778012019441290 usec, L: 0
0505 20:13:49.327753 (+ 198us) write_op.cc:270] Start()
0505 20:13:49.327777 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019441984 usec, L: 0
0505 20:13:49.327956 (+ 179us) write_op.cc:270] Start()
0505 20:13:49.327981 (+ 25us) write_op.cc:276] Timestamp: P: 1778012019442682 usec, L: 0
0505 20:13:49.328122 (+ 141us) write_op.cc:270] Start()
0505 20:13:49.328146 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019468427 usec, L: 0
0505 20:13:49.328302 (+ 156us) write_op.cc:270] Start()
0505 20:13:49.328325 (+ 23us) write_op.cc:276] Timestamp: P: 1778012019510387 usec, L: 0
0505 20:13:49.328464 (+ 139us) write_op.cc:270] Start()
0505 20:13:49.328487 (+ 23us) write_op.cc:276] Timestamp: P: 1778012019617011 usec, L: 0
0505 20:13:49.328635 (+ 148us) write_op.cc:270] Start()
0505 20:13:49.328659 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019618951 usec, L: 0
0505 20:13:49.328868 (+ 209us) write_op.cc:270] Start()
0505 20:13:49.328918 (+ 50us) write_op.cc:276] Timestamp: P: 1778012019619903 usec, L: 0
0505 20:13:49.329087 (+ 169us) write_op.cc:270] Start()
0505 20:13:49.329110 (+ 23us) write_op.cc:276] Timestamp: P: 1778012019643690 usec, L: 0
0505 20:13:49.329279 (+ 169us) write_op.cc:270] Start()
0505 20:13:49.329299 (+ 20us) write_op.cc:276] Timestamp: P: 1778012019645287 usec, L: 0
0505 20:13:49.329427 (+ 128us) write_op.cc:270] Start()
0505 20:13:49.329446 (+ 19us) write_op.cc:276] Timestamp: P: 1778012019646100 usec, L: 0
0505 20:13:49.329644 (+ 198us) write_op.cc:270] Start()
0505 20:13:49.329676 (+ 32us) write_op.cc:276] Timestamp: P: 1778012019659993 usec, L: 0
0505 20:13:49.346377 (+ 16701us) write_op.cc:270] Start()
0505 20:13:49.346425 (+ 48us) write_op.cc:276] Timestamp: P: 1778012019669511 usec, L: 0
0505 20:13:49.346667 (+ 242us) write_op.cc:270] Start()
0505 20:13:49.346702 (+ 35us) write_op.cc:276] Timestamp: P: 1778012019687974 usec, L: 0
0505 20:13:49.346863 (+ 161us) write_op.cc:270] Start()
0505 20:13:49.346883 (+ 20us) write_op.cc:276] Timestamp: P: 1778012019710632 usec, L: 0
0505 20:13:49.347018 (+ 135us) write_op.cc:270] Start()
0505 20:13:49.347044 (+ 26us) write_op.cc:276] Timestamp: P: 1778012019881056 usec, L: 0
0505 20:13:49.347165 (+ 121us) write_op.cc:270] Start()
0505 20:13:49.347183 (+ 18us) write_op.cc:276] Timestamp: P: 1778012019891711 usec, L: 0
0505 20:13:49.347340 (+ 157us) write_op.cc:270] Start()
0505 20:13:49.347367 (+ 27us) write_op.cc:276] Timestamp: P: 1778012019901669 usec, L: 0
0505 20:13:49.347508 (+ 141us) write_op.cc:270] Start()
0505 20:13:49.347532 (+ 24us) write_op.cc:276] Timestamp: P: 1778012019911048 usec, L: 0
0505 20:13:49.347659 (+ 127us) write_op.cc:270] Start()
0505 20:13:49.347689 (+ 30us) write_op.cc:276] Timestamp: P: 1778012019960242 usec, L: 0
0505 20:13:49.347851 (+ 162us) write_op.cc:270] Start()
0505 20:13:49.347873 (+ 22us) write_op.cc:276] Timestamp: P: 1778012019974617 usec, L: 0
0505 20:13:49.348001 (+ 128us) write_op.cc:270] Start()
0505 20:13:49.348019 (+ 18us) write_op.cc:276] Timestamp: P: 1778012019986434 usec, L: 0
0505 20:13:49.348145 (+ 126us) write_op.cc:270] Start()
0505 20:13:49.348162 (+ 17us) write_op.cc:276] Timestamp: P: 1778012019995661 usec, L: 0
0505 20:13:49.348294 (+ 132us) write_op.cc:270] Start()
0505 20:13:49.348312 (+ 18us) write_op.cc:276] Timestamp: P: 1778012020002781 usec, L: 0
0505 20:13:49.348446 (+ 134us) write_op.cc:270] Start()
0505 20:13:49.348465 (+ 19us) write_op.cc:276] Timestamp: P: 1778012020012923 usec, L: 0
0505 20:13:49.348632 (+ 167us) write_op.cc:270] Start()
0505 20:13:49.348653 (+ 21us) write_op.cc:276] Timestamp: P: 1778012020034221 usec, L: 0
0505 20:13:49.348803 (+ 150us) write_op.cc:270] Start()
0505 20:13:49.348822 (+ 19us) write_op.cc:276] Timestamp: P: 1778012020048195 usec, L: 0
0505 20:13:49.348947 (+ 125us) write_op.cc:270] Start()
0505 20:13:49.348967 (+ 20us) write_op.cc:276] Timestamp: P: 1778012020049378 usec, L: 0
0505 20:13:49.349100 (+ 133us) write_op.cc:270] Start()
0505 20:13:49.349121 (+ 21us) write_op.cc:276] Timestamp: P: 1778012020049993 usec, L: 0
0505 20:13:49.349239 (+ 118us) write_op.cc:270] Start()
0505 20:13:49.349258 (+ 19us) write_op.cc:276] Timestamp: P: 1778012020050844 usec, L: 0
0505 20:13:49.349392 (+ 134us) write_op.cc:270] Start()
0505 20:13:49.349410 (+ 18us) write_op.cc:276] Timestamp: P: 1778012020055520 usec, L: 0
0505 20:13:49.349554 (+ 144us) write_op.cc:270] Start()
0505 20:13:49.349575 (+ 21us) write_op.cc:276] Timestamp: P: 1778012020130369 usec, L: 0
0505 20:13:49.349707 (+ 132us) write_op.cc:270] Start()
0505 20:13:49.349724 (+ 17us) write_op.cc:276] Timestamp: P: 1778012020132324 usec, L: 0
0505 20:13:49.363651 (+ 13927us) write_op.cc:270] Start()
0505 20:13:49.363712 (+ 61us) write_op.cc:276] Timestamp: P: 1778012020133355 usec, L: 0
0505 20:13:49.363957 (+ 245us) write_op.cc:270] Start()
0505 20:13:49.363984 (+ 27us) write_op.cc:276] Timestamp: P: 1778012020134183 usec, L: 0
0505 20:13:49.364137 (+ 153us) write_op.cc:270] Start()
0505 20:13:49.364162 (+ 25us) write_op.cc:276] Timestamp: P: 1778012020153024 usec, L: 0
0505 20:13:49.364326 (+ 164us) write_op.cc:270] Start()
0505 20:13:49.364349 (+ 23us) write_op.cc:276] Timestamp: P: 1778012020158622 usec, L: 0
0505 20:13:49.364516 (+ 167us) write_op.cc:270] Start()
0505 20:13:49.364541 (+ 25us) write_op.cc:276] Timestamp: P: 1778012020187866 usec, L: 0
0505 20:13:49.364723 (+ 182us) write_op.cc:270] Start()
0505 20:13:49.364746 (+ 23us) write_op.cc:276] Timestamp: P: 1778012020424288 usec, L: 0
0505 20:13:49.371745 (+ 6999us) write_op.cc:270] Start()
0505 20:13:49.371801 (+ 56us) write_op.cc:276] Timestamp: P: 1778012020473283 usec, L: 0
0505 20:13:49.398440 (+ 26639us) log.cc:844] Serialized 112889 byte log entry
0505 20:13:49.410078 (+ 11638us) raft_consensus.cc:1645] Marking committed up to 760
0505 20:13:49.410265 (+ 187us) log.cc:844] Serialized 15 byte log entry
0505 20:13:49.429850 (+ 19585us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.429862 (+ 12us) write_op.cc:454] Released schema lock
0505 20:13:49.439101 (+ 9239us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.439107 (+ 6us) write_op.cc:454] Released schema lock
0505 20:13:49.442342 (+ 3235us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.442347 (+ 5us) write_op.cc:454] Released schema lock
0505 20:13:49.444881 (+ 2534us) raft_consensus.cc:1697] Filling consensus response to leader.
0505 20:13:49.444939 (+ 58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0505 20:13:49.444971 (+ 32us) raft_consensus.cc:1685] finished
0505 20:13:49.444977 (+ 6us) raft_consensus.cc:1691] UpdateReplicas() finished
0505 20:13:49.445148 (+ 171us) inbound_call.cc:177] Queueing success response
0505 20:13:49.445461 (+ 313us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x616000021154. stack: 00007f55bac98086 00007f55bac97e40 00007f55b9c513ad 000000000099adb4 000000000099ad7d 00007f55ca02e6bd 00007f55ca02e7b3 00007f55c6becb21 00007f55ceb10665 00007f55ceb244c5 00007f55ceb24271 00007f55c7f6dc9d 00007f55c6bfd92e 00007f55c6bfd67d 0000000000aa4cac 00007f55bacddf6f
0505 20:13:49.445591 (+ 130us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x616000021154. stack: 00007f55bac98086 00007f55bac97e40 00007f55b9c513ad 000000000099adb4 000000000099ad7d 00007f55ca02e6bd 00007f55ca02e7b3 00007f55c6becb21 00007f55ceb10665 00007f55ceb244c5 00007f55ceb24271 00007f55c7f6dc9d 00007f55c6bfd92e 00007f55c6bfd67d 0000000000aa4cac 00007f55bacddf6f
Related trace 'op':
0505 20:13:49.127876 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:49.128026 (+ 150us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:49.128031 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:49.128033 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:49.128150 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:49.128169 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:49.128177 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:49.128272 (+ 95us) tablet.cc:701] Row locks acquired
0505 20:13:49.128276 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:49.417917 (+289641us) op_driver.cc:464] REPLICATION: finished
0505 20:13:49.423976 (+ 6059us) write_op.cc:301] APPLY: starting
0505 20:13:49.424010 (+ 34us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:49.424388 (+ 378us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:49.424393 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:49.424517 (+ 124us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:49.424755 (+ 238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:49.424862 (+ 107us) write_op.cc:312] APPLY: finished
0505 20:13:49.425158 (+ 296us) log.cc:844] Serialized 23 byte log entry
0505 20:13:49.425433 (+ 275us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.425473 (+ 40us) write_op.cc:454] Released schema lock
0505 20:13:49.425490 (+ 17us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0505 20:13:49.128364 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:49.128487 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:49.128495 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:49.128499 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:49.128699 (+ 200us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:49.128734 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:49.128740 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:49.128855 (+ 115us) tablet.cc:701] Row locks acquired
0505 20:13:49.128858 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:49.430043 (+301185us) op_driver.cc:464] REPLICATION: finished
0505 20:13:49.434382 (+ 4339us) write_op.cc:301] APPLY: starting
0505 20:13:49.434401 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:49.434469 (+ 68us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:49.434474 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:49.434570 (+ 96us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:49.434654 (+ 84us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:49.434699 (+ 45us) write_op.cc:312] APPLY: finished
0505 20:13:49.434797 (+ 98us) log.cc:844] Serialized 29 byte log entry
0505 20:13:49.434895 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.434917 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:49.434925 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:49.434981 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:49.434985 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0505 20:13:49.157916 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:49.158108 (+ 192us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:49.158118 (+ 10us) write_op.cc:435] Acquired schema lock
0505 20:13:4
W20260505 20:13:49.517493 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet f5dfabb36fa5499780b0d15c71404307 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5dfabb36fa5499780b0d15c71404307 already in progress: creating tablet
I20260505 20:13:49.517534 9894 raft_consensus.cc:2749] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.517582 9270 raft_consensus.cc:2243] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.517735 9270 raft_consensus.cc:2272] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.518412 9270 ts_tablet_manager.cc:1916] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.520102 10234 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f4615fa5639440fc820498f897adf17d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:49.520344 10234 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [sys.catalog]: This master's current role is: LEADER
W20260505 20:13:49.521363 7737 leader_election.cc:343] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1aaff49cb0ff4298be24603b2015c8a4
I20260505 20:13:49.521528 7737 leader_election.cc:304] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.521919 9894 raft_consensus.cc:2749] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:49.525080 7737 leader_election.cc:343] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 172cd9f38dd8491ea3ecf42b680d398f
I20260505 20:13:49.525228 7737 leader_election.cc:304] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.525945 9894 raft_consensus.cc:2749] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:49.526227 9894 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:49.526350 9894 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.526895 9894 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.500630 9271 ts_tablet_manager.cc:1929] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.527355 9271 log.cc:1199] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8c8754580368453aa0aae021d8c665da
I20260505 20:13:49.527805 9271 ts_tablet_manager.cc:1950] T 8c8754580368453aa0aae021d8c665da P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.529312 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.502786 8053 tablet_bootstrap.cc:492] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.529486 7921 raft_consensus.cc:2468] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.529618 8053 ts_tablet_manager.cc:1403] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20260505 20:13:49.530269 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede080523cb1482d8a531f4044164475" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:49.530412 7921 raft_consensus.cc:3060] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.530352 8053 raft_consensus.cc:359] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.530499 8053 raft_consensus.cc:385] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.530543 8053 raft_consensus.cc:740] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.530725 8053 consensus_queue.cc:260] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.531270 8053 ts_tablet_manager.cc:1434] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.531533 8053 tablet_bootstrap.cc:492] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.532990 7921 raft_consensus.cc:2468] T ede080523cb1482d8a531f4044164475 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.533228 8053 tablet_bootstrap.cc:654] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.534534 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 150) took 12146 ms. Trace:
I20260505 20:13:49.534621 9271 rpcz_store.cc:276] 0505 20:13:37.387971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.388001 (+ 30us) service_pool.cc:224] Handling call
0505 20:13:49.480736 (+12092735us) ts_tablet_manager.cc:1151] Deleting tablet 8c8754580368453aa0aae021d8c665da
0505 20:13:49.480745 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.484650 (+ 3905us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.500550 (+ 15900us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.534516 (+ 33966us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12092623}
I20260505 20:13:49.535478 9271 tablet_replica.cc:333] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.535662 9271 raft_consensus.cc:2243] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.535794 9271 raft_consensus.cc:2272] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.536240 9271 ts_tablet_manager.cc:1916] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.537124 9894 raft_consensus.cc:493] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.537223 9894 raft_consensus.cc:515] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.537925 9894 leader_election.cc:290] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:49.538861 7737 leader_election.cc:343] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e69bdfc75a494635837178cb16c08c1c
I20260505 20:13:49.539021 7737 leader_election.cc:304] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.539407 9894 raft_consensus.cc:2749] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:49.539898 9894 consensus_queue.cc:1048] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.541103 9975 consensus_queue.cc:1048] T 9845d42fafa14457bd6c54d7477786aa P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:49.542083 7737 leader_election.cc:343] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 296494f478244052971e12a09f0b15b4
I20260505 20:13:49.542285 7737 leader_election.cc:304] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.542529 9975 raft_consensus.cc:2749] T 296494f478244052971e12a09f0b15b4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.543008 9975 consensus_queue.cc:1048] T a25cb36420534396a0850aef61706ae1 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:49.543612 7737 consensus_peers.cc:597] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0ca8cc557674992b88f3379cc1db652. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.549686 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 169) took 11710 ms. Trace:
I20260505 20:13:49.553925 8058 tablet_bootstrap.cc:492] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.554081 8058 ts_tablet_manager.cc:1403] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260505 20:13:49.554255 9121 rpcz_store.cc:276] 0505 20:13:37.838924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.839474 (+ 550us) service_pool.cc:224] Handling call
0505 20:13:49.198780 (+11359306us) ts_tablet_manager.cc:1151] Deleting tablet 1f317f62391b422db2bf2a97ef928f99
0505 20:13:49.198796 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.392965 (+194169us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.395765 (+ 2800us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.549655 (+153890us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45637,"tablet-delete.queue_time_us":11359118}
I20260505 20:13:49.554901 8058 raft_consensus.cc:359] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.555063 8058 raft_consensus.cc:385] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.555117 8058 raft_consensus.cc:740] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.555290 8058 consensus_queue.cc:260] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.557080 9121 tablet_replica.cc:333] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:49.558199 8058 ts_tablet_manager.cc:1434] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:49.558491 8058 tablet_bootstrap.cc:492] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.558727 9121 raft_consensus.cc:2243] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.560108 8058 tablet_bootstrap.cc:654] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.546684 10252 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260505 20:13:49.568243 9271 ts_tablet_manager.cc:1929] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.568379 9271 log.cc:1199] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/17acb52d6cde4ced988506cee48eb040
I20260505 20:13:49.568733 9271 ts_tablet_manager.cc:1950] T 17acb52d6cde4ced988506cee48eb040 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.569523 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 138) took 12182 ms. Trace:
I20260505 20:13:49.558943 8054 tablet_bootstrap.cc:492] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.570004 8054 ts_tablet_manager.cc:1403] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.000s
I20260505 20:13:49.570750 8054 raft_consensus.cc:359] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.571059 8054 raft_consensus.cc:385] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.571151 8054 raft_consensus.cc:740] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.571468 8054 consensus_queue.cc:260] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.572062 8054 ts_tablet_manager.cc:1434] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.572376 8054 tablet_bootstrap.cc:492] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.573688 8054 tablet_bootstrap.cc:654] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.575955 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.576242 7921 raft_consensus.cc:2468] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.577606 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.577869 7921 raft_consensus.cc:2468] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.578397 9121 raft_consensus.cc:2272] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.578434 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.578970 9121 ts_tablet_manager.cc:1916] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.580515 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:49.580711 7921 raft_consensus.cc:3060] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.583540 7921 raft_consensus.cc:2468] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.586768 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.586936 7928 raft_consensus.cc:2468] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.588193 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 1f317f62391b422db2bf2a97ef928f99 (table default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]) successfully deleted
I20260505 20:13:49.593171 10167 raft_consensus.cc:493] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.593441 10167 raft_consensus.cc:515] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.594552 10167 leader_election.cc:290] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:49.596093 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ede080523cb1482d8a531f4044164475" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.596307 7663 raft_consensus.cc:3060] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.599699 7663 raft_consensus.cc:2468] T ede080523cb1482d8a531f4044164475 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.604841 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.607990 10258 raft_consensus.cc:493] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.608263 10258 raft_consensus.cc:515] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.609163 10258 leader_election.cc:290] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.611431 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.614058 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.614830 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.615087 7663 raft_consensus.cc:3060] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.619681 7663 raft_consensus.cc:2468] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.620397 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.620661 7662 raft_consensus.cc:2468] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:49.620966 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.621178 7652 raft_consensus.cc:2468] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.624318 7652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432b497141ed46ba9112b2b74f895238" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.626492 9906 raft_consensus.cc:493] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:49.626801 9906 raft_consensus.cc:515] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.627614 9906 leader_election.cc:290] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.630749 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.633538 10221 raft_consensus.cc:493] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.633733 10221 raft_consensus.cc:515] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.634636 10221 leader_election.cc:290] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.636897 9975 consensus_queue.cc:1048] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.637336 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.637533 7661 raft_consensus.cc:2468] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:49.637624 7736 leader_election.cc:343] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.638038 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.639302 8058 tablet_bootstrap.cc:492] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.639568 8053 tablet_bootstrap.cc:492] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.639698 8053 ts_tablet_manager.cc:1403] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.000s
I20260505 20:13:49.639942 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:49.640473 8053 raft_consensus.cc:359] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.640699 8053 raft_consensus.cc:385] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.640753 8053 raft_consensus.cc:740] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.640978 8053 consensus_queue.cc:260] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.641614 8053 ts_tablet_manager.cc:1434] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:49.643035 8054 tablet_bootstrap.cc:492] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.643217 8054 ts_tablet_manager.cc:1403] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.002s
I20260505 20:13:49.645452 10091 consensus_queue.cc:1048] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.647131 8058 ts_tablet_manager.cc:1403] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.002s
I20260505 20:13:49.648021 8058 raft_consensus.cc:359] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.653306 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaff49cb0ff4298be24603b2015c8a4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.653489 7785 raft_consensus.cc:2468] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:49.654413 10091 consensus_queue.cc:1048] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.654469 9975 consensus_queue.cc:1048] T ab52fb4e7c73420fa58cb6da23372adc P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.655275 10197 mvcc.cc:204] Tried to move back new op lower bound from 7282737235858567168 to 7282737200491700224. Current Snapshot: MvccSnapshot[applied={T|T < 7282737235858567168 or (T in {7282737235858567168})}]
I20260505 20:13:49.640656 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:49.655908 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:49.657795 7736 leader_election.cc:304] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
W20260505 20:13:49.658174 7736 leader_election.cc:343] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.658463 7736 leader_election.cc:343] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.658561 7870 leader_election.cc:343] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.658798 7869 leader_election.cc:304] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:49.658993 7870 leader_election.cc:343] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.659170 7736 leader_election.cc:304] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.659476 9975 raft_consensus.cc:2804] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.659590 9975 raft_consensus.cc:697] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:49.659837 9975 consensus_queue.cc:237] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.660904 9894 raft_consensus.cc:2804] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.661021 9894 raft_consensus.cc:697] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:49.661475 9894 consensus_queue.cc:237] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.661638 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:49.664279 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:49.664616 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:49.666821 9498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "cab133462c2f46309dc8f0792122bad9" instance_seqno: 1778011999975983) as {username='slave'} at 127.7.33.193:33693; Asking this server to re-register.
I20260505 20:13:49.667251 7736 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.667560 9944 raft_consensus.cc:2804] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:49.667640 9944 raft_consensus.cc:493] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 974ed93a43c54ccbb58e60bfdae7c546)
I20260505 20:13:49.667699 9944 raft_consensus.cc:3060] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:49.670295 9944 raft_consensus.cc:515] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.670827 9944 leader_election.cc:290] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.676815 7736 leader_election.cc:304] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.677136 9944 raft_consensus.cc:2804] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.677214 9944 raft_consensus.cc:493] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.677289 9944 raft_consensus.cc:3060] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.678308 10196 raft_consensus.cc:2804] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.678390 10196 raft_consensus.cc:493] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.678443 10196 raft_consensus.cc:3060] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.679772 9944 raft_consensus.cc:515] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.680423 9944 leader_election.cc:290] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.681069 10196 raft_consensus.cc:515] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.681366 9948 raft_consensus.cc:493] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:49.681485 9948 raft_consensus.cc:515] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.681668 10196 leader_election.cc:290] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.681818 10031 raft_consensus.cc:493] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.681919 10031 raft_consensus.cc:515] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.682034 9948 leader_election.cc:290] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.682387 10031 leader_election.cc:290] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.683954 7869 leader_election.cc:304] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.684278 10196 raft_consensus.cc:2804] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.684357 10196 raft_consensus.cc:493] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.684432 10196 raft_consensus.cc:3060] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.687773 10196 raft_consensus.cc:515] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.688493 10196 leader_election.cc:290] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.689165 8054 raft_consensus.cc:359] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.689422 8054 raft_consensus.cc:385] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.689546 8054 raft_consensus.cc:740] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.690192 8054 consensus_queue.cc:260] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.690768 8054 ts_tablet_manager.cc:1434] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260505 20:13:49.691092 8054 tablet_bootstrap.cc:492] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.692562 8054 tablet_bootstrap.cc:654] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:49.694779 7870 leader_election.cc:343] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.694991 7870 leader_election.cc:304] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.695111 9944 raft_consensus.cc:493] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.695217 9619 raft_consensus.cc:2804] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.695298 9619 raft_consensus.cc:493] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.695377 9619 raft_consensus.cc:3060] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.695411 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.695402 9944 raft_consensus.cc:515] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.695674 7933 raft_consensus.cc:2393] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:49.696144 8058 raft_consensus.cc:385] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.696168 9944 leader_election.cc:290] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.696324 8058 raft_consensus.cc:740] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.696637 8058 consensus_queue.cc:260] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:49.697925 7869 leader_election.cc:343] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.697976 9619 raft_consensus.cc:515] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.698086 7869 leader_election.cc:304] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.698498 9619 leader_election.cc:290] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.698563 10276 raft_consensus.cc:2749] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:49.698741 7870 leader_election.cc:343] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.699364 9619 consensus_queue.cc:1048] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.700188 8058 ts_tablet_manager.cc:1434] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.053s user 0.001s sys 0.001s
I20260505 20:13:49.700465 8058 tablet_bootstrap.cc:492] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.702286 8058 tablet_bootstrap.cc:654] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.702553 10167 consensus_queue.cc:1048] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.703387 10167 consensus_queue.cc:1048] T a5fcaee384c440bcb3307cba455e2ffa P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:49.704542 7598 leader_election.cc:343] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1aaff49cb0ff4298be24603b2015c8a4
I20260505 20:13:49.695220 9270 ts_tablet_manager.cc:1929] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.706228 9270 log.cc:1199] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/a4a42f0b6dc74cbd8d72ae36410f9d35
I20260505 20:13:49.706825 9270 ts_tablet_manager.cc:1950] T a4a42f0b6dc74cbd8d72ae36410f9d35 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:49.707988 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 139) took 12334 ms. Trace:
I20260505 20:13:49.708178 9270 rpcz_store.cc:276] 0505 20:13:37.373654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.373694 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:49.517340 (+12143646us) ts_tablet_manager.cc:1151] Deleting tablet a4a42f0b6dc74cbd8d72ae36410f9d35
0505 20:13:49.517351 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.521352 (+ 4001us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.695147 (+173795us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.707960 (+ 12813us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12143451}
I20260505 20:13:49.708725 9944 raft_consensus.cc:493] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.708945 9944 raft_consensus.cc:515] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.709247 9270 tablet_replica.cc:333] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:49.709618 9270 raft_consensus.cc:2243] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:49.709653 9944 leader_election.cc:290] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.710525 10276 raft_consensus.cc:493] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.710675 10276 raft_consensus.cc:515] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.711436 10276 leader_election.cc:290] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.724553 10276 raft_consensus.cc:493] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.724695 10276 raft_consensus.cc:515] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.725293 10276 leader_election.cc:290] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.727303 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1fa4131acf4d23ad35aaae5ebfa5ca" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.732784 8053 tablet_bootstrap.cc:492] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.708942 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet a4a42f0b6dc74cbd8d72ae36410f9d35 (table default.Table_8b4013ec119f4c35aef190778e2fa5c6 [id=8ac7668d8df2475098e86492dd431fb2]) successfully deleted
I20260505 20:13:49.738058 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:49.738876 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:49.739562 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:49.740680 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:49.749619 8054 tablet_bootstrap.cc:492] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.749864 8054 ts_tablet_manager.cc:1403] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.002s
I20260505 20:13:49.750557 8054 raft_consensus.cc:359] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.750814 8054 raft_consensus.cc:385] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.750929 8054 raft_consensus.cc:740] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.715168 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9bd035b077474294d274a8f8cb38fd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.715221 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.715672 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.751173 8054 consensus_queue.cc:260] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.751319 7661 raft_consensus.cc:3060] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.751788 8054 ts_tablet_manager.cc:1434] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:49.752029 8054 tablet_bootstrap.cc:492] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.752924 9121 ts_tablet_manager.cc:1929] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.753012 9121 log.cc:1199] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/35ada922a36f4f329a5ff8b328dbef5f
I20260505 20:13:49.753361 8054 tablet_bootstrap.cc:654] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.753378 9121 ts_tablet_manager.cc:1950] T 35ada922a36f4f329a5ff8b328dbef5f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:49.754436 7661 raft_consensus.cc:2468] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.721351 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.727846 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.728289 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335acbbc84624d61b779a422f29919fa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:49.720300 7598 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: bd01314146a34257b444a622829b2fe4
I20260505 20:13:49.751312 7658 raft_consensus.cc:3060] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.759121 7658 raft_consensus.cc:2468] T 7e9bd035b077474294d274a8f8cb38fd P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.765539 8054 tablet_bootstrap.cc:492] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.765772 8054 ts_tablet_manager.cc:1403] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.012s
I20260505 20:13:49.766477 8054 raft_consensus.cc:359] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.766703 8054 raft_consensus.cc:385] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.766904 8054 raft_consensus.cc:740] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.767145 8054 consensus_queue.cc:260] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.767650 8054 ts_tablet_manager.cc:1434] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:49.768370 8054 tablet_bootstrap.cc:492] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.770350 8054 tablet_bootstrap.cc:654] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.771406 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.771615 7922 raft_consensus.cc:2468] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.772245 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:49.772436 7934 raft_consensus.cc:2393] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:49.773357 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.773517 7934 raft_consensus.cc:2468] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.774974 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:49.775136 7934 raft_consensus.cc:2468] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:49.778430 8054 tablet_bootstrap.cc:492] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.778604 8054 ts_tablet_manager.cc:1403] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260505 20:13:49.779219 8054 raft_consensus.cc:359] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.779412 8054 raft_consensus.cc:385] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.779506 8054 raft_consensus.cc:740] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.779721 8054 consensus_queue.cc:260] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.780212 8054 ts_tablet_manager.cc:1434] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260505 20:13:49.780495 8054 tablet_bootstrap.cc:492] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.781205 9944 raft_consensus.cc:493] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.781837 9944 raft_consensus.cc:515] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.782567 8053 tablet_bootstrap.cc:654] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.569619 9271 rpcz_store.cc:276] 0505 20:13:37.387030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.389805 (+ 2775us) service_pool.cc:224] Handling call
0505 20:13:49.535429 (+12145624us) ts_tablet_manager.cc:1151] Deleting tablet 17acb52d6cde4ced988506cee48eb040
0505 20:13:49.535439 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.565215 (+ 29776us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.568183 (+ 2968us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.569498 (+ 1315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12145476}
I20260505 20:13:49.784353 9271 tablet_replica.cc:333] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.784602 9944 leader_election.cc:290] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.784646 9271 raft_consensus.cc:2243] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.784955 9271 raft_consensus.cc:2272] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.789705 8054 tablet_bootstrap.cc:654] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.789705 9619 raft_consensus.cc:493] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.790200 9619 raft_consensus.cc:515] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.790723 9619 leader_election.cc:290] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.792465 7710 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:49.796037 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.800531 9944 raft_consensus.cc:493] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.800715 9944 raft_consensus.cc:515] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.801498 9944 leader_election.cc:290] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.802433 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.802621 9894 raft_consensus.cc:493] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.802664 7662 raft_consensus.cc:2393] T 6f3a4294f4c34ac886a136c2ece31531 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:49.802726 9894 raft_consensus.cc:515] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.803211 9894 leader_election.cc:290] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.803558 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c24f9f26c84ba7b2ce85f9da4bccf8" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.803756 7657 raft_consensus.cc:3060] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:49.803866 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 187) took 11062 ms. Trace:
I20260505 20:13:49.803961 9121 rpcz_store.cc:276] 0505 20:13:38.741631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.743280 (+ 1649us) service_pool.cc:224] Handling call
0505 20:13:49.557020 (+10813740us) ts_tablet_manager.cc:1151] Deleting tablet 35ada922a36f4f329a5ff8b328dbef5f
0505 20:13:49.557037 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.749839 (+192802us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.752874 (+ 3035us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.803842 (+ 50968us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10813435}
I20260505 20:13:49.804332 9121 tablet_replica.cc:333] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:49.804556 9121 raft_consensus.cc:2243] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.804702 9121 raft_consensus.cc:2272] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.805187 9121 ts_tablet_manager.cc:1916] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.785693 9271 ts_tablet_manager.cc:1916] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.807777 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.808600 7737 leader_election.cc:304] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.808853 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.809221 7737 leader_election.cc:304] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.809190 9944 raft_consensus.cc:2804] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.809443 9944 raft_consensus.cc:493] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.809567 9944 raft_consensus.cc:3060] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.809870 9948 raft_consensus.cc:2804] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.809952 9948 raft_consensus.cc:493] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.810030 9948 raft_consensus.cc:3060] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.812851 9948 raft_consensus.cc:515] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.813369 9948 leader_election.cc:290] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.813702 9944 raft_consensus.cc:515] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.814252 9944 leader_election.cc:290] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.809561 7737 leader_election.cc:304] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:49.817632 7737 leader_election.cc:343] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 20c24f9f26c84ba7b2ce85f9da4bccf8
I20260505 20:13:49.817881 8058 tablet_bootstrap.cc:492] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.818056 8058 ts_tablet_manager.cc:1403] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.000s
I20260505 20:13:49.818220 10221 raft_consensus.cc:2804] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.818677 10221 raft_consensus.cc:493] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.818822 10221 raft_consensus.cc:3060] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.821219 10221 raft_consensus.cc:515] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.822048 10221 leader_election.cc:290] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:49.825256 9271 ts_tablet_manager.cc:1929] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.827873 9271 log.cc:1199] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e083f131eca54d98852e5685e08ef46b
I20260505 20:13:49.828213 9271 ts_tablet_manager.cc:1950] T e083f131eca54d98852e5685e08ef46b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.829815 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 142) took 12442 ms. Trace:
I20260505 20:13:49.829907 9271 rpcz_store.cc:276] 0505 20:13:37.387322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.390497 (+ 3175us) service_pool.cc:224] Handling call
0505 20:13:49.784286 (+12393789us) ts_tablet_manager.cc:1151] Deleting tablet e083f131eca54d98852e5685e08ef46b
0505 20:13:49.784301 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.821210 (+ 36909us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.825208 (+ 3998us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.829794 (+ 4586us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12393646}
W20260505 20:13:49.830996 7870 leader_election.cc:343] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.831166 8053 tablet_bootstrap.cc:492] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.831286 8053 ts_tablet_manager.cc:1403] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.010s
I20260505 20:13:49.831461 9271 tablet_replica.cc:333] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.831581 7870 leader_election.cc:304] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.831692 9271 raft_consensus.cc:2243] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.831835 9271 raft_consensus.cc:2272] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.831840 9619 raft_consensus.cc:2804] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.831960 9619 raft_consensus.cc:697] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:49.831902 8053 raft_consensus.cc:359] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.832047 8053 raft_consensus.cc:385] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.832089 8053 raft_consensus.cc:740] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.832260 8053 consensus_queue.cc:260] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.832195 9619 consensus_queue.cc:237] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.832685 8053 ts_tablet_manager.cc:1434] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:49.832927 8053 tablet_bootstrap.cc:492] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.833244 9271 ts_tablet_manager.cc:1916] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.834515 8053 tablet_bootstrap.cc:654] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:49.837594 7870 leader_election.cc:343] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.838094 7870 leader_election.cc:343] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.838547 7870 leader_election.cc:343] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.838958 7870 leader_election.cc:304] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.839344 9619 raft_consensus.cc:2804] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:49.839574 9619 raft_consensus.cc:697] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:49.839931 9619 consensus_queue.cc:237] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.841226 10258 raft_consensus.cc:493] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.841414 10258 raft_consensus.cc:515] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.842221 10258 leader_election.cc:290] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.845705 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:49.845852 8054 tablet_bootstrap.cc:492] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.845997 8054 ts_tablet_manager.cc:1403] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.007s
I20260505 20:13:49.846719 8054 raft_consensus.cc:359] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.846881 8054 raft_consensus.cc:385] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.846943 8054 raft_consensus.cc:740] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.847167 8054 consensus_queue.cc:260] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.847690 8054 ts_tablet_manager.cc:1434] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.784232 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 17acb52d6cde4ced988506cee48eb040 (table default.Table_e11454be890e45bc9d2ba2cd319f2c93 [id=8dc245508fd34445bb94f647505e20d9]) successfully deleted
W20260505 20:13:49.848598 7397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 64403.4us
I20260505 20:13:49.848848 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e083f131eca54d98852e5685e08ef46b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:49.848901 8053 tablet_bootstrap.cc:492] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.805985 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 35ada922a36f4f329a5ff8b328dbef5f (table default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6]) successfully deleted
I20260505 20:13:49.849025 8053 ts_tablet_manager.cc:1403] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20260505 20:13:49.849642 8053 raft_consensus.cc:359] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.849823 8053 raft_consensus.cc:385] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.849892 8053 raft_consensus.cc:740] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.850060 8053 consensus_queue.cc:260] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.850488 8053 ts_tablet_manager.cc:1434] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260505 20:13:49.850732 8053 tablet_bootstrap.cc:492] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.850852 9619 raft_consensus.cc:493] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.850980 9619 raft_consensus.cc:515] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.851312 7412 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 65003660c44547cc8674baeca370e395 (table default.Table_2add910ed16e4806844c4179947d54e2 [id=497ef8628c1c4dc8b2992736e49a2e3d]). Expected version 4 got 3
I20260505 20:13:49.851874 9619 leader_election.cc:290] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.852514 8054 tablet_bootstrap.cc:492] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.852692 8053 tablet_bootstrap.cc:654] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.853880 8054 tablet_bootstrap.cc:654] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.855355 8058 raft_consensus.cc:359] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.855551 8058 raft_consensus.cc:385] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.844089 7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.844655 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b05546a4f47aea5fae1cf767b762d" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.855819 8058 raft_consensus.cc:740] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.856104 8058 consensus_queue.cc:260] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.856750 8058 ts_tablet_manager.cc:1434] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:49.850157 9270 raft_consensus.cc:2272] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.843568 7657 raft_consensus.cc:2468] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 2.
I20260505 20:13:49.862425 9270 ts_tablet_manager.cc:1916] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:49.867058 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.867702 8058 tablet_bootstrap.cc:492] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.869673 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.870085 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753489e300e743c48485cb5d3d19b8b9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.870211 8053 tablet_bootstrap.cc:492] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.870347 8053 ts_tablet_manager.cc:1403] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260505 20:13:49.870992 8053 raft_consensus.cc:359] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.871155 8053 raft_consensus.cc:385] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.871205 8053 raft_consensus.cc:740] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.871398 8053 consensus_queue.cc:260] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.871884 8053 ts_tablet_manager.cc:1434] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260505 20:13:49.872141 8053 tablet_bootstrap.cc:492] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.872565 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:49.873102 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.873669 8053 tablet_bootstrap.cc:654] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.873652 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:49.874212 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:49.874861 7736 leader_election.cc:343] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.875144 7736 leader_election.cc:343] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: 44ddf95d810c4c80a5f78c1b7600cee4
W20260505 20:13:49.875298 7736 leader_election.cc:343] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.875533 7736 leader_election.cc:343] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.875792 10196 raft_consensus.cc:493] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.875924 10196 raft_consensus.cc:515] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.876834 10196 leader_election.cc:290] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.877592 9906 consensus_queue.cc:1048] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:49.879616 7596 consensus_peers.cc:597] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e98c0e648c98488e8c5509b296824bea. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:49.886721 7736 leader_election.cc:343] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.887105 7736 leader_election.cc:343] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:49.887365 8054 tablet_bootstrap.cc:492] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.887343 7736 leader_election.cc:304] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:49.887516 8054 ts_tablet_manager.cc:1403] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.002s
I20260505 20:13:49.888082 9944 raft_consensus.cc:2804] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:49.888131 8054 raft_consensus.cc:359] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.888293 8054 raft_consensus.cc:385] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.888350 8054 raft_consensus.cc:740] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.888242 9944 raft_consensus.cc:697] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:49.888705 9944 consensus_queue.cc:237] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.889391 8053 tablet_bootstrap.cc:492] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.889436 9121 ts_tablet_manager.cc:1929] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:49.889523 8053 ts_tablet_manager.cc:1403] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260505 20:13:49.889542 9121 log.cc:1199] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/359ab1033ccf4445862867f3f8b78ecd
I20260505 20:13:49.890182 8053 raft_consensus.cc:359] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.890339 8053 raft_consensus.cc:385] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.890393 8053 raft_consensus.cc:740] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.890573 8053 consensus_queue.cc:260] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.891050 8053 ts_tablet_manager.cc:1434] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260505 20:13:49.891337 8053 tablet_bootstrap.cc:492] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.892725 7596 leader_election.cc:304] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:49.893023 8053 tablet_bootstrap.cc:654] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.893949 8054 consensus_queue.cc:260] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.894492 8054 ts_tablet_manager.cc:1434] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260505 20:13:49.894773 8054 tablet_bootstrap.cc:492] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:49.895079 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 76914us
W20260505 20:13:49.895460 7737 leader_election.cc:343] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 20c24f9f26c84ba7b2ce85f9da4bccf8
I20260505 20:13:49.895916 7737 leader_election.cc:304] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.896077 8054 tablet_bootstrap.cc:654] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.896339 9975 raft_consensus.cc:2804] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.896441 9975 raft_consensus.cc:493] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.896538 9975 raft_consensus.cc:3060] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.896699 7737 leader_election.cc:304] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:49.897097 7737 leader_election.cc:343] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:49.897204 7737 leader_election.cc:304] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.897598 10298 raft_consensus.cc:2749] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.897783 10298 raft_consensus.cc:2749] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:49.898087 7737 leader_election.cc:304] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.898324 9894 raft_consensus.cc:2804] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.898409 9894 raft_consensus.cc:493] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.898487 9894 raft_consensus.cc:3060] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.899574 9975 raft_consensus.cc:515] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.900197 9975 leader_election.cc:290] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.901227 9894 raft_consensus.cc:515] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.901957 9894 leader_election.cc:290] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.902522 7737 leader_election.cc:304] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:49.903045 10298 raft_consensus.cc:2804] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.903155 10298 raft_consensus.cc:493] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.903265 10298 raft_consensus.cc:3060] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.906343 10298 raft_consensus.cc:515] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.906565 8054 tablet_bootstrap.cc:492] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.906698 8054 ts_tablet_manager.cc:1403] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:49.907014 10298 leader_election.cc:290] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:49.907317 8054 raft_consensus.cc:359] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.907491 8054 raft_consensus.cc:385] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.907552 8054 raft_consensus.cc:740] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.907728 8054 consensus_queue.cc:260] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.908185 8054 ts_tablet_manager.cc:1434] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260505 20:13:49.908473 8054 tablet_bootstrap.cc:492] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.909621 8053 tablet_bootstrap.cc:492] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.909612 9906 raft_consensus.cc:2804] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:49.909693 9906 raft_consensus.cc:493] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:49.909776 8053 ts_tablet_manager.cc:1403] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260505 20:13:49.909819 9906 raft_consensus.cc:3060] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.910429 8053 raft_consensus.cc:359] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.910605 8053 raft_consensus.cc:385] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.910681 8053 raft_consensus.cc:740] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.910729 8054 tablet_bootstrap.cc:654] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.910943 8053 consensus_queue.cc:260] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.911442 8053 ts_tablet_manager.cc:1434] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:49.911726 8053 tablet_bootstrap.cc:492] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.912298 9906 raft_consensus.cc:515] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.912861 9906 leader_election.cc:290] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:49.913316 8053 tablet_bootstrap.cc:654] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:49.914798 7596 consensus_peers.cc:597] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c8754580368453aa0aae021d8c665da. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.916512 9906 consensus_queue.cc:1048] T 22b7c02a4bd84e788d9fc92781c161a1 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:49.916831 8058 tablet_bootstrap.cc:654] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.917620 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432b497141ed46ba9112b2b74f895238" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.919028 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.919240 7785 raft_consensus.cc:2393] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:49.919736 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.919924 7785 raft_consensus.cc:2393] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:49.920735 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.920902 7785 raft_consensus.cc:2468] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:49.923612 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9bd035b077474294d274a8f8cb38fd" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.923779 7787 raft_consensus.cc:3060] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:49.934939 7787 raft_consensus.cc:2468] T 7e9bd035b077474294d274a8f8cb38fd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:49.938459 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.938788 7787 raft_consensus.cc:2393] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:49.939985 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.940447 7787 raft_consensus.cc:2393] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:49.948892 9498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" instance_seqno: 1778012000949582) as {username='slave'} at 127.7.33.195:48053; Asking this server to re-register.
I20260505 20:13:49.955536 10281 raft_consensus.cc:493] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:49.955780 10281 raft_consensus.cc:515] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.956657 10281 leader_election.cc:290] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:49.957960 7736 leader_election.cc:343] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.958240 7736 leader_election.cc:343] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.958467 7736 leader_election.cc:343] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.958685 7736 leader_election.cc:343] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:49.961510 7598 consensus_peers.cc:597] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f34a3f1f30b4165a0c60fab482dce36. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:49.966655 9271 ts_tablet_manager.cc:1929] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:49.966828 9271 log.cc:1199] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/883ec65f15604346813e5f87d55802fc
I20260505 20:13:49.967260 9271 ts_tablet_manager.cc:1950] T 883ec65f15604346813e5f87d55802fc P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:49.969677 8058 tablet_bootstrap.cc:492] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:49.969862 8058 ts_tablet_manager.cc:1403] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.102s user 0.001s sys 0.002s
I20260505 20:13:49.970561 8058 raft_consensus.cc:359] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.970749 8058 raft_consensus.cc:385] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.970798 8058 raft_consensus.cc:740] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.971051 8058 consensus_queue.cc:260] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:49.971746 8058 ts_tablet_manager.cc:1434] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:49.971724 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 144) took 12584 ms. Trace:
I20260505 20:13:49.971839 9271 rpcz_store.cc:276] 0505 20:13:37.387546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.390651 (+ 3105us) service_pool.cc:224] Handling call
0505 20:13:49.831409 (+12440758us) ts_tablet_manager.cc:1151] Deleting tablet 883ec65f15604346813e5f87d55802fc
0505 20:13:49.831419 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.858151 (+ 26732us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.966582 (+108431us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.971655 (+ 5073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12440655}
I20260505 20:13:49.972052 8058 tablet_bootstrap.cc:492] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:49.972316 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 883ec65f15604346813e5f87d55802fc (table default.Table_17eda505104c417ba34f71dbb19633f5 [id=373b40a3cc5a425f8e0609881bd0029f]) successfully deleted
I20260505 20:13:49.972674 9271 tablet_replica.cc:333] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:49.972975 9271 raft_consensus.cc:2243] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:49.973228 9271 raft_consensus.cc:2272] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:49.974072 9271 ts_tablet_manager.cc:1916] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:49.974634 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 58205.5us
I20260505 20:13:49.976279 7596 leader_election.cc:304] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:49.976562 9906 raft_consensus.cc:2749] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:49.979512 8054 tablet_bootstrap.cc:492] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:49.979705 8054 ts_tablet_manager.cc:1403] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.023s
I20260505 20:13:49.980583 8054 raft_consensus.cc:359] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.980819 8054 raft_consensus.cc:385] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.980896 8054 raft_consensus.cc:740] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.981153 8054 consensus_queue.cc:260] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.982319 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f3a4294f4c34ac886a136c2ece31531" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:49.982650 7787 raft_consensus.cc:2393] T 6f3a4294f4c34ac886a136c2ece31531 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:49.983736 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335acbbc84624d61b779a422f29919fa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:49.984787 7596 leader_election.cc:343] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: bd01314146a34257b444a622829b2fe4
I20260505 20:13:49.984970 7596 leader_election.cc:304] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:49.985239 9906 raft_consensus.cc:2749] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260505 20:13:49.987601 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:49.987874 7787 raft_consensus.cc:2468] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:49.988555 8058 tablet_bootstrap.cc:654] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.991911 8053 tablet_bootstrap.cc:492] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:49.992077 8053 ts_tablet_manager.cc:1403] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.080s user 0.019s sys 0.036s
I20260505 20:13:49.992102 8054 ts_tablet_manager.cc:1434] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260505 20:13:49.992444 8054 tablet_bootstrap.cc:492] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:49.992871 8053 raft_consensus.cc:359] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.993062 8053 raft_consensus.cc:385] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:49.993155 8053 raft_consensus.cc:740] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:49.993393 8053 consensus_queue.cc:260] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:49.993904 8054 tablet_bootstrap.cc:654] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:49.994005 8053 ts_tablet_manager.cc:1434] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:49.994308 8053 tablet_bootstrap.cc:492] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:49.995841 8053 tablet_bootstrap.cc:654] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.000594 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753489e300e743c48485cb5d3d19b8b9" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:50.001024 7400 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8ca1fb1425e347d191f3c5931d9bf224 consensus state has no leader
I20260505 20:13:50.003403 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.003859 7787 raft_consensus.cc:2468] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:50.005002 9121 ts_tablet_manager.cc:1950] T 359ab1033ccf4445862867f3f8b78ecd P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:50.005697 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 186) took 11264 ms. Trace:
I20260505 20:13:50.005831 9121 rpcz_store.cc:276] 0505 20:13:38.741489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.743786 (+ 2297us) service_pool.cc:224] Handling call
0505 20:13:49.804272 (+11060486us) ts_tablet_manager.cc:1151] Deleting tablet 359ab1033ccf4445862867f3f8b78ecd
0505 20:13:49.804283 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.886478 (+ 82195us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:49.889386 (+ 2908us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.005679 (+116293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11059740}
I20260505 20:13:50.006354 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]) successfully deleted
I20260505 20:13:50.008288 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.009667 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c20374c4df742799110a12f3fea5daa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:50.014673 7870 leader_election.cc:343] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.015941 7870 leader_election.cc:343] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.016579 9498 ts_manager.cc:194] Registered new tserver with Master: cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.020161 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.020349 7921 raft_consensus.cc:2468] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.020720 7787 raft_consensus.cc:2468] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
W20260505 20:13:50.021077 7870 leader_election.cc:343] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.021792 8053 tablet_bootstrap.cc:492] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.021976 8053 ts_tablet_manager.cc:1403] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.003s
I20260505 20:13:50.022800 8053 raft_consensus.cc:359] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.022992 8053 raft_consensus.cc:385] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.023068 8053 raft_consensus.cc:740] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.023391 8053 consensus_queue.cc:260] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.023880 8053 ts_tablet_manager.cc:1434] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:50.024195 9121 tablet_replica.cc:333] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:50.024401 9121 raft_consensus.cc:2243] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.024551 9121 raft_consensus.cc:2272] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.025727 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.025930 7663 raft_consensus.cc:3060] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.025972 9271 ts_tablet_manager.cc:1929] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.026110 9271 log.cc:1199] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f2b2e40635b141c59d3789aca81efba7
I20260505 20:13:50.026626 9271 ts_tablet_manager.cc:1950] T f2b2e40635b141c59d3789aca81efba7 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.027113 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.027209 8053 tablet_bootstrap.cc:492] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.027279 7658 raft_consensus.cc:3060] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.027464 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 146) took 12639 ms. Trace:
I20260505 20:13:50.027581 9271 rpcz_store.cc:276] 0505 20:13:37.387704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.390763 (+ 3059us) service_pool.cc:224] Handling call
0505 20:13:49.972130 (+12581367us) ts_tablet_manager.cc:1151] Deleting tablet f2b2e40635b141c59d3789aca81efba7
0505 20:13:49.972578 (+ 448us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.002817 (+ 30239us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.025856 (+ 23039us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.027417 (+ 1561us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12581274}
I20260505 20:13:50.027957 9271 tablet_replica.cc:333] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.028209 9271 raft_consensus.cc:2243] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.028376 9271 raft_consensus.cc:2272] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.028951 8053 tablet_bootstrap.cc:654] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.028903 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f2b2e40635b141c59d3789aca81efba7 (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:50.030133 8054 tablet_bootstrap.cc:492] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.030294 8054 ts_tablet_manager.cc:1403] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.002s
I20260505 20:13:50.031172 8054 raft_consensus.cc:359] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.031414 8054 raft_consensus.cc:385] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.031487 8054 raft_consensus.cc:740] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.031733 8054 consensus_queue.cc:260] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.032254 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.032603 8054 ts_tablet_manager.cc:1434] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.033160 8054 tablet_bootstrap.cc:492] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.034874 8054 tablet_bootstrap.cc:654] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.039310 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.039513 7934 raft_consensus.cc:3060] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.039687 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.039845 7921 raft_consensus.cc:2468] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.041877 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.042096 7924 raft_consensus.cc:2393] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:50.042989 9498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" instance_seqno: 1778012000454248) as {username='slave'} at 127.7.33.194:49727; Asking this server to re-register.
I20260505 20:13:50.044795 7934 raft_consensus.cc:2468] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.046828 9121 ts_tablet_manager.cc:1916] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.051789 7983 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:50.053992 9271 ts_tablet_manager.cc:1916] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.057840 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.058064 7934 raft_consensus.cc:3060] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.061120 7934 raft_consensus.cc:2468] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.062315 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ed3ee8c7a048979f5c620bc21f5b96" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.062712 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc112545c3eb4e0189cb1ea45edd4fd0" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.062841 7933 raft_consensus.cc:3060] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.065181 7933 raft_consensus.cc:2468] T bc112545c3eb4e0189cb1ea45edd4fd0 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:50.065196 7736 leader_election.cc:343] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.062551 7934 raft_consensus.cc:3060] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:50.066998 7598 leader_election.cc:343] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1aaff49cb0ff4298be24603b2015c8a4
I20260505 20:13:50.067035 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e4b516283f441bb77f038816afa4ed" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.067162 7933 raft_consensus.cc:3060] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:50.067183 7598 leader_election.cc:343] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f5dfabb36fa5499780b0d15c71404307
W20260505 20:13:50.068738 7869 leader_election.cc:343] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.068840 7869 leader_election.cc:304] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.069067 10276 raft_consensus.cc:2749] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.070974 7933 raft_consensus.cc:2468] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.073323 7934 raft_consensus.cc:2468] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.073983 7658 raft_consensus.cc:2468] T bc112545c3eb4e0189cb1ea45edd4fd0 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.074409 7663 raft_consensus.cc:2468] T 01ed3ee8c7a048979f5c620bc21f5b96 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.075031 7736 leader_election.cc:304] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:50.076857 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c20374c4df742799110a12f3fea5daa" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.077580 7870 leader_election.cc:343] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.077764 7736 leader_election.cc:304] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:50.078083 10307 raft_consensus.cc:2804] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.078238 10307 raft_consensus.cc:697] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:50.078596 10307 consensus_queue.cc:237] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.079246 8058 tablet_bootstrap.cc:492] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.079437 8058 ts_tablet_manager.cc:1403] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.107s user 0.011s sys 0.021s
I20260505 20:13:50.079516 8054 tablet_bootstrap.cc:492] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.079663 8054 ts_tablet_manager.cc:1403] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20260505 20:13:50.079687 10306 raft_consensus.cc:2804] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.079810 10306 raft_consensus.cc:697] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:50.080070 10306 consensus_queue.cc:237] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.080171 8058 raft_consensus.cc:359] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.080319 8058 raft_consensus.cc:385] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.080272 8054 raft_consensus.cc:359] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.080370 8058 raft_consensus.cc:740] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.080420 8054 raft_consensus.cc:385] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.080463 8054 raft_consensus.cc:740] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.080638 8054 consensus_queue.cc:260] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.080792 10276 raft_consensus.cc:493] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.080931 10276 raft_consensus.cc:515] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.081216 8054 ts_tablet_manager.cc:1434] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260505 20:13:50.081517 8054 tablet_bootstrap.cc:492] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.081612 10276 leader_election.cc:290] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.080544 8058 consensus_queue.cc:260] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.082635 8058 ts_tablet_manager.cc:1434] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260505 20:13:50.082964 8058 tablet_bootstrap.cc:492] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.082653 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160aa46d629247d0a46f433ef4088643" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.084285 7870 leader_election.cc:343] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.086330 8054 tablet_bootstrap.cc:654] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.086819 8058 tablet_bootstrap.cc:654] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.088095 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 5d5754e93fba4352a6b82124b3ec146f (DEFAULT_TABLE table=default.Table_931c21464de44ef0b036b4024d64f4c8 [id=fabfe12783814fa6956e471fee6ccf3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.088477 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d5754e93fba4352a6b82124b3ec146f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.096799 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 5d5754e93fba4352a6b82124b3ec146f (DEFAULT_TABLE table=default.Table_931c21464de44ef0b036b4024d64f4c8 [id=fabfe12783814fa6956e471fee6ccf3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.097472 10276 raft_consensus.cc:493] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.097594 10276 raft_consensus.cc:515] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.098037 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 5d5754e93fba4352a6b82124b3ec146f (DEFAULT_TABLE table=default.Table_931c21464de44ef0b036b4024d64f4c8 [id=fabfe12783814fa6956e471fee6ccf3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.098253 10276 leader_election.cc:290] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.098480 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d5754e93fba4352a6b82124b3ec146f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.098846 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79f58b6c874103afffa963c45891a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.099298 7870 leader_election.cc:343] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.102089 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 37e384cdbca64575bc4011e986db2c6d (DEFAULT_TABLE table=default.Table_d66751bd7e2848cbaa9997541b6713b2 [id=62acc6b63e5446fd8b8202929019e0f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.102560 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e384cdbca64575bc4011e986db2c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.106122 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d5754e93fba4352a6b82124b3ec146f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.118031 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 075fe0b84d00414c8054973ee041dd24 (DEFAULT_TABLE table=default.Table_a921d77be67041078921ff843f067f0a [id=53e48cd726d44d25bceede6a8d2ff4c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.118515 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075fe0b84d00414c8054973ee041dd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.119936 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 37e384cdbca64575bc4011e986db2c6d (DEFAULT_TABLE table=default.Table_d66751bd7e2848cbaa9997541b6713b2 [id=62acc6b63e5446fd8b8202929019e0f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.120292 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e384cdbca64575bc4011e986db2c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.121273 9271 ts_tablet_manager.cc:1929] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.121408 9271 log.cc:1199] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/168d9a40a69d4beab8e79a97e7723e69
I20260505 20:13:50.121850 9271 ts_tablet_manager.cc:1950] T 168d9a40a69d4beab8e79a97e7723e69 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.124437 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 37e384cdbca64575bc4011e986db2c6d (DEFAULT_TABLE table=default.Table_d66751bd7e2848cbaa9997541b6713b2 [id=62acc6b63e5446fd8b8202929019e0f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.124888 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e384cdbca64575bc4011e986db2c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.126502 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 148) took 12738 ms. Trace:
I20260505 20:13:50.126608 9271 rpcz_store.cc:276] 0505 20:13:37.387835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.390866 (+ 3031us) service_pool.cc:224] Handling call
0505 20:13:50.027876 (+12637010us) ts_tablet_manager.cc:1151] Deleting tablet 168d9a40a69d4beab8e79a97e7723e69
0505 20:13:50.027886 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.057256 (+ 29370us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.121196 (+ 63940us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.126443 (+ 5247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12636911}
I20260505 20:13:50.126991 9271 tablet_replica.cc:333] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.127111 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 168d9a40a69d4beab8e79a97e7723e69 (table default.Table_ae5f3f820d7a408eb8027c6556b44309 [id=967e469ababf4dcfb96366119fa360cd]) successfully deleted
I20260505 20:13:50.127224 9271 raft_consensus.cc:2243] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.127425 9271 raft_consensus.cc:2272] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.127976 9271 ts_tablet_manager.cc:1916] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.138417 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 075fe0b84d00414c8054973ee041dd24 (DEFAULT_TABLE table=default.Table_a921d77be67041078921ff843f067f0a [id=53e48cd726d44d25bceede6a8d2ff4c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.138898 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075fe0b84d00414c8054973ee041dd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.139484 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 075fe0b84d00414c8054973ee041dd24 (DEFAULT_TABLE table=default.Table_a921d77be67041078921ff843f067f0a [id=53e48cd726d44d25bceede6a8d2ff4c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.140079 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075fe0b84d00414c8054973ee041dd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.140250 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf (DEFAULT_TABLE table=default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.140563 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.142570 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf (DEFAULT_TABLE table=default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.142959 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.142896 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf (DEFAULT_TABLE table=default.Table_f812836f154f43be8c95a729c99d8665 [id=85526e4b761a40f6a1d87f384ceac9a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.143391 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff4c3577dfd4eaaa93b8201cbc6cdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.145913 10307 raft_consensus.cc:493] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.146103 10307 raft_consensus.cc:515] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.146812 10307 leader_election.cc:290] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.147011 7635 tablet_service.cc:1511] Processing CreateTablet for tablet b828a1b36d234dacafdab31037b02ccd (DEFAULT_TABLE table=default.Table_c7157ba30a7545deacef9ed5821f90b4 [id=e633d22063f94042ad7adb0e88e85810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.147146 9271 ts_tablet_manager.cc:1929] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.147250 9271 log.cc:1199] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/880cbba188144dd795873186f8cda1e9
I20260505 20:13:50.147373 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b828a1b36d234dacafdab31037b02ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.147681 9271 ts_tablet_manager.cc:1950] T 880cbba188144dd795873186f8cda1e9 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.148186 7771 tablet_service.cc:1511] Processing CreateTablet for tablet b828a1b36d234dacafdab31037b02ccd (DEFAULT_TABLE table=default.Table_c7157ba30a7545deacef9ed5821f90b4 [id=e633d22063f94042ad7adb0e88e85810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.148463 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 149) took 12760 ms. Trace:
I20260505 20:13:50.148581 9271 rpcz_store.cc:276] 0505 20:13:37.387906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.390971 (+ 3065us) service_pool.cc:224] Handling call
0505 20:13:50.126893 (+12735922us) ts_tablet_manager.cc:1151] Deleting tablet 880cbba188144dd795873186f8cda1e9
0505 20:13:50.126903 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.144170 (+ 17267us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.147048 (+ 2878us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.148423 (+ 1375us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12735808}
I20260505 20:13:50.148921 9271 tablet_replica.cc:333] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.149123 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b828a1b36d234dacafdab31037b02ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.149937 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.150413 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 880cbba188144dd795873186f8cda1e9 (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]) successfully deleted
W20260505 20:13:50.150588 7736 leader_election.cc:343] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.151268 7905 tablet_service.cc:1511] Processing CreateTablet for tablet b828a1b36d234dacafdab31037b02ccd (DEFAULT_TABLE table=default.Table_c7157ba30a7545deacef9ed5821f90b4 [id=e633d22063f94042ad7adb0e88e85810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.151616 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b828a1b36d234dacafdab31037b02ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.162129 7776 tablet_service.cc:1511] Processing CreateTablet for tablet ef11066bc0d24d19910df97e73fbb3cd (DEFAULT_TABLE table=default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.162593 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef11066bc0d24d19910df97e73fbb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.163096 7642 tablet_service.cc:1511] Processing CreateTablet for tablet ef11066bc0d24d19910df97e73fbb3cd (DEFAULT_TABLE table=default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.163529 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef11066bc0d24d19910df97e73fbb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.165906 10276 raft_consensus.cc:493] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.166057 10276 raft_consensus.cc:515] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.166687 10276 leader_election.cc:290] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.167156 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76178d1c329b4bf59fe3955f2893cd39" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.168145 7870 leader_election.cc:343] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.169260 7902 tablet_service.cc:1511] Processing CreateTablet for tablet ef11066bc0d24d19910df97e73fbb3cd (DEFAULT_TABLE table=default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.169665 7902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef11066bc0d24d19910df97e73fbb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.174770 7869 leader_election.cc:304] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.175014 9944 raft_consensus.cc:493] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cab133462c2f46309dc8f0792122bad9)
I20260505 20:13:50.175024 9619 consensus_queue.cc:1048] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.175148 9944 raft_consensus.cc:515] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.175463 9619 raft_consensus.cc:2749] T 01ed3ee8c7a048979f5c620bc21f5b96 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.175442 7869 leader_election.cc:304] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.175756 9944 leader_election.cc:290] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.175781 9619 raft_consensus.cc:2804] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.175837 9619 raft_consensus.cc:493] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.175907 9619 raft_consensus.cc:3060] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.176164 7869 leader_election.cc:304] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.176548 7869 leader_election.cc:304] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:50.176975 7869 leader_election.cc:343] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.177083 7869 leader_election.cc:304] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.177699 10258 raft_consensus.cc:2749] T e1e4b516283f441bb77f038816afa4ed P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.178025 10258 raft_consensus.cc:2749] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.178175 10258 raft_consensus.cc:2749] T 335acbbc84624d61b779a422f29919fa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.178826 9619 raft_consensus.cc:515] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.149158 9271 raft_consensus.cc:2243] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.179306 9271 raft_consensus.cc:2272] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.179898 9271 ts_tablet_manager.cc:1916] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.180022 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.180620 7870 leader_election.cc:343] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.180796 9619 leader_election.cc:290] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.181778 7737 leader_election.cc:304] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.182070 10307 raft_consensus.cc:2804] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.182152 10307 raft_consensus.cc:493] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.182207 10307 raft_consensus.cc:3060] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.184187 7848 heartbeater.cc:461] Registering TS with master...
I20260505 20:13:50.184707 8058 tablet_bootstrap.cc:492] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.184633 10307 raft_consensus.cc:515] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.184940 8058 ts_tablet_manager.cc:1403] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.102s user 0.001s sys 0.005s
I20260505 20:13:50.185191 10307 leader_election.cc:290] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.185689 8058 raft_consensus.cc:359] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.186018 8058 raft_consensus.cc:385] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260505 20:13:50.186007 7736 leader_election.cc:343] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Not found: Tablet not found: b17da5cf513647d9b8e582a9b3b460a1
I20260505 20:13:50.186074 8058 raft_consensus.cc:740] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.186244 8058 consensus_queue.cc:260] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.186719 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.187188 7736 leader_election.cc:343] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.187310 8058 ts_tablet_manager.cc:1434] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.187570 8058 tablet_bootstrap.cc:492] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.188928 8058 tablet_bootstrap.cc:654] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.193763 8054 tablet_bootstrap.cc:492] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.193908 8054 ts_tablet_manager.cc:1403] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.112s user 0.005s sys 0.013s
I20260505 20:13:50.194690 8054 raft_consensus.cc:359] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.194859 8054 raft_consensus.cc:385] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.194907 8054 raft_consensus.cc:740] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.195088 8054 consensus_queue.cc:260] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.195560 8054 ts_tablet_manager.cc:1434] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:50.195807 8054 tablet_bootstrap.cc:492] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:50.195884 7737 leader_election.cc:343] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: aa0b05546a4f47aea5fae1cf767b762d
I20260505 20:13:50.196003 7737 leader_election.cc:304] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.196257 10306 raft_consensus.cc:2749] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.196538 7737 leader_election.cc:304] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.196753 10306 raft_consensus.cc:2804] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.196821 10306 raft_consensus.cc:493] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.196877 10306 raft_consensus.cc:3060] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.196863 7737 leader_election.cc:304] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.197207 8054 tablet_bootstrap.cc:654] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.200950 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 5e99a08f9bb04288b3007214b9761a24 (DEFAULT_TABLE table=default.Table_270a7713798242e4a709ebcbe0e0da03 [id=eb8a7c8505f34b5eb76cdc7e63946d94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.201222 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 5e99a08f9bb04288b3007214b9761a24 (DEFAULT_TABLE table=default.Table_270a7713798242e4a709ebcbe0e0da03 [id=eb8a7c8505f34b5eb76cdc7e63946d94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.201603 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99a08f9bb04288b3007214b9761a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.201967 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99a08f9bb04288b3007214b9761a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.201576 10306 raft_consensus.cc:515] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.203784 7776 tablet_service.cc:1511] Processing CreateTablet for tablet 7729beaa17104b16b4891f7e4e97c8a7 (DEFAULT_TABLE table=default.Table_0c647e85ed684787a671fbc4dfec5f16 [id=0f31c94eb447417a8daea1db313f4f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.204130 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7729beaa17104b16b4891f7e4e97c8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.208113 9704 consensus_queue.cc:1048] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.208195 7636 tablet_service.cc:1511] Processing CreateTablet for tablet 7729beaa17104b16b4891f7e4e97c8a7 (DEFAULT_TABLE table=default.Table_0c647e85ed684787a671fbc4dfec5f16 [id=0f31c94eb447417a8daea1db313f4f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.209419 9619 raft_consensus.cc:493] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.209546 9619 raft_consensus.cc:515] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.210140 9619 leader_election.cc:290] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.210556 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd2235cec9d41f299d04398c097ae42" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.211071 7870 leader_election.cc:343] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.212769 9271 ts_tablet_manager.cc:1929] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.212890 9271 log.cc:1199] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/ae8bd19470294a1db91855afe49be6a5
I20260505 20:13:50.213212 9271 ts_tablet_manager.cc:1950] T ae8bd19470294a1db91855afe49be6a5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.213887 10298 raft_consensus.cc:2749] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.216145 7737 leader_election.cc:304] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.216692 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.216563 7737 leader_election.cc:304] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:50.217141 7736 leader_election.cc:343] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.217398 9944 raft_consensus.cc:2804] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.217512 9944 raft_consensus.cc:697] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:50.217840 9944 consensus_queue.cc:237] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.218825 8053 tablet_bootstrap.cc:492] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.218942 8053 ts_tablet_manager.cc:1403] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.192s user 0.019s sys 0.018s
I20260505 20:13:50.219643 8053 raft_consensus.cc:359] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.219794 8053 raft_consensus.cc:385] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.219846 8053 raft_consensus.cc:740] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.219925 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 84922625c3194035b827e8bdfbb49f51 (DEFAULT_TABLE table=default.Table_3e4262d289ac4cf2a732bc2c66459d09 [id=329aae36b0ca47449d5495eb6e34ce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.220010 8053 consensus_queue.cc:260] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.220050 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 84922625c3194035b827e8bdfbb49f51 (DEFAULT_TABLE table=default.Table_3e4262d289ac4cf2a732bc2c66459d09 [id=329aae36b0ca47449d5495eb6e34ce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.220414 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84922625c3194035b827e8bdfbb49f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.220590 8053 ts_tablet_manager.cc:1434] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.220829 8053 tablet_bootstrap.cc:492] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.222240 8053 tablet_bootstrap.cc:654] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.222559 10276 consensus_queue.cc:1048] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.226910 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7729beaa17104b16b4891f7e4e97c8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.231166 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 152) took 12827 ms. Trace:
I20260505 20:13:50.216660 10307 raft_consensus.cc:2804] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.231688 10307 raft_consensus.cc:697] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:50.232079 10307 consensus_queue.cc:237] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.231267 9271 rpcz_store.cc:276] 0505 20:13:37.403432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.403506 (+ 74us) service_pool.cc:224] Handling call
0505 20:13:50.148860 (+12745354us) ts_tablet_manager.cc:1151] Deleting tablet ae8bd19470294a1db91855afe49be6a5
0505 20:13:50.148869 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.209919 (+ 61050us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.212720 (+ 2801us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.231143 (+ 18423us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17101,"tablet-delete.queue_time_us":12745130}
I20260505 20:13:50.232811 9271 tablet_replica.cc:333] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.232990 9271 raft_consensus.cc:2243] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.233031 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]) successfully deleted
I20260505 20:13:50.233117 9271 raft_consensus.cc:2272] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.233570 9271 ts_tablet_manager.cc:1916] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.238626 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84922625c3194035b827e8bdfbb49f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.238955 8053 tablet_bootstrap.cc:492] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.239087 8053 ts_tablet_manager.cc:1403] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260505 20:13:50.239672 8053 raft_consensus.cc:359] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.239816 8053 raft_consensus.cc:385] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.239858 8053 raft_consensus.cc:740] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.240062 10306 leader_election.cc:290] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.240026 8053 consensus_queue.cc:260] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.244673 8058 tablet_bootstrap.cc:492] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.245131 8058 ts_tablet_manager.cc:1403] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.001s
I20260505 20:13:50.245956 8058 raft_consensus.cc:359] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.246156 8053 ts_tablet_manager.cc:1434] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260505 20:13:50.246434 8053 tablet_bootstrap.cc:492] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.247794 8053 tablet_bootstrap.cc:654] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.248692 9498 ts_manager.cc:194] Registered new tserver with Master: 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:50.250495 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 73548.6us
I20260505 20:13:50.250784 7869 leader_election.cc:304] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:50.251226 7869 leader_election.cc:343] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.251348 7869 leader_election.cc:304] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.251395 8053 tablet_bootstrap.cc:492] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.251514 8053 ts_tablet_manager.cc:1403] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:50.251595 10276 raft_consensus.cc:2804] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.251667 10276 raft_consensus.cc:493] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.251717 7869 leader_election.cc:304] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.251724 10276 raft_consensus.cc:3060] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.251942 9619 raft_consensus.cc:2749] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.252081 9619 raft_consensus.cc:2804] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.252146 9619 raft_consensus.cc:493] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.252198 9619 raft_consensus.cc:3060] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.252167 8053 raft_consensus.cc:359] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.252307 8053 raft_consensus.cc:385] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.252350 8053 raft_consensus.cc:740] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.252529 8053 consensus_queue.cc:260] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.252944 8053 ts_tablet_manager.cc:1434] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:50.253927 10298 raft_consensus.cc:493] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.254035 10298 raft_consensus.cc:515] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.254621 10298 leader_election.cc:290] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.254590 10276 raft_consensus.cc:515] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.255548 10276 leader_election.cc:290] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.256328 9271 ts_tablet_manager.cc:1929] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.256425 9271 log.cc:1199] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/cb5cfc700aff4082ae089476e2af044f
I20260505 20:13:50.256716 9271 ts_tablet_manager.cc:1950] T cb5cfc700aff4082ae089476e2af044f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.255849 9619 raft_consensus.cc:515] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.257441 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 153) took 12853 ms. Trace:
I20260505 20:13:50.257519 9271 rpcz_store.cc:276] 0505 20:13:37.404138 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.404179 (+ 41us) service_pool.cc:224] Handling call
0505 20:13:50.232756 (+12828577us) ts_tablet_manager.cc:1151] Deleting tablet cb5cfc700aff4082ae089476e2af044f
0505 20:13:50.232770 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.236891 (+ 4121us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.256272 (+ 19381us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.257422 (+ 1150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12828424}
I20260505 20:13:50.259066 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet cb5cfc700aff4082ae089476e2af044f (table default.Table_fb996331a7e24a51a33fa182ef600060 [id=9a9e98190466489cb9ba081ad541a8e3]) successfully deleted
W20260505 20:13:50.261785 7737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 44320.7us
I20260505 20:13:50.262838 7737 leader_election.cc:304] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.259243 8054 tablet_bootstrap.cc:492] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.259312 9619 leader_election.cc:290] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.263257 8054 ts_tablet_manager.cc:1403] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.006s
I20260505 20:13:50.263284 8053 tablet_bootstrap.cc:492] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.263432 10306 raft_consensus.cc:2804] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.263679 10306 raft_consensus.cc:697] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:50.257428 9121 ts_tablet_manager.cc:1929] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.263794 9121 log.cc:1199] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/a114db19f63346d9a67e9e3a8225caa4
I20260505 20:13:50.256986 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.263906 8058 raft_consensus.cc:385] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.263983 8058 raft_consensus.cc:740] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.258633 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.258721 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.264714 7736 leader_election.cc:343] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.261015 9495 consensus_queue.cc:1048] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.264825 8053 tablet_bootstrap.cc:654] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.264516 8058 consensus_queue.cc:260] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.265157 7660 raft_consensus.cc:3060] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.265559 9271 tablet_replica.cc:333] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.265766 9271 raft_consensus.cc:2243] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.265887 9271 raft_consensus.cc:2272] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.266335 9271 ts_tablet_manager.cc:1916] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.267897 7660 raft_consensus.cc:2468] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:50.268343 8058 ts_tablet_manager.cc:1434] T 799f3fc33c48436da61cc0cfbf0b0218 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
W20260505 20:13:50.268460 7870 leader_election.cc:343] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.268597 8058 tablet_bootstrap.cc:492] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.268630 7870 leader_election.cc:304] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:50.269251 10306 consensus_queue.cc:237] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.275416 9271 ts_tablet_manager.cc:1929] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.275558 9271 log.cc:1199] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e6c5c661e8aa4962bb9922b9ead7d784
I20260505 20:13:50.275679 10091 consensus_queue.cc:1048] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.275959 9271 ts_tablet_manager.cc:1950] T e6c5c661e8aa4962bb9922b9ead7d784 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.276686 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 154) took 12856 ms. Trace:
I20260505 20:13:50.276777 9271 rpcz_store.cc:276] 0505 20:13:37.419780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.419872 (+ 92us) service_pool.cc:224] Handling call
0505 20:13:50.265515 (+12845643us) ts_tablet_manager.cc:1151] Deleting tablet e6c5c661e8aa4962bb9922b9ead7d784
0505 20:13:50.265524 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.271733 (+ 6209us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.275354 (+ 3621us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.276668 (+ 1314us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12845424}
I20260505 20:13:50.277141 9271 tablet_replica.cc:333] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.277073 8054 raft_consensus.cc:359] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.277159 10091 raft_consensus.cc:493] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.277217 8054 raft_consensus.cc:385] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.277273 8054 raft_consensus.cc:740] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.277348 9271 raft_consensus.cc:2243] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:50.277261 10091 raft_consensus.cc:515] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.277365 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e6c5c661e8aa4962bb9922b9ead7d784 (table default.Table_20042b0bea294bc1ad99439fa62373da [id=bea129294980408ea07ab3a19804d918]) successfully deleted
I20260505 20:13:50.277504 8054 consensus_queue.cc:260] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.277588 9271 raft_consensus.cc:2272] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.277899 10091 leader_election.cc:290] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.278162 8054 ts_tablet_manager.cc:1434] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260505 20:13:50.278414 8054 tablet_bootstrap.cc:492] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.278579 10031 raft_consensus.cc:2804] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.278687 10031 raft_consensus.cc:697] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:50.278883 10031 consensus_queue.cc:237] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.278949 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.279740 7870 leader_election.cc:343] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.283310 8053 tablet_bootstrap.cc:492] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.283468 8053 ts_tablet_manager.cc:1403] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260505 20:13:50.284407 8054 tablet_bootstrap.cc:654] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.284519 8053 raft_consensus.cc:359] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.284686 8053 raft_consensus.cc:385] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.284761 8053 raft_consensus.cc:740] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.284988 8053 consensus_queue.cc:260] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.285632 8053 ts_tablet_manager.cc:1434] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.285995 8053 tablet_bootstrap.cc:492] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.287799 8053 tablet_bootstrap.cc:654] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.288090 10298 raft_consensus.cc:493] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.288224 10298 raft_consensus.cc:515] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.288920 10298 leader_election.cc:290] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.289350 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.289894 7736 leader_election.cc:343] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.290144 9704 raft_consensus.cc:493] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.290272 9704 raft_consensus.cc:515] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:50.291497 7598 leader_election.cc:343] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: cb5cfc700aff4082ae089476e2af044f
I20260505 20:13:50.292760 9271 ts_tablet_manager.cc:1916] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.293172 9704 leader_election.cc:290] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:50.294220 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaff49cb0ff4298be24603b2015c8a4" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.294378 7789 raft_consensus.cc:3060] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.296911 7789 raft_consensus.cc:2468] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:50.297066 8054 tablet_bootstrap.cc:492] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.297211 8054 ts_tablet_manager.cc:1403] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.003s
I20260505 20:13:50.298417 8054 raft_consensus.cc:359] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.298605 8054 raft_consensus.cc:385] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.298671 8054 raft_consensus.cc:740] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.298856 8054 consensus_queue.cc:260] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.299379 8054 ts_tablet_manager.cc:1434] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.299656 8054 tablet_bootstrap.cc:492] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.300451 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5dfabb36fa5499780b0d15c71404307" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:50.300544 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 48479.9us
I20260505 20:13:50.300650 7789 raft_consensus.cc:2468] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
W20260505 20:13:50.300786 7869 leader_election.cc:343] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.300891 7869 leader_election.cc:304] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.301003 8053 tablet_bootstrap.cc:492] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.301419 8053 ts_tablet_manager.cc:1403] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260505 20:13:50.301476 10258 raft_consensus.cc:2749] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.301877 7869 leader_election.cc:304] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.302109 9619 raft_consensus.cc:2804] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.302191 9619 raft_consensus.cc:493] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.302256 9619 raft_consensus.cc:3060] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.302620 8053 raft_consensus.cc:359] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.302771 8053 raft_consensus.cc:385] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.302814 8053 raft_consensus.cc:740] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.302960 8053 consensus_queue.cc:260] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.303269 10337 raft_consensus.cc:493] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.303480 8053 ts_tablet_manager.cc:1434] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:50.303423 10337 raft_consensus.cc:515] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.303723 8053 tablet_bootstrap.cc:492] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.304304 10337 leader_election.cc:290] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.304678 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 5e99a08f9bb04288b3007214b9761a24 (DEFAULT_TABLE table=default.Table_270a7713798242e4a709ebcbe0e0da03 [id=eb8a7c8505f34b5eb76cdc7e63946d94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.305037 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99a08f9bb04288b3007214b9761a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.305065 8053 tablet_bootstrap.cc:654] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.305320 9619 raft_consensus.cc:515] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.306294 9619 leader_election.cc:290] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.306466 9271 ts_tablet_manager.cc:1929] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.306569 9271 log.cc:1199] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/c720fc66db36402a83a7690d70a40353
I20260505 20:13:50.306694 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.306946 9271 ts_tablet_manager.cc:1950] T c720fc66db36402a83a7690d70a40353 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:50.307230 7870 leader_election.cc:343] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.307709 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 155) took 12887 ms. Trace:
I20260505 20:13:50.307792 9271 rpcz_store.cc:276] 0505 20:13:37.420608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.420652 (+ 44us) service_pool.cc:224] Handling call
0505 20:13:50.277097 (+12856445us) ts_tablet_manager.cc:1151] Deleting tablet c720fc66db36402a83a7690d70a40353
0505 20:13:50.277106 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.295974 (+ 18868us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.306417 (+ 10443us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.307691 (+ 1274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12856305}
I20260505 20:13:50.308166 9271 tablet_replica.cc:333] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.308341 9271 raft_consensus.cc:2243] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.308481 9271 raft_consensus.cc:2272] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.308460 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet c720fc66db36402a83a7690d70a40353 (table default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]) successfully deleted
I20260505 20:13:50.309878 9121 ts_tablet_manager.cc:1950] T a114db19f63346d9a67e9e3a8225caa4 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:50.310567 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 184) took 11569 ms. Trace:
I20260505 20:13:50.310653 9121 rpcz_store.cc:276] 0505 20:13:38.741269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.743898 (+ 2629us) service_pool.cc:224] Handling call
0505 20:13:50.024144 (+11280246us) ts_tablet_manager.cc:1151] Deleting tablet a114db19f63346d9a67e9e3a8225caa4
0505 20:13:50.024156 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.204786 (+180630us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.257375 (+ 52589us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.310550 (+ 53175us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11279383}
I20260505 20:13:50.310957 9121 tablet_replica.cc:333] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:50.311157 9121 raft_consensus.cc:2243] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.311332 9121 raft_consensus.cc:2272] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.311789 9121 ts_tablet_manager.cc:1916] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.312884 9271 ts_tablet_manager.cc:1916] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.320779 8058 tablet_bootstrap.cc:654] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.323058 8053 tablet_bootstrap.cc:492] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.323199 8053 ts_tablet_manager.cc:1403] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.003s
I20260505 20:13:50.323210 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ee820d24ec4ba1b3ae17388f75341b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.323808 7870 leader_election.cc:343] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.323865 8053 raft_consensus.cc:359] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.324021 8053 raft_consensus.cc:385] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.324076 8053 raft_consensus.cc:740] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.324273 8053 consensus_queue.cc:260] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.325053 8053 ts_tablet_manager.cc:1434] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.325322 8053 tablet_bootstrap.cc:492] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.326742 8053 tablet_bootstrap.cc:654] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.329066 9271 ts_tablet_manager.cc:1929] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.329160 9271 log.cc:1199] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/44ddf95d810c4c80a5f78c1b7600cee4
I20260505 20:13:50.329246 9619 raft_consensus.cc:493] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.329497 9271 ts_tablet_manager.cc:1950] T 44ddf95d810c4c80a5f78c1b7600cee4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.329413 9619 raft_consensus.cc:515] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.330435 9619 leader_election.cc:290] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.330474 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 156) took 12909 ms. Trace:
I20260505 20:13:50.330549 9271 rpcz_store.cc:276] 0505 20:13:37.421217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.421260 (+ 43us) service_pool.cc:224] Handling call
0505 20:13:50.308115 (+12886855us) ts_tablet_manager.cc:1151] Deleting tablet 44ddf95d810c4c80a5f78c1b7600cee4
0505 20:13:50.308128 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.317108 (+ 8980us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.329014 (+ 11906us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.330456 (+ 1442us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12886717}
I20260505 20:13:50.331044 9271 tablet_replica.cc:333] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.331264 9271 raft_consensus.cc:2243] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.331300 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 44ddf95d810c4c80a5f78c1b7600cee4 (table default.Table_4678f19979234d3bba292f510282993e [id=2dd6459aaec24c92896c919a5375c5b3]) successfully deleted
I20260505 20:13:50.331427 9271 raft_consensus.cc:2272] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.331950 9271 ts_tablet_manager.cc:1916] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.332109 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca1fb1425e347d191f3c5931d9bf224" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.332633 7870 leader_election.cc:343] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.335282 10307 raft_consensus.cc:493] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.335405 10307 raft_consensus.cc:515] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.335948 10307 leader_election.cc:290] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.336632 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb5e21649a4cc39764a3847fa41c21" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.337548 8054 tablet_bootstrap.cc:654] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:50.338225 7736 leader_election.cc:343] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.340130 8053 tablet_bootstrap.cc:492] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.340257 8053 ts_tablet_manager.cc:1403] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260505 20:13:50.340858 8053 raft_consensus.cc:359] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.341024 8053 raft_consensus.cc:385] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.341082 8053 raft_consensus.cc:740] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.341267 8053 consensus_queue.cc:260] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.341727 8053 ts_tablet_manager.cc:1434] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:50.342034 8053 tablet_bootstrap.cc:492] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.343333 8053 tablet_bootstrap.cc:654] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.349925 8053 tablet_bootstrap.cc:492] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.350467 8053 ts_tablet_manager.cc:1403] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20260505 20:13:50.350412 7902 tablet_service.cc:1511] Processing CreateTablet for tablet 7729beaa17104b16b4891f7e4e97c8a7 (DEFAULT_TABLE table=default.Table_0c647e85ed684787a671fbc4dfec5f16 [id=0f31c94eb447417a8daea1db313f4f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.350874 7902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7729beaa17104b16b4891f7e4e97c8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.351100 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.351188 8053 raft_consensus.cc:359] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.351333 8053 raft_consensus.cc:385] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.351331 7921 raft_consensus.cc:2468] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.351388 8053 raft_consensus.cc:740] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.351567 8053 consensus_queue.cc:260] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.352073 8053 ts_tablet_manager.cc:1434] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:50.352331 8053 tablet_bootstrap.cc:492] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.353127 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet a114db19f63346d9a67e9e3a8225caa4 (table default.Table_4ea12411a44f4701a2b87ff72c38e8d6 [id=39135661c6b246a0bc45ec344e9bdc8e]) successfully deleted
I20260505 20:13:50.354043 8053 tablet_bootstrap.cc:654] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.354835 9271 ts_tablet_manager.cc:1929] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.354933 9271 log.cc:1199] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/172cd9f38dd8491ea3ecf42b680d398f
I20260505 20:13:50.355285 9271 ts_tablet_manager.cc:1950] T 172cd9f38dd8491ea3ecf42b680d398f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.356012 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 157) took 12934 ms. Trace:
I20260505 20:13:50.356108 9271 rpcz_store.cc:276] 0505 20:13:37.421954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.421995 (+ 41us) service_pool.cc:224] Handling call
0505 20:13:50.330991 (+12908996us) ts_tablet_manager.cc:1151] Deleting tablet 172cd9f38dd8491ea3ecf42b680d398f
0505 20:13:50.330999 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.345298 (+ 14299us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.354779 (+ 9481us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.355987 (+ 1208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12908862}
W20260505 20:13:50.356344 7598 consensus_peers.cc:597] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2b2e40635b141c59d3789aca81efba7. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.356504 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 158) took 12933 ms. Trace:
I20260505 20:13:50.356590 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 172cd9f38dd8491ea3ecf42b680d398f (table default.Table_a0a4ba2ddd114a5290800e09d4ba6fc0 [id=53190afe0efc4b75a333dd189a53376c]) successfully deleted
I20260505 20:13:50.356578 9271 rpcz_store.cc:276] 0505 20:13:37.422634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.422673 (+ 39us) service_pool.cc:224] Handling call
0505 20:13:50.356391 (+12933718us) ts_tablet_manager.cc:1151] Deleting tablet 91496ff1e14e4cfdbaadb34d25ad8b68
0505 20:13:50.356401 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.356488 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12933582}
I20260505 20:13:50.356812 9271 tablet_replica.cc:333] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.357048 9271 raft_consensus.cc:2243] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:50.357157 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 91496ff1e14e4cfdbaadb34d25ad8b68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91496ff1e14e4cfdbaadb34d25ad8b68 already in progress: creating tablet
I20260505 20:13:50.357208 9271 raft_consensus.cc:2272] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.357705 9271 ts_tablet_manager.cc:1916] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.360991 9121 ts_tablet_manager.cc:1929] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.361132 9121 log.cc:1199] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/be05357416b24dabaaa5f2ce2f33c82e
I20260505 20:13:50.361481 9121 ts_tablet_manager.cc:1950] T be05357416b24dabaaa5f2ce2f33c82e P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:50.364079 8053 tablet_bootstrap.cc:492] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.364207 8053 ts_tablet_manager.cc:1403] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260505 20:13:50.364859 8053 raft_consensus.cc:359] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.365036 8053 raft_consensus.cc:385] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.365105 8053 raft_consensus.cc:740] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.365295 8053 consensus_queue.cc:260] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.365761 8053 ts_tablet_manager.cc:1434] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:50.366040 8053 tablet_bootstrap.cc:492] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.367357 8053 tablet_bootstrap.cc:654] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.367652 7905 tablet_service.cc:1511] Processing CreateTablet for tablet 84922625c3194035b827e8bdfbb49f51 (DEFAULT_TABLE table=default.Table_3e4262d289ac4cf2a732bc2c66459d09 [id=329aae36b0ca47449d5495eb6e34ce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:50.368705 9271 ts_tablet_manager.cc:1929] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.368804 9271 log.cc:1199] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/e69bdfc75a494635837178cb16c08c1c
I20260505 20:13:50.369146 9271 ts_tablet_manager.cc:1950] T e69bdfc75a494635837178cb16c08c1c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.371140 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 159) took 12947 ms. Trace:
I20260505 20:13:50.371934 9271 rpcz_store.cc:276] 0505 20:13:37.423306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.423346 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:50.356777 (+12933431us) ts_tablet_manager.cc:1151] Deleting tablet e69bdfc75a494635837178cb16c08c1c
0505 20:13:50.356783 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.361009 (+ 4226us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.368656 (+ 7647us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.371121 (+ 2465us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12933290}
I20260505 20:13:50.372278 9271 tablet_replica.cc:333] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.372488 9271 raft_consensus.cc:2243] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.372486 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet e69bdfc75a494635837178cb16c08c1c (table default.Table_6071ca6b55a24946bfa133a951d84705 [id=1d0a4f96e2d2469eb1f5713c8be415df]) successfully deleted
I20260505 20:13:50.372643 9271 raft_consensus.cc:2272] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.373137 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "160aa46d629247d0a46f433ef4088643" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.373694 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae79f58b6c874103afffa963c45891a1" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.372943 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:50.374212 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76178d1c329b4bf59fe3955f2893cd39" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.374254 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:50.374395 7795 raft_consensus.cc:2468] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:50.374608 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:50.373145 9271 ts_tablet_manager.cc:1916] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.374941 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:50.376320 7413 catalog_manager.cc:5671] T 534726d2291044d78740896ff9031fca P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:50.377005 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:50.377274 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:50.378506 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:50.378825 7413 catalog_manager.cc:5671] T 6375582031e0445086c58402e8b189c0 P cab133462c2f46309dc8f0792122bad9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:50.379199 8053 tablet_bootstrap.cc:492] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.379329 8053 ts_tablet_manager.cc:1403] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260505 20:13:50.380142 8054 tablet_bootstrap.cc:492] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.379999 8053 raft_consensus.cc:359] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.380393 8054 ts_tablet_manager.cc:1403] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.000s
I20260505 20:13:50.380254 8053 raft_consensus.cc:385] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.380515 8053 raft_consensus.cc:740] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.380728 8053 consensus_queue.cc:260] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.381122 8054 raft_consensus.cc:359] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.381300 8053 ts_tablet_manager.cc:1434] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.381327 8054 raft_consensus.cc:385] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.381374 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.381425 8054 raft_consensus.cc:740] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.381573 8053 tablet_bootstrap.cc:492] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.381510 7787 raft_consensus.cc:3060] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.381644 8054 consensus_queue.cc:260] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.382194 8054 ts_tablet_manager.cc:1434] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.382623 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:50.382913 8053 tablet_bootstrap.cc:654] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.383534 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:50.383844 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:50.383929 8058 tablet_bootstrap.cc:492] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.384079 8058 ts_tablet_manager.cc:1403] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.116s user 0.002s sys 0.001s
I20260505 20:13:50.384240 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet f2b0dd5d7870453bb1b771405daeb22f (table default.Table_38a781e02b0a4a03ae8f23957324408e [id=633565e251844b0aa66147472deee05f]). Expected version 3 got 0
I20260505 20:13:50.384721 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:50.384730 8058 raft_consensus.cc:359] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.384907 8058 raft_consensus.cc:385] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.384997 8058 raft_consensus.cc:740] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.385171 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:50.385224 8058 consensus_queue.cc:260] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.385730 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd2235cec9d41f299d04398c097ae42" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.385871 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67]). Expected version 1 got 0
I20260505 20:13:50.385946 8058 ts_tablet_manager.cc:1434] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.386153 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:50.386227 8058 tablet_bootstrap.cc:492] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.386406 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:50.386555 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 53f1318ef5bf439f97de685ae7d6f462 (table default.Table_bf48cc2ebe77443c9853c922b28b8897 [id=10cd3e3153354713804ceb88f2fde76f]). Expected version 1 got 0
I20260505 20:13:50.386719 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:50.386730 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.386943 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_5a10edf039e649cdaebec19cc78b2149 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 1 got 0
I20260505 20:13:50.386976 7789 raft_consensus.cc:3060] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.387187 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:50.387377 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:50.387718 8058 tablet_bootstrap.cc:654] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.387755 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:50.387739 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.387929 7785 raft_consensus.cc:2393] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:50.388002 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:50.388345 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:50.388528 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:50.389258 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.389394 7785 raft_consensus.cc:2468] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:50.389520 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:50.389953 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:50.390092 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:50.390630 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:50.390974 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:50.392357 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:50.392666 7413 catalog_manager.cc:5763] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:50.393524 7405 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 85ab5b85e6d24e14a8e7507003eed5d2
I20260505 20:13:50.393659 7789 raft_consensus.cc:2468] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:50.394124 7405 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 177) took 8061 ms. Trace:
I20260505 20:13:50.394446 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ab5b85e6d24e14a8e7507003eed5d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:50.394241 7405 rpcz_store.cc:276] 0505 20:13:42.332254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:45.972146 (+3639892us) service_pool.cc:224] Handling call
0505 20:13:46.245629 (+273483us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:46.258240 (+ 12611us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:46.258311 (+ 71us) catalog_manager.cc:2824] Locking tablets
0505 20:13:46.258467 (+ 156us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:46.298150 (+ 39683us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:46.354799 (+ 56649us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:50.393480 (+4038681us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:50.394063 (+ 583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.259180 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.259291 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.259297 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:46.259299 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.259428 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.259439 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.259443 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.259544 (+ 101us) tablet.cc:701] Row locks acquired
0505 20:13:46.259546 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.259578 (+ 32us) write_op.cc:270] Start()
0505 20:13:46.259612 (+ 34us) write_op.cc:276] Timestamp: P: 1778012026259606 usec, L: 0
0505 20:13:46.259616 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.259804 (+ 188us) log.cc:844] Serialized 728 byte log entry
0505 20:13:46.297107 (+ 37303us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.297305 (+ 198us) write_op.cc:301] APPLY: starting
0505 20:13:46.297324 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.297372 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.297402 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.297475 (+ 73us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.297512 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:46.297519 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.297608 (+ 89us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.297676 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.297701 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:46.297708 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.297801 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.297805 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":488,"apply.run_wall_time_us":488,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":10443,"prepare.run_wall_time_us":37417,"raft.queue_time_us":369,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":4,"replication_time_us":37446,"spinlock_wait_cycles":13568,"thread_start_us":36544,"threads_started":1}]]}
W20260505 20:13:50.395032 7405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 264) took 3344 ms (client timeout 1000 ms). Trace:
W20260505 20:13:50.395119 7405 rpcz_store.cc:269] 0505 20:13:47.051033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.394943 (+3343910us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.394980 (+ 37us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:50.395449 7405 rpcz_store.cc:267] Call kudu.master.MasterService.Ping from 127.7.33.195:36663 (request call id 290) took 3275 ms (client timeout 1000 ms). Trace:
W20260505 20:13:50.395525 7405 rpcz_store.cc:269] 0505 20:13:47.120271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.395377 (+3275106us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.395404 (+ 27us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:50.395761 7405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.193:44295 (request call id 254) took 2513 ms (client timeout 1000 ms). Trace:
W20260505 20:13:50.395838 7405 rpcz_store.cc:269] 0505 20:13:47.882762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.395676 (+2512914us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.395706 (+ 30us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:50.396085 7405 rpcz_store.cc:267] Call kudu.master.MasterService.Ping from 127.7.33.195:36663 (request call id 291) took 2270 ms (client timeout 1000 ms). Trace:
W20260505 20:13:50.396185 7405 rpcz_store.cc:269] 0505 20:13:48.125835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.395997 (+2270162us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.396028 (+ 31us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:50.396416 7405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.33.194:40601 (request call id 265) took 1536 ms (client timeout 1000 ms). Trace:
I20260505 20:13:50.396292 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ee820d24ec4ba1b3ae17388f75341b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:50.396492 7405 rpcz_store.cc:269] 0505 20:13:48.859556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.396332 (+1536776us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.396364 (+ 32us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:50.396683 7405 rpcz_store.cc:267] Call kudu.master.MasterService.Ping from 127.7.33.193:44295 (request call id 255) took 1505 ms (client timeout 1000 ms). Trace:
W20260505 20:13:50.396749 7405 rpcz_store.cc:269] 0505 20:13:48.890886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.396618 (+1505732us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.396644 (+ 26us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260505 20:13:50.396973 7405 rpcz_store.cc:267] Call kudu.master.MasterService.Ping from 127.7.33.195:36663 (request call id 292) took 1270 ms (client timeout 1000 ms). Trace:
W20260505 20:13:50.397045 7405 rpcz_store.cc:269] 0505 20:13:49.126806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.396881 (+1270075us) service_pool.cc:211] Skipping call since client already timed out
0505 20:13:50.396921 (+ 40us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260505 20:13:50.397114 7787 raft_consensus.cc:2468] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:50.397914 7984 heartbeater.cc:344] Connected to a master server at 127.7.33.253:39345
I20260505 20:13:50.398159 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:50.398145 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.399561 7789 raft_consensus.cc:2393] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:50.399943 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca1fb1425e347d191f3c5931d9bf224" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.400081 7785 raft_consensus.cc:2468] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:50.402240 7902 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ab5b85e6d24e14a8e7507003eed5d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:50.402758 7849 heartbeater.cc:344] Connected to a master server at 127.7.33.253:39345
I20260505 20:13:50.402907 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:50.403131 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.403422 7936 raft_consensus.cc:2468] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.405823 8053 tablet_bootstrap.cc:492] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.405952 8053 ts_tablet_manager.cc:1403] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260505 20:13:50.405994 9498 ts_manager.cc:194] Registered new tserver with Master: c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:50.410274 9619 raft_consensus.cc:493] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.410487 9619 raft_consensus.cc:515] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.411252 9619 leader_election.cc:290] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.412003 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.412308 7930 raft_consensus.cc:2393] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:50.412613 8053 raft_consensus.cc:359] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.412774 8053 raft_consensus.cc:385] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.412825 8053 raft_consensus.cc:740] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.412771 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799f3fc33c48436da61cc0cfbf0b0218" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.413021 8053 consensus_queue.cc:260] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.413522 8053 ts_tablet_manager.cc:1434] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260505 20:13:50.413827 8053 tablet_bootstrap.cc:492] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.397652 7711 heartbeater.cc:344] Connected to a master server at 127.7.33.253:39345
I20260505 20:13:50.415171 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:50.417028 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84922625c3194035b827e8bdfbb49f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:50.417425 9271 ts_tablet_manager.cc:1929] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.417517 9271 log.cc:1199] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
I20260505 20:13:50.402261 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ab5b85e6d24e14a8e7507003eed5d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:50.417872 9271 ts_tablet_manager.cc:1950] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.418748 8053 tablet_bootstrap.cc:654] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.419727 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 162) took 12991 ms. Trace:
I20260505 20:13:50.419816 9271 rpcz_store.cc:276] 0505 20:13:37.428445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.428495 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:50.372230 (+12943735us) ts_tablet_manager.cc:1151] Deleting tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
0505 20:13:50.372239 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.400046 (+ 27807us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.417367 (+ 17321us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.419711 (+ 2344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12943578}
I20260505 20:13:50.420164 9271 tablet_replica.cc:333] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.420359 9271 raft_consensus.cc:2243] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:50.420370 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 (table default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]) successfully deleted
I20260505 20:13:50.420588 9271 pending_rounds.cc:70] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:50.420642 9271 pending_rounds.cc:77] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7282737274427002880 op_type: NO_OP noop_request { }
I20260505 20:13:50.420733 9271 raft_consensus.cc:2889] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:50.420805 9271 raft_consensus.cc:2272] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.397634 7405 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_bf48cc2ebe77443c9853c922b28b8897" } modify_external_catalogs: true
I20260505 20:13:50.422667 7405 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_bf48cc2ebe77443c9853c922b28b8897" } modify_external_catalogs: true
I20260505 20:13:50.425107 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.426517 7870 leader_election.cc:343] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.427532 9271 ts_tablet_manager.cc:1916] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.434700 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet dbd23fcf8a2b423ba77086aa4e01c50f
I20260505 20:13:50.434690 7596 leader_election.cc:304] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:50.435276 7407 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 194) took 5908 ms. Trace:
I20260505 20:13:50.435303 10281 raft_consensus.cc:2804] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.435462 10281 raft_consensus.cc:697] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:50.435631 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd23fcf8a2b423ba77086aa4e01c50f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:50.435405 7407 rpcz_store.cc:276] 0505 20:13:44.527102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.582546 (+2055444us) service_pool.cc:224] Handling call
0505 20:13:46.583090 (+ 544us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:46.583247 (+ 157us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:46.583312 (+ 65us) catalog_manager.cc:2824] Locking tablets
0505 20:13:46.583492 (+ 180us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:46.599991 (+ 16499us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:46.600080 (+ 89us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:50.434622 (+3834542us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:50.435227 (+ 605us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.594938 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.595071 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.595078 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:46.595080 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.595188 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.595197 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.595202 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.595310 (+ 108us) tablet.cc:701] Row locks acquired
0505 20:13:46.595313 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:46.595347 (+ 34us) write_op.cc:270] Start()
0505 20:13:46.595378 (+ 31us) write_op.cc:276] Timestamp: P: 1778012026595507 usec, L: 0
0505 20:13:46.595381 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.595540 (+ 159us) log.cc:844] Serialized 728 byte log entry
0505 20:13:46.599158 (+ 3618us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.599329 (+ 171us) write_op.cc:301] APPLY: starting
0505 20:13:46.599343 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.599382 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.599407 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.599470 (+ 63us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.599504 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:46.599513 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:46.599575 (+ 62us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.599623 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.599642 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:46.599648 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.599715 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.599718 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":380,"apply.run_wall_time_us":380,"mutex_wait_us":9858,"num_ops":2,"prepare.queue_time_us":9907,"prepare.run_cpu_time_us":696,"prepare.run_wall_time_us":2006,"replication_time_us":3752}]]}
I20260505 20:13:50.435745 10281 consensus_queue.cc:237] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.436167 7407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_095ae1e51561487880dc7e039bc823b2" } new_table_name: "default.Table_a41cab9b68a142c9b7665c88d0d0ca7d" modify_external_catalogs: true
I20260505 20:13:50.437107 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.437335 7930 raft_consensus.cc:2468] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.437919 8054 tablet_bootstrap.cc:492] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.439404 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd23fcf8a2b423ba77086aa4e01c50f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:50.439659 8054 tablet_bootstrap.cc:654] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.450191 9271 ts_tablet_manager.cc:1929] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:50.450317 9271 log.cc:1199] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/20c24f9f26c84ba7b2ce85f9da4bccf8
I20260505 20:13:50.450676 9271 ts_tablet_manager.cc:1950] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.451236 7596 leader_election.cc:304] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:50.451725 9495 raft_consensus.cc:2804] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.451807 9495 raft_consensus.cc:493] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.451882 9495 raft_consensus.cc:3060] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.452065 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 185) took 11710 ms. Trace:
I20260505 20:13:50.452204 9121 rpcz_store.cc:276] 0505 20:13:38.741392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.748618 (+ 7226us) service_pool.cc:224] Handling call
0505 20:13:50.310910 (+11562292us) ts_tablet_manager.cc:1151] Deleting tablet be05357416b24dabaaa5f2ce2f33c82e
0505 20:13:50.310919 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.358304 (+ 47385us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.360898 (+ 2594us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.452019 (+ 91121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11562005}
I20260505 20:13:50.452659 9121 tablet_replica.cc:333] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:50.454443 9270 ts_tablet_manager.cc:1929] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.454545 9270 log.cc:1199] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/54becbd4690c403e803a7a79f12cb6d5
I20260505 20:13:50.454883 9270 ts_tablet_manager.cc:1950] T 54becbd4690c403e803a7a79f12cb6d5 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:50.454980 9495 raft_consensus.cc:515] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.455713 9495 leader_election.cc:290] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.455991 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet be05357416b24dabaaa5f2ce2f33c82e (table default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4]) successfully deleted
I20260505 20:13:50.456604 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 164) took 13022 ms. Trace:
I20260505 20:13:50.456701 9271 rpcz_store.cc:276] 0505 20:13:37.433638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.433682 (+ 44us) service_pool.cc:224] Handling call
0505 20:13:50.420121 (+12986439us) ts_tablet_manager.cc:1151] Deleting tablet 20c24f9f26c84ba7b2ce85f9da4bccf8
0505 20:13:50.420131 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.430576 (+ 10445us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.450120 (+ 19544us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.456584 (+ 6464us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12986216}
I20260505 20:13:50.457041 9271 tablet_replica.cc:333] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.457166 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 (table default.Table_133f54e3650c43b59175c563864bd932 [id=5248510b86d2424eb2167fd9a12ec41e]) successfully deleted
I20260505 20:13:50.457231 9271 raft_consensus.cc:2243] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.457391 9271 raft_consensus.cc:2272] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:50.457496 7598 leader_election.cc:343] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: f5dfabb36fa5499780b0d15c71404307
I20260505 20:13:50.457979 9271 ts_tablet_manager.cc:1916] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:50.458422 7407 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06ad0e52c8b346cd920b35701fb23328 consensus state has no leader
I20260505 20:13:50.463037 9619 raft_consensus.cc:493] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.463248 9619 raft_consensus.cc:515] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.464033 9619 leader_election.cc:290] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.465711 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet dbd23fcf8a2b423ba77086aa4e01c50f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:42188
W20260505 20:13:50.466282 7409 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 907b7dccd7a94115aca36915a558b103 consensus state has no leader
I20260505 20:13:50.466747 7410 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 8cc695d3e3f941bbbe0d208c9f3572ee
I20260505 20:13:50.467329 7410 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 188) took 7198 ms. Trace:
I20260505 20:13:50.467453 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cc695d3e3f941bbbe0d208c9f3572ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:50.467428 7410 rpcz_store.cc:276] 0505 20:13:43.269047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.522441 (+3253394us) service_pool.cc:224] Handling call
0505 20:13:46.522946 (+ 505us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:46.523089 (+ 143us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:46.523161 (+ 72us) catalog_manager.cc:2824] Locking tablets
0505 20:13:46.523333 (+ 172us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:46.533872 (+ 10539us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:46.534022 (+ 150us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:50.466706 (+3932684us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:50.467244 (+ 538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.524522 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.524630 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.524635 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:46.524637 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.524739 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.524752 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.524756 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.524850 (+ 94us) tablet.cc:701] Row locks acquired
0505 20:13:46.524853 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:46.524890 (+ 37us) write_op.cc:270] Start()
0505 20:13:46.524918 (+ 28us) write_op.cc:276] Timestamp: P: 1778012026525022 usec, L: 0
0505 20:13:46.524923 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.527047 (+ 2124us) log.cc:844] Serialized 728 byte log entry
0505 20:13:46.530675 (+ 3628us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.530910 (+ 235us) write_op.cc:301] APPLY: starting
0505 20:13:46.530926 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.530971 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.530996 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.531060 (+ 64us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.531093 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:46.531100 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.531170 (+ 70us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.531226 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.531245 (+ 19us) write_op.cc:454] Released schema lock
0505 20:13:46.531251 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.531314 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.531317 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":185,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":398,"num_ops":2,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":745,"prepare.run_wall_time_us":3649,"raft.queue_time_us":36,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"replication_time_us":5722}]]}
I20260505 20:13:50.468231 7410 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_af2341b021674fe494cd635374e98c3e" } new_table_name: "default.Table_62ee92145c3c4d44950043e4f19c5b15" modify_external_catalogs: true
I20260505 20:13:50.468865 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cc695d3e3f941bbbe0d208c9f3572ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:50.469339 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cc695d3e3f941bbbe0d208c9f3572ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:50.471155 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc9a6e1c824305869f6634192c5e78" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.471617 7407 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 196) took 5668 ms. Trace:
I20260505 20:13:50.471732 7407 rpcz_store.cc:276] 0505 20:13:44.802919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.436003 (+5633084us) service_pool.cc:224] Handling call
0505 20:13:50.436328 (+ 325us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:50.436542 (+ 214us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:50.436745 (+ 203us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:50.436826 (+ 81us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:50.458158 (+ 21332us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:50.471578 (+ 13420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.437435 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.437548 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.437556 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:50.437558 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.437665 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.437681 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.437685 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:50.437777 (+ 92us) tablet.cc:701] Row locks acquired
0505 20:13:50.437780 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.437814 (+ 34us) write_op.cc:270] Start()
0505 20:13:50.437849 (+ 35us) write_op.cc:276] Timestamp: P: 1778012030437871 usec, L: 0
0505 20:13:50.437855 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.438040 (+ 185us) log.cc:844] Serialized 405 byte log entry
0505 20:13:50.443321 (+ 5281us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.443431 (+ 110us) write_op.cc:301] APPLY: starting
0505 20:13:50.443450 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.443497 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.443523 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.443583 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.443627 (+ 44us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:50.443633 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:50.443715 (+ 82us) log.cc:844] Serialized 23 byte log entry
0505 20:13:50.443777 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.443798 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:50.443804 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.443878 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.443881 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59,"apply.run_cpu_time_us":437,"apply.run_wall_time_us":436,"num_ops":1,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":737,"prepare.run_wall_time_us":736,"raft.queue_time_us":652,"raft.run_cpu_time_us":705,"raft.run_wall_time_us":703,"replication_time_us":5432}]]}
W20260505 20:13:50.472276 7870 leader_election.cc:343] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.472993 7409 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 193) took 5973 ms. Trace:
I20260505 20:13:50.473088 7409 rpcz_store.cc:276] 0505 20:13:44.499188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.576100 (+2076912us) service_pool.cc:224] Handling call
0505 20:13:46.576475 (+ 375us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:46.576703 (+ 228us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:46.576895 (+ 192us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:46.576974 (+ 79us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:46.596995 (+ 20021us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:50.472937 (+3875942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.591254 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.591461 (+ 207us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.591467 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:46.591470 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:46.591580 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.591596 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.591600 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:46.591669 (+ 69us) tablet.cc:701] Row locks acquired
0505 20:13:46.591672 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:46.591706 (+ 34us) write_op.cc:270] Start()
0505 20:13:46.591742 (+ 36us) write_op.cc:276] Timestamp: P: 1778012026591865 usec, L: 0
0505 20:13:46.591746 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.591929 (+ 183us) log.cc:844] Serialized 405 byte log entry
0505 20:13:46.596095 (+ 4166us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.596209 (+ 114us) write_op.cc:301] APPLY: starting
0505 20:13:46.596239 (+ 30us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.596286 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.596323 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.596379 (+ 56us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.596418 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:46.596425 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.596496 (+ 71us) log.cc:844] Serialized 23 byte log entry
0505 20:13:46.596553 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.596568 (+ 15us) write_op.cc:454] Released schema lock
0505 20:13:46.596574 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.596642 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.596646 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":425,"apply.run_wall_time_us":424,"num_ops":1,"prepare.queue_time_us":13736,"prepare.run_cpu_time_us":735,"prepare.run_wall_time_us":1297,"raft.queue_time_us":40,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":285,"replication_time_us":4319}]]}
I20260505 20:13:50.474006 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_a22be686199c4d04853e7e11967bd0f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.474740 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22be686199c4d04853e7e11967bd0f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.475133 9271 ts_tablet_manager.cc:1929] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.475251 9271 log.cc:1199] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1aaff49cb0ff4298be24603b2015c8a4
I20260505 20:13:50.475549 9271 ts_tablet_manager.cc:1950] T 1aaff49cb0ff4298be24603b2015c8a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.475570 9121 raft_consensus.cc:2243] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.475872 9121 raft_consensus.cc:2272] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.476372 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 165) took 13042 ms. Trace:
I20260505 20:13:50.476459 9271 rpcz_store.cc:276] 0505 20:13:37.434106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.434145 (+ 39us) service_pool.cc:224] Handling call
0505 20:13:50.456993 (+13022848us) ts_tablet_manager.cc:1151] Deleting tablet 1aaff49cb0ff4298be24603b2015c8a4
0505 20:13:50.457002 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.460983 (+ 3981us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.475072 (+ 14089us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.476351 (+ 1279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13022715}
I20260505 20:13:50.476589 9495 consensus_queue.cc:1048] T 3535f0c31ad5451ea5bceeb50f756eef P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.476769 9271 tablet_replica.cc:333] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.476958 9271 raft_consensus.cc:2243] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.476987 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1aaff49cb0ff4298be24603b2015c8a4 (table default.Table_d6c96dbb361b457684823113cd6727ea [id=5b2af32ce8704ee4b48ebeb114130d6b]) successfully deleted
I20260505 20:13:50.477106 9271 raft_consensus.cc:2272] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.477233 9121 ts_tablet_manager.cc:1916] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.477598 9271 ts_tablet_manager.cc:1916] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.485387 8054 tablet_bootstrap.cc:492] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.488734 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 198) took 4411 ms. Trace:
I20260505 20:13:50.488840 7409 rpcz_store.cc:276] 0505 20:13:46.076911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.473789 (+4396878us) service_pool.cc:224] Handling call
0505 20:13:50.474899 (+ 1110us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.475459 (+ 560us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.488479 (+ 13020us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.488583 (+ 104us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.488670 (+ 87us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.476164 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.476283 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.476289 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:50.476291 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.476382 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.476396 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.476400 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.476483 (+ 83us) tablet.cc:701] Row locks acquired
0505 20:13:50.476488 (+ 5us) write_op.cc:260] PREPARE: finished
0505 20:13:50.476526 (+ 38us) write_op.cc:270] Start()
0505 20:13:50.476561 (+ 35us) write_op.cc:276] Timestamp: P: 1778012030476596 usec, L: 0
0505 20:13:50.476565 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.476752 (+ 187us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.480357 (+ 3605us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.480473 (+ 116us) write_op.cc:301] APPLY: starting
0505 20:13:50.480492 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.480550 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.480596 (+ 46us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.480734 (+ 138us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.480782 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.480793 (+ 11us) write_op.cc:312] APPLY: finished
0505 20:13:50.480882 (+ 89us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.480946 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.480971 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:50.480980 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.481071 (+ 91us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.481078 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":583,"apply.run_wall_time_us":581,"num_ops":2,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":703,"prepare.run_wall_time_us":703,"raft.queue_time_us":502,"raft.run_cpu_time_us":613,"raft.run_wall_time_us":613,"replication_time_us":3751,"spinlock_wait_cycles":14592}]]}
I20260505 20:13:50.485570 8054 ts_tablet_manager.cc:1403] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.000s
I20260505 20:13:50.490025 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_eabba64f8cfd46b79633f42b297da738"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.490599 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eabba64f8cfd46b79633f42b297da738 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.490612 8054 raft_consensus.cc:359] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.491225 8054 raft_consensus.cc:385] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.493124 7410 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 197) took 4469 ms. Trace:
I20260505 20:13:50.493233 7410 rpcz_store.cc:276] 0505 20:13:46.023243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.468044 (+4444801us) service_pool.cc:224] Handling call
0505 20:13:50.480323 (+ 12279us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:50.480577 (+ 254us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:50.480748 (+ 171us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:50.480833 (+ 85us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:50.492687 (+ 11854us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:50.493080 (+ 393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.481456 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.481544 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.481551 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:50.481553 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.481645 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.481659 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.481665 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:50.481723 (+ 58us) tablet.cc:701] Row locks acquired
0505 20:13:50.481727 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:50.481780 (+ 53us) write_op.cc:270] Start()
0505 20:13:50.481808 (+ 28us) write_op.cc:276] Timestamp: P: 1778012030481853 usec, L: 0
0505 20:13:50.481813 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.481955 (+ 142us) log.cc:844] Serialized 405 byte log entry
0505 20:13:50.486599 (+ 4644us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.491915 (+ 5316us) write_op.cc:301] APPLY: starting
0505 20:13:50.491934 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.491975 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.491997 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.492043 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.492072 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:50.492079 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:50.492143 (+ 64us) log.cc:844] Serialized 23 byte log entry
0505 20:13:50.492207 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.492221 (+ 14us) write_op.cc:454] Released schema lock
0505 20:13:50.492227 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.492286 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.492290 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5247,"apply.run_cpu_time_us":374,"apply.run_wall_time_us":375,"num_ops":1,"prepare.queue_time_us":190,"prepare.run_cpu_time_us":557,"prepare.run_wall_time_us":558,"replication_time_us":4756}]]}
I20260505 20:13:50.493991 7410 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_6825628c592243e0996f4b1cd6f3d30c" } new_table_name: "default.Table_859d395c7b674d92b89e3f922f7b8db5" modify_external_catalogs: true
I20260505 20:13:50.496750 9271 ts_tablet_manager.cc:1929] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.496861 9271 log.cc:1199] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8e650b297603425184ad97ddf99ec36d
I20260505 20:13:50.497447 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_40ea5fef14794773a98ea223a7f8115d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:50.497565 10307 consensus_queue.cc:1048] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:50.498317 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ea5fef14794773a98ea223a7f8115d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.500465 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 199) took 4343 ms. Trace:
I20260505 20:13:50.500560 7409 rpcz_store.cc:276] 0505 20:13:46.156840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.489816 (+4332976us) service_pool.cc:224] Handling call
0505 20:13:50.490702 (+ 886us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.491254 (+ 552us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.500232 (+ 8978us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.500324 (+ 92us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.500400 (+ 76us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.491729 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.491819 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.491824 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:50.491826 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.491900 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.491909 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.491914 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.491984 (+ 70us) tablet.cc:701] Row locks acquired
0505 20:13:50.491987 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.492015 (+ 28us) write_op.cc:270] Start()
0505 20:13:50.492042 (+ 27us) write_op.cc:276] Timestamp: P: 1778012030492095 usec, L: 0
0505 20:13:50.492045 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.492212 (+ 167us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.498489 (+ 6277us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.498975 (+ 486us) write_op.cc:301] APPLY: starting
0505 20:13:50.498991 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.499032 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.499075 (+ 43us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.499190 (+ 115us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.499223 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.499230 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:50.499297 (+ 67us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.499354 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.499371 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:50.499377 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.499436 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.499440 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":428,"apply.run_cpu_time_us":458,"apply.run_wall_time_us":458,"num_ops":2,"prepare.queue_time_us":44,"prepare.run_cpu_time_us":557,"prepare.run_wall_time_us":557,"raft.queue_time_us":97,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"replication_time_us":6416}]]}
I20260505 20:13:50.502359 7409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_feafef8bf3e64e14b0fe7067ffa9c9fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.502983 7409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_feafef8bf3e64e14b0fe7067ffa9c9fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.509464 7404 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_7b6a139d5f9b4d20a41265ef5910a4ef [id=e15ceb414ab94d7a9f3faca77320faf0] alter complete (version 1)
I20260505 20:13:50.512959 9271 ts_tablet_manager.cc:1950] T 8e650b297603425184ad97ddf99ec36d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.513895 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 166) took 13079 ms. Trace:
I20260505 20:13:50.513984 9619 raft_consensus.cc:493] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.513993 9271 rpcz_store.cc:276] 0505 20:13:37.434435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.434472 (+ 37us) service_pool.cc:224] Handling call
0505 20:13:50.476718 (+13042246us) ts_tablet_manager.cc:1151] Deleting tablet 8e650b297603425184ad97ddf99ec36d
0505 20:13:50.476730 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.493971 (+ 17241us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.496699 (+ 2728us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.513872 (+ 17173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13042122}
I20260505 20:13:50.514322 9271 tablet_replica.cc:333] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.514513 9271 raft_consensus.cc:2243] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.514496 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 8e650b297603425184ad97ddf99ec36d (table default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]) successfully deleted
I20260505 20:13:50.514667 9271 raft_consensus.cc:2272] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.514132 9619 raft_consensus.cc:515] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.515272 9271 ts_tablet_manager.cc:1916] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.515373 9619 leader_election.cc:290] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:50.518131 7410 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e6c46a2b6fe4edf857b2a4570dbee7c consensus state has no leader
I20260505 20:13:50.518297 7410 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 200) took 4061 ms. Trace:
I20260505 20:13:50.518435 7410 rpcz_store.cc:276] 0505 20:13:46.456398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.493844 (+4037446us) service_pool.cc:224] Handling call
0505 20:13:50.494155 (+ 311us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:50.494368 (+ 213us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:50.494515 (+ 147us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:50.494582 (+ 67us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:50.517820 (+ 23238us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:50.518268 (+ 448us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.495489 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.495584 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.495590 (+ 6us) write_op.cc:435] Acquired schema lock
0505 20:13:50.495592 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.495675 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.495683 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.495687 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:50.495735 (+ 48us) tablet.cc:701] Row locks acquired
0505 20:13:50.495738 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.495765 (+ 27us) write_op.cc:270] Start()
0505 20:13:50.495810 (+ 45us) write_op.cc:276] Timestamp: P: 1778012030495847 usec, L: 0
0505 20:13:50.495814 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.495966 (+ 152us) log.cc:844] Serialized 405 byte log entry
0505 20:13:50.513361 (+ 17395us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.513689 (+ 328us) write_op.cc:301] APPLY: starting
0505 20:13:50.513706 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.513794 (+ 88us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.513826 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.513875 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.513908 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:50.513920 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:50.513998 (+ 78us) log.cc:844] Serialized 23 byte log entry
0505 20:13:50.514063 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.514080 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:50.514086 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.514151 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.514155 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":272,"apply.run_cpu_time_us":457,"apply.run_wall_time_us":457,"num_ops":1,"prepare.queue_time_us":514,"prepare.run_cpu_time_us":539,"prepare.run_wall_time_us":539,"replication_time_us":17516}]]}
I20260505 20:13:50.522707 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 201) took 3965 ms. Trace:
I20260505 20:13:50.522851 7407 rpcz_store.cc:276] 0505 20:13:46.557489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.497275 (+3939786us) service_pool.cc:224] Handling call
0505 20:13:50.498406 (+ 1131us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.498833 (+ 427us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.522436 (+ 23603us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.522578 (+ 142us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.522662 (+ 84us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.499283 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.499381 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.499386 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:50.499388 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.499467 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.499475 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.499479 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.499538 (+ 59us) tablet.cc:701] Row locks acquired
0505 20:13:50.499540 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:50.499598 (+ 58us) write_op.cc:270] Start()
0505 20:13:50.499624 (+ 26us) write_op.cc:276] Timestamp: P: 1778012030499650 usec, L: 0
0505 20:13:50.499628 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.499748 (+ 120us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.513426 (+ 13678us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.514236 (+ 810us) write_op.cc:301] APPLY: starting
0505 20:13:50.514247 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.514300 (+ 53us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.514321 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.514430 (+ 109us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.514457 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.514463 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:50.514527 (+ 64us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.514572 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.514585 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:50.514590 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":773,"apply.run_cpu_time_us":409,"apply.run_wall_time_us":408,"num_ops":2,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":508,"prepare.run_wall_time_us":507,"replication_time_us":13783,"threads_started":1}]]}
I20260505 20:13:50.528153 7411 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 7382e748682547b1a41781ff05c6733d
W20260505 20:13:50.528261 7408 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1205ac0117464cff99a742ac112a2178 consensus state has no leader
I20260505 20:13:50.528494 7408 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:39198 (request call id 178) took 8193 ms. Trace:
I20260505 20:13:50.528839 7411 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:39198 (request call id 184) took 7610 ms. Trace:
I20260505 20:13:50.529032 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 7382e748682547b1a41781ff05c6733d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:50.528651 7408 rpcz_store.cc:276] 0505 20:13:42.335124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.044716 (+3709592us) service_pool.cc:224] Handling call
0505 20:13:46.248288 (+203572us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:46.248527 (+ 239us) catalog_manager.cc:3725] Apply alter schema
0505 20:13:46.354645 (+106118us) catalog_manager.cc:3757] Acquired catalog manager lock
0505 20:13:46.354770 (+ 125us) catalog_manager.cc:3915] Updating metadata on disk
0505 20:13:46.365310 (+ 10540us) catalog_manager.cc:3946] Committing alterations to in-memory state
0505 20:13:50.528441 (+4163131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.355419 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.355549 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.355556 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:46.355559 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:46.355667 (+ 108us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.355684 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.355689 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0505 20:13:46.355760 (+ 71us) tablet.cc:701] Row locks acquired
0505 20:13:46.355762 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.355804 (+ 42us) write_op.cc:270] Start()
0505 20:13:46.355839 (+ 35us) write_op.cc:276] Timestamp: P: 1778012026355869 usec, L: 0
0505 20:13:46.355843 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.356066 (+ 223us) log.cc:844] Serialized 405 byte log entry
0505 20:13:46.364532 (+ 8466us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.364701 (+ 169us) write_op.cc:301] APPLY: starting
0505 20:13:46.364721 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.364772 (+ 51us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.364827 (+ 55us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.364918 (+ 91us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.364963 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:46.364971 (+ 8us) write_op.cc:312] APPLY: finished
0505 20:13:46.365085 (+ 114us) log.cc:844] Serialized 23 byte log entry
0505 20:13:46.365164 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.365193 (+ 29us) write_op.cc:454] Released schema lock
0505 20:13:46.365200 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.365303 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.365311 (+ 8us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":108,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":588,"num_ops":1,"prepare.queue_time_us":89,"prepare.run_cpu_time_us":767,"prepare.run_wall_time_us":767,"raft.queue_time_us":258,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":409,"replication_time_us":8648,"spinlock_wait_cycles":128896}]]}
I20260505 20:13:50.529678 9121 ts_tablet_manager.cc:1929] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.529855 9121 log.cc:1199] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ec3374a8f51d4c1a94dbd24d4a9da0af
I20260505 20:13:50.528957 7411 rpcz_store.cc:276] 0505 20:13:42.918372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:46.478092 (+3559720us) service_pool.cc:224] Handling call
0505 20:13:46.487890 (+ 9798us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0505 20:13:46.489936 (+ 2046us) catalog_manager.cc:2815] Modifying in-memory table state
0505 20:13:46.490758 (+ 822us) catalog_manager.cc:2824] Locking tablets
0505 20:13:46.493519 (+ 2761us) catalog_manager.cc:2838] Removing table and tablets from system table
0505 20:13:46.515615 (+ 22096us) catalog_manager.cc:2856] Removing table from by-name map
0505 20:13:46.515771 (+ 156us) catalog_manager.cc:2872] Committing in-memory state
0505 20:13:50.528091 (+4012320us) catalog_manager.cc:2876] Aborting table tasks
0505 20:13:50.528771 (+ 680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:46.505250 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:46.505343 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:46.505348 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:46.505350 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:46.505450 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:46.505460 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:46.505464 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:46.505564 (+ 100us) tablet.cc:701] Row locks acquired
0505 20:13:46.505566 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:46.505598 (+ 32us) write_op.cc:270] Start()
0505 20:13:46.505625 (+ 27us) write_op.cc:276] Timestamp: P: 1778012026505724 usec, L: 0
0505 20:13:46.505630 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:46.505822 (+ 192us) log.cc:844] Serialized 728 byte log entry
0505 20:13:46.514991 (+ 9169us) op_driver.cc:464] REPLICATION: finished
0505 20:13:46.515109 (+ 118us) write_op.cc:301] APPLY: starting
0505 20:13:46.515128 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:46.515175 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:46.515211 (+ 36us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:46.515285 (+ 74us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:46.515321 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0505 20:13:46.515328 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:46.515412 (+ 84us) log.cc:844] Serialized 29 byte log entry
0505 20:13:46.515477 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.515498 (+ 21us) write_op.cc:454] Released schema lock
0505 20:13:46.515505 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:46.515576 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:46.515580 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":66,"apply.run_cpu_time_us":461,"apply.run_wall_time_us":461,"num_ops":2,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":630,"replication_time_us":9327}]]}
I20260505 20:13:50.530179 9121 ts_tablet_manager.cc:1950] T ec3374a8f51d4c1a94dbd24d4a9da0af P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:50.532546 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet 7382e748682547b1a41781ff05c6733d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:50.533270 9271 ts_tablet_manager.cc:1929] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.533406 9271 log.cc:1199] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/28ce3efe875a43d9b30d40623bf8a385
I20260505 20:13:50.542866 9271 ts_tablet_manager.cc:1950] T 28ce3efe875a43d9b30d40623bf8a385 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.543422 10307 raft_consensus.cc:493] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.543557 10307 raft_consensus.cc:515] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.543781 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 167) took 13108 ms. Trace:
I20260505 20:13:50.543867 9271 rpcz_store.cc:276] 0505 20:13:37.434869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.434910 (+ 41us) service_pool.cc:224] Handling call
0505 20:13:50.514276 (+13079366us) ts_tablet_manager.cc:1151] Deleting tablet 28ce3efe875a43d9b30d40623bf8a385
0505 20:13:50.514286 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.530074 (+ 15788us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.533202 (+ 3128us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.543757 (+ 10555us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13079237}
I20260505 20:13:50.544183 10307 leader_election.cc:290] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.544667 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 28ce3efe875a43d9b30d40623bf8a385 (table default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]) successfully deleted
I20260505 20:13:50.528425 9906 raft_consensus.cc:493] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:50.547964 9906 raft_consensus.cc:515] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } }
I20260505 20:13:50.548717 9906 leader_election.cc:290] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:50.529062 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c591e3f33d4606be7181e380fadcf6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.529439 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 7382e748682547b1a41781ff05c6733d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-05 20:13:46 UTC) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:50.545614 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.549444 7736 leader_election.cc:343] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.549886 7870 leader_election.cc:343] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.558216 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 140) took 13184 ms. Trace:
I20260505 20:13:50.558350 9270 rpcz_store.cc:276] 0505 20:13:37.373790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.373923 (+ 133us) service_pool.cc:224] Handling call
0505 20:13:49.709195 (+12335272us) ts_tablet_manager.cc:1151] Deleting tablet 54becbd4690c403e803a7a79f12cb6d5
0505 20:13:49.709207 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:49.857131 (+147924us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x616000154c54. stack: 00007fd6a5153086 00007fd6a5152e40 00007fd6a410c3ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007fd6b10a4f23 00007fd6b23f8283 00007fd6b4fbda77 00007fd6b4ff0b44 00007fd6b4fd1560 00007fd6b4fd12ed 0000000000aa4cac 00007fd6a5198f6f 00007fd6a519c28b 00007fd6a519c108
0505 20:13:50.392253 (+535122us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.454386 (+ 62133us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.558188 (+103802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86616832,"tablet-delete.queue_time_us":12335127}
I20260505 20:13:50.558883 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 54becbd4690c403e803a7a79f12cb6d5 (table default.Table_98748ee269264963be11b33de38e1d1e [id=46cde0b7c30d4eae8254a080cb8caac8]) successfully deleted
I20260505 20:13:50.562852 9270 tablet_replica.cc:333] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:50.563176 9270 raft_consensus.cc:2243] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.563410 9270 raft_consensus.cc:2272] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.564039 9270 ts_tablet_manager.cc:1916] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.564191 8058 tablet_bootstrap.cc:492] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.564321 8058 ts_tablet_manager.cc:1403] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.178s user 0.013s sys 0.029s
I20260505 20:13:50.564587 9906 consensus_queue.cc:1048] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.564981 8058 raft_consensus.cc:359] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.565137 8058 raft_consensus.cc:385] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.565193 8058 raft_consensus.cc:740] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.565366 8058 consensus_queue.cc:260] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.565863 8058 ts_tablet_manager.cc:1434] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260505 20:13:50.566134 8058 tablet_bootstrap.cc:492] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.567476 8058 tablet_bootstrap.cc:654] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.569406 8053 tablet_bootstrap.cc:492] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.569553 8053 ts_tablet_manager.cc:1403] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.156s user 0.016s sys 0.025s
I20260505 20:13:50.570282 8053 raft_consensus.cc:359] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.570453 8053 raft_consensus.cc:385] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.570515 8053 raft_consensus.cc:740] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.570698 8053 consensus_queue.cc:260] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.571228 8053 ts_tablet_manager.cc:1434] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:50.571623 8053 tablet_bootstrap.cc:492] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.573374 8053 tablet_bootstrap.cc:654] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.576256 8058 tablet_bootstrap.cc:492] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.576390 8058 ts_tablet_manager.cc:1403] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260505 20:13:50.577059 8058 raft_consensus.cc:359] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.577108 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb5e21649a4cc39764a3847fa41c21" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.577224 8058 raft_consensus.cc:385] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.577272 8058 raft_consensus.cc:740] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.577342 7934 raft_consensus.cc:2468] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.577744 8058 consensus_queue.cc:260] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.578284 8058 ts_tablet_manager.cc:1434] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.578574 8058 tablet_bootstrap.cc:492] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
W20260505 20:13:50.579088 7598 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421
W20260505 20:13:50.579270 7596 leader_election.cc:343] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: cb5cfc700aff4082ae089476e2af044f
I20260505 20:13:50.579454 7596 leader_election.cc:304] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:50.580612 9944 consensus_queue.cc:1048] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.580912 9495 raft_consensus.cc:2749] T cb5cfc700aff4082ae089476e2af044f P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:50.583123 7869 leader_election.cc:343] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.583272 7869 leader_election.cc:304] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.583653 9619 raft_consensus.cc:2749] T 160aa46d629247d0a46f433ef4088643 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.586531 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 188) took 11844 ms. Trace:
I20260505 20:13:50.587863 8053 tablet_bootstrap.cc:492] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.588012 8053 ts_tablet_manager.cc:1403] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260505 20:13:50.588649 8053 raft_consensus.cc:359] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.588819 8053 raft_consensus.cc:385] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.588871 8053 raft_consensus.cc:740] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.589095 8053 consensus_queue.cc:260] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.589625 8053 ts_tablet_manager.cc:1434] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.588889 9944 raft_consensus.cc:493] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.590420 9944 raft_consensus.cc:515] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.590963 9944 leader_election.cc:290] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.603657 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_bd80980cb57c4ada90ee385fb2aba768"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.604378 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd80980cb57c4ada90ee385fb2aba768 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260505 20:13:50.604879 7869 leader_election.cc:343] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.605010 7869 leader_election.cc:304] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.605533 10337 raft_consensus.cc:2749] T ae79f58b6c874103afffa963c45891a1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.605659 7411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_2b459106b61447888223447c59e0a007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:50.606029 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d78ebf153640e4b2f518fb215f1bf1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.606184 7411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b459106b61447888223447c59e0a007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.606216 7869 leader_election.cc:304] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.606424 10337 raft_consensus.cc:2804] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.606482 10337 raft_consensus.cc:493] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.606536 10337 raft_consensus.cc:3060] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:50.606506 7736 leader_election.cc:343] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.609448 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_07c3fedf259d4cb78e5ea08bd6799bb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260505 20:13:50.609628 10337 raft_consensus.cc:515] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
W20260505 20:13:50.609987 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07c3fedf259d4cb78e5ea08bd6799bb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.610292 10337 leader_election.cc:290] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.610850 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76178d1c329b4bf59fe3955f2893cd39" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.611346 7870 leader_election.cc:343] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.611696 7409 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 202) took 3958 ms. Trace:
I20260505 20:13:50.611784 7409 rpcz_store.cc:276] 0505 20:13:46.653446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.502174 (+3848728us) service_pool.cc:224] Handling call
0505 20:13:50.503157 (+ 983us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.503706 (+ 549us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.611454 (+107748us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.611550 (+ 96us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.611642 (+ 92us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.504326 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.504451 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.504460 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:50.504464 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:50.504571 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.504585 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.504592 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.504681 (+ 89us) tablet.cc:701] Row locks acquired
0505 20:13:50.504683 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:50.504705 (+ 22us) write_op.cc:270] Start()
0505 20:13:50.504730 (+ 25us) write_op.cc:276] Timestamp: P: 1778012030504791 usec, L: 0
0505 20:13:50.504733 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.504893 (+ 160us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.603509 (+ 98616us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.603596 (+ 87us) write_op.cc:301] APPLY: starting
0505 20:13:50.603617 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.603670 (+ 53us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.603720 (+ 50us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.603855 (+ 135us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.603926 (+ 71us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.603935 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:50.604082 (+ 147us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.604165 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.604187 (+ 22us) write_op.cc:454] Released schema lock
0505 20:13:50.604195 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":35,"apply.run_cpu_time_us":667,"apply.run_wall_time_us":666,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":644,"prepare.run_wall_time_us":644,"replication_time_us":98736}]]}
I20260505 20:13:50.614600 9944 raft_consensus.cc:493] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.614758 9944 raft_consensus.cc:515] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.615448 9944 leader_election.cc:290] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.616143 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ec070a0196451c9564fa24b806516c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.617048 7736 leader_election.cc:343] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.586634 9121 rpcz_store.cc:276] 0505 20:13:38.741778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.749289 (+ 7511us) service_pool.cc:224] Handling call
0505 20:13:50.452592 (+11703303us) ts_tablet_manager.cc:1151] Deleting tablet ec3374a8f51d4c1a94dbd24d4a9da0af
0505 20:13:50.452603 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.481824 (+ 29221us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.523179 (+ 41355us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.586507 (+ 63328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22624,"tablet-delete.queue_time_us":11703072}
I20260505 20:13:50.621659 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet ec3374a8f51d4c1a94dbd24d4a9da0af (table default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54]) successfully deleted
I20260505 20:13:50.621810 9121 tablet_replica.cc:333] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:50.622056 9121 raft_consensus.cc:2243] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.627035 7411 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 205) took 3947 ms. Trace:
I20260505 20:13:50.580363 8058 tablet_bootstrap.cc:654] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.627169 7411 rpcz_store.cc:276] 0505 20:13:46.679374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.530264 (+3850890us) service_pool.cc:224] Handling call
0505 20:13:50.605591 (+ 75327us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9741b13 00007f70d01d57c6 00007f70d01d54f5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:50.606268 (+ 677us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.606698 (+ 430us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.626180 (+ 19482us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.626301 (+ 121us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.626402 (+ 101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.608723 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.608804 (+ 81us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.608809 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:50.608811 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.608890 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.608898 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.608903 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.608956 (+ 53us) tablet.cc:701] Row locks acquired
0505 20:13:50.608959 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.608982 (+ 23us) write_op.cc:270] Start()
0505 20:13:50.609003 (+ 21us) write_op.cc:276] Timestamp: P: 1778012030609109 usec, L: 0
0505 20:13:50.609006 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.609133 (+ 127us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.615524 (+ 6391us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.618743 (+ 3219us) write_op.cc:301] APPLY: starting
0505 20:13:50.618753 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.618782 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.618804 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.618897 (+ 93us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.618923 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.618932 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:50.619000 (+ 68us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.619040 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.619056 (+ 16us) write_op.cc:454] Released schema lock
0505 20:13:50.619063 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":172715392,"child_traces":[["op",{"apply.queue_time_us":3188,"apply.run_cpu_time_us":402,"apply.run_wall_time_us":401,"num_ops":2,"prepare.queue_time_us":1571,"prepare.run_cpu_time_us":481,"prepare.run_wall_time_us":479,"raft.queue_time_us":387,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":7,"replication_time_us":6486,"threads_started":1}]]}
I20260505 20:13:50.544209 9271 tablet_replica.cc:333] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.630317 9271 raft_consensus.cc:2243] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.633378 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 204) took 3951 ms. Trace:
I20260505 20:13:50.630569 8053 tablet_bootstrap.cc:492] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.633615 7408 rpcz_store.cc:276] 0505 20:13:46.678422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.529465 (+3851043us) service_pool.cc:224] Handling call
0505 20:13:50.603586 (+ 74121us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9741b13 00007f70d01d57c6 00007f70d01d54f5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:50.604483 (+ 897us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.604949 (+ 466us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.626472 (+ 21523us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.630014 (+ 3542us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.630125 (+ 111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.608129 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.608245 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.608250 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:50.608252 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.608334 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.608344 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.608348 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.608431 (+ 83us) tablet.cc:701] Row locks acquired
0505 20:13:50.608433 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:50.608465 (+ 32us) write_op.cc:270] Start()
0505 20:13:50.608496 (+ 31us) write_op.cc:276] Timestamp: P: 1778012030608590 usec, L: 0
0505 20:13:50.608499 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.608633 (+ 134us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.615468 (+ 6835us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.618285 (+ 2817us) write_op.cc:301] APPLY: starting
0505 20:13:50.618296 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.618328 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.618359 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.618451 (+ 92us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.618479 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.618486 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:50.618562 (+ 76us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.618603 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.618616 (+ 13us) write_op.cc:454] Released schema lock
0505 20:13:50.618621 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.618681 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.618685 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":169780096,"child_traces":[["op",{"apply.queue_time_us":2784,"apply.run_cpu_time_us":389,"apply.run_wall_time_us":389,"num_ops":2,"prepare.queue_time_us":2709,"prepare.run_cpu_time_us":574,"prepare.run_wall_time_us":573,"raft.queue_time_us":867,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":6948}]]}
I20260505 20:13:50.635792 8053 tablet_bootstrap.cc:654] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.637090 10337 consensus_queue.cc:1048] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.637270 10031 raft_consensus.cc:493] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.637394 10031 raft_consensus.cc:515] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.637818 9121 raft_consensus.cc:2272] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.623471 9270 ts_tablet_manager.cc:1929] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.644028 10307 consensus_queue.cc:1048] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.644219 7737 leader_election.cc:304] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.644583 10307 raft_consensus.cc:2804] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.644680 10307 raft_consensus.cc:493] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.644784 10307 raft_consensus.cc:3060] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.647500 10307 raft_consensus.cc:515] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.648602 10307 leader_election.cc:290] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.649889 10306 raft_consensus.cc:493] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.649914 9271 raft_consensus.cc:2272] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.650058 10306 raft_consensus.cc:515] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.651513 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_3cb536c7aee840079709caef1337d17e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.652189 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cb536c7aee840079709caef1337d17e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.638525 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369f4a55fdd64e4bb907666bede9f241" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.651696 8058 tablet_bootstrap.cc:492] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.656857 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.657896 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907b7dccd7a94115aca36915a558b103" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.662508 8058 ts_tablet_manager.cc:1403] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.001s
I20260505 20:13:50.663051 9270 log.cc:1199] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/22a98da176254eeb896c680fbcb98caa
I20260505 20:13:50.663506 9270 ts_tablet_manager.cc:1950] T 22a98da176254eeb896c680fbcb98caa P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:50.663729 8058 raft_consensus.cc:359] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.663910 8058 raft_consensus.cc:385] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.663970 8058 raft_consensus.cc:740] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.664216 8058 consensus_queue.cc:260] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.664316 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 143) took 13290 ms. Trace:
I20260505 20:13:50.664405 9270 rpcz_store.cc:276] 0505 20:13:37.374058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.374536 (+ 478us) service_pool.cc:224] Handling call
0505 20:13:50.558878 (+13184342us) ts_tablet_manager.cc:1151] Deleting tablet 22a98da176254eeb896c680fbcb98caa
0505 20:13:50.562791 (+ 3913us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.567478 (+ 4687us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.623396 (+ 55918us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.664296 (+ 40900us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13184175}
I20260505 20:13:50.664731 8058 ts_tablet_manager.cc:1434] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.664885 9270 tablet_replica.cc:333] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:50.664873 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 22a98da176254eeb896c680fbcb98caa (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]) successfully deleted
I20260505 20:13:50.665023 8058 tablet_bootstrap.cc:492] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.665082 9270 raft_consensus.cc:2243] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.665234 9270 raft_consensus.cc:2272] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.665809 9270 ts_tablet_manager.cc:1916] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.666170 7413 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_0ef8400118a94669bd053c6bfd79b180 [id=81cca356ac0a4576af3226017a09f6f1] alter complete (version 1)
I20260505 20:13:50.667322 8058 tablet_bootstrap.cc:654] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.662325 10385 tablet.cc:1724] T 947a4d496d994b799d1688cc258a181d P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:50.637985 10031 leader_election.cc:290] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:50.638465 7869 leader_election.cc:343] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.639465 10276 consensus_queue.cc:1048] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.669302 7869 leader_election.cc:304] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.650761 9619 raft_consensus.cc:493] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:50.662881 7870 leader_election.cc:343] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.669540 10031 raft_consensus.cc:2749] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.669596 9121 ts_tablet_manager.cc:1916] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.669540 9619 raft_consensus.cc:515] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.670418 7869 leader_election.cc:304] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.670432 9619 leader_election.cc:290] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.670727 10031 raft_consensus.cc:2804] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.670822 10031 raft_consensus.cc:493] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.670892 10031 raft_consensus.cc:3060] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.670831 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb3d246d6b443b8933648fe4f4aa5c2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.671360 7870 leader_election.cc:343] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.673323 10031 raft_consensus.cc:515] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.674230 7869 leader_election.cc:304] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.674245 9619 consensus_queue.cc:1048] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.674485 10276 raft_consensus.cc:2804] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.674590 10276 raft_consensus.cc:697] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
W20260505 20:13:50.674623 7869 leader_election.cc:343] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.674697 7869 leader_election.cc:304] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.674892 9619 raft_consensus.cc:2749] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.674863 10276 consensus_queue.cc:237] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.675081 7869 leader_election.cc:304] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.675303 9619 raft_consensus.cc:2804] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.675395 7869 leader_election.cc:304] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.675423 9619 raft_consensus.cc:697] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:50.675570 10337 raft_consensus.cc:2749] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.675717 7869 leader_election.cc:304] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.675787 9619 consensus_queue.cc:237] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.675969 10337 raft_consensus.cc:2804] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.676023 10337 raft_consensus.cc:493] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.676090 10337 raft_consensus.cc:3060] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.676649 10031 leader_election.cc:290] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.677079 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.677541 7870 leader_election.cc:343] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.678982 10337 raft_consensus.cc:515] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.679594 10337 leader_election.cc:290] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.680130 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca1fb1425e347d191f3c5931d9bf224" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.680560 7870 leader_election.cc:343] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.659195 7598 consensus_peers.cc:597] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae8bd19470294a1db91855afe49be6a5. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.693471 10252 catalog_manager.cc:1269] Loaded cluster ID: 8e14917c53ec4295b4e8c6dc8fd1b1e5
I20260505 20:13:50.694062 9271 ts_tablet_manager.cc:1916] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.694093 10306 leader_election.cc:290] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:50.694620 7736 leader_election.cc:343] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.695709 7736 leader_election.cc:343] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.697170 10252 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: loading cluster ID for follower catalog manager: success
I20260505 20:13:50.701309 8058 tablet_bootstrap.cc:492] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.701478 8058 ts_tablet_manager.cc:1403] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.006s
I20260505 20:13:50.702378 8058 raft_consensus.cc:359] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.702556 8058 raft_consensus.cc:385] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.702608 8058 raft_consensus.cc:740] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
W20260505 20:13:50.702822 7737 leader_election.cc:343] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b17da5cf513647d9b8e582a9b3b460a1
I20260505 20:13:50.702996 7737 leader_election.cc:304] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.703290 10306 raft_consensus.cc:2749] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260505 20:13:50.703485 7737 consensus_peers.cc:597] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35ada922a36f4f329a5ff8b328dbef5f. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.703826 7737 leader_election.cc:304] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.704181 10306 raft_consensus.cc:2804] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.704281 10306 raft_consensus.cc:493] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.704314 7737 leader_election.cc:304] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.704406 10306 raft_consensus.cc:3060] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.704543 9975 raft_consensus.cc:2749] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.704707 7737 leader_election.cc:304] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.704916 9975 raft_consensus.cc:2749] T 799f3fc33c48436da61cc0cfbf0b0218 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.705123 7737 leader_election.cc:304] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.705348 9975 raft_consensus.cc:2804] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.705431 9975 raft_consensus.cc:493] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.705531 9975 raft_consensus.cc:3060] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.706037 7737 leader_election.cc:304] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.706568 9894 raft_consensus.cc:2804] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.706677 9894 raft_consensus.cc:493] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.706768 9894 raft_consensus.cc:3060] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.707147 10306 raft_consensus.cc:515] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.707331 9271 ts_tablet_manager.cc:1929] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.707441 9271 log.cc:1199] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/004a8e72cab44d31af3369b8df1e434e
I20260505 20:13:50.707789 10306 leader_election.cc:290] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.707877 9271 ts_tablet_manager.cc:1950] T 004a8e72cab44d31af3369b8df1e434e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.707988 9975 raft_consensus.cc:515] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.708647 9975 leader_election.cc:290] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.708701 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 168) took 13273 ms. Trace:
I20260505 20:13:50.708822 9271 rpcz_store.cc:276] 0505 20:13:37.435189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.435254 (+ 65us) service_pool.cc:224] Handling call
0505 20:13:50.544160 (+13108906us) ts_tablet_manager.cc:1151] Deleting tablet 004a8e72cab44d31af3369b8df1e434e
0505 20:13:50.544170 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.704250 (+160080us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.707240 (+ 2990us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.708656 (+ 1416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3544,"tablet-delete.queue_time_us":13108741}
I20260505 20:13:50.709192 9271 tablet_replica.cc:333] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.709435 9271 raft_consensus.cc:2243] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.709388 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 004a8e72cab44d31af3369b8df1e434e (table default.Table_d74b7092fc2d4c3aa335636b0905e53f [id=bc7111d081dd4f4ba06f987ca0b9d6a3]) successfully deleted
I20260505 20:13:50.709414 9894 raft_consensus.cc:515] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.709594 9271 raft_consensus.cc:2272] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.710223 9271 ts_tablet_manager.cc:1916] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.710878 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.711383 7736 leader_election.cc:343] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.711787 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.712222 7736 leader_election.cc:343] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.713514 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5dfabb36fa5499780b0d15c71404307" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.713708 7795 raft_consensus.cc:3060] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.716068 8058 consensus_queue.cc:260] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.716168 10386 tablet.cc:1724] T 947a4d496d994b799d1688cc258a181d P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:50.716303 7795 raft_consensus.cc:2468] T f5dfabb36fa5499780b0d15c71404307 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:50.716527 8058 ts_tablet_manager.cc:1434] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260505 20:13:50.716809 8058 tablet_bootstrap.cc:492] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.718573 8058 tablet_bootstrap.cc:654] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.720505 8053 tablet_bootstrap.cc:492] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.720729 8053 ts_tablet_manager.cc:1403] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.090s user 0.008s sys 0.004s
I20260505 20:13:50.721478 8053 raft_consensus.cc:359] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.721691 8053 raft_consensus.cc:385] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.721848 8053 raft_consensus.cc:740] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.722090 8053 consensus_queue.cc:260] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.722591 8053 ts_tablet_manager.cc:1434] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.722913 8053 tablet_bootstrap.cc:492] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.723310 9894 leader_election.cc:290] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.723678 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb5e21649a4cc39764a3847fa41c21" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.724162 7736 leader_election.cc:343] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.724888 8053 tablet_bootstrap.cc:654] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.725172 10337 raft_consensus.cc:493] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.725306 10337 raft_consensus.cc:515] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.725982 10337 leader_election.cc:290] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.726454 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a694c65f90f4499ab96e45fbbaa9e892" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.726998 7870 leader_election.cc:343] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.734246 9271 ts_tablet_manager.cc:1929] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.734441 9271 log.cc:1199] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/8f1505e592e543cca92d8949bdae007e
I20260505 20:13:50.734920 9271 ts_tablet_manager.cc:1950] T 8f1505e592e543cca92d8949bdae007e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.735965 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 169) took 13300 ms. Trace:
I20260505 20:13:50.736081 9271 rpcz_store.cc:276] 0505 20:13:37.435643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.435704 (+ 61us) service_pool.cc:224] Handling call
0505 20:13:50.709113 (+13273409us) ts_tablet_manager.cc:1151] Deleting tablet 8f1505e592e543cca92d8949bdae007e
0505 20:13:50.709124 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.713056 (+ 3932us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.734134 (+ 21078us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.735894 (+ 1760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13273272}
I20260505 20:13:50.736507 9271 tablet_replica.cc:333] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.736644 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 8f1505e592e543cca92d8949bdae007e (table default.Table_cb573900a07b4be28febcbbaed8b4bea [id=89535e5ccfe149dfa88d3d37fd6dc2b9]) successfully deleted
I20260505 20:13:50.736788 9271 raft_consensus.cc:2243] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.737007 9271 raft_consensus.cc:2272] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.737830 10337 raft_consensus.cc:493] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.737993 10337 raft_consensus.cc:515] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.738890 10337 leader_election.cc:290] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.739532 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b6d9b8da2d4550bd5bb37cd0da929b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.740110 7870 leader_election.cc:343] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.750658 9495 raft_consensus.cc:493] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.750882 9495 raft_consensus.cc:515] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.751786 9495 leader_election.cc:290] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.752697 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.753038 7926 raft_consensus.cc:2393] T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:50.758194 7596 leader_election.cc:304] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:50.758618 9704 raft_consensus.cc:2804] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.758759 9704 raft_consensus.cc:697] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:50.759032 9704 consensus_queue.cc:237] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.762600 8054 raft_consensus.cc:740] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.737538 9271 ts_tablet_manager.cc:1916] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.770126 9495 raft_consensus.cc:493] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.770318 9495 raft_consensus.cc:515] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.771144 9495 leader_election.cc:290] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:50.773980 7596 consensus_peers.cc:597] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e083f131eca54d98852e5685e08ef46b. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:50.775907 7596 consensus_peers.cc:597] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2b2e40635b141c59d3789aca81efba7. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:50.776345 7596 leader_election.cc:343] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:50.776473 7596 leader_election.cc:304] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:50.776934 9495 raft_consensus.cc:2749] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260505 20:13:50.771575 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.778158 7926 raft_consensus.cc:2393] T 753536034d2647ef90ee3cf280b13855 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:50.779624 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.779816 7931 raft_consensus.cc:2468] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.780824 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d78ebf153640e4b2f518fb215f1bf1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.780982 7934 raft_consensus.cc:2468] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.781137 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907b7dccd7a94115aca36915a558b103" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.781167 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.781301 7922 raft_consensus.cc:2468] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:50.781409 7930 raft_consensus.cc:3060] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.781793 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.781971 7934 raft_consensus.cc:2393] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:50.783874 10307 raft_consensus.cc:493] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.784061 10307 raft_consensus.cc:515] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.784494 7930 raft_consensus.cc:2468] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:50.784967 7596 consensus_peers.cc:597] T 168d9a40a69d4beab8e79a97e7723e69 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 168d9a40a69d4beab8e79a97e7723e69. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.784956 10307 leader_election.cc:290] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.784976 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:50.785117 7921 raft_consensus.cc:3060] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.788569 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ec070a0196451c9564fa24b806516c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.788758 7919 raft_consensus.cc:2468] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:50.793440 7596 consensus_peers.cc:597] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.793974 7921 raft_consensus.cc:2468] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:50.796931 7596 consensus_peers.cc:597] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae8bd19470294a1db91855afe49be6a5. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.797801 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ab1033ccf4445862867f3f8b78ecd" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.798281 7596 consensus_peers.cc:597] T 883ec65f15604346813e5f87d55802fc P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 883ec65f15604346813e5f87d55802fc. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:50.798727 7736 leader_election.cc:343] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.799762 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.799953 7789 raft_consensus.cc:2468] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:50.801440 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc9a6e1c824305869f6634192c5e78" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.801651 7789 raft_consensus.cc:2468] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:50.802376 10307 consensus_queue.cc:1048] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.803190 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c591e3f33d4606be7181e380fadcf6" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.803740 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76178d1c329b4bf59fe3955f2893cd39" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.803910 7789 raft_consensus.cc:3060] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.804524 10252 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: acquiring CA information for follower catalog manager: success
I20260505 20:13:50.806816 7789 raft_consensus.cc:2468] T 76178d1c329b4bf59fe3955f2893cd39 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:50.788331 7413 catalog_manager.cc:6216] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: default.Table_2add910ed16e4806844c4179947d54e2 [id=497ef8628c1c4dc8b2992736e49a2e3d] alter complete (version 4)
I20260505 20:13:50.807367 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "369f4a55fdd64e4bb907666bede9f241" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.808145 8054 consensus_queue.cc:260] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.808655 9271 ts_tablet_manager.cc:1929] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.808781 9271 log.cc:1199] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/d3cd1b7b0456462a80d653dd442589a6
I20260505 20:13:50.809269 9271 ts_tablet_manager.cc:1950] T d3cd1b7b0456462a80d653dd442589a6 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.810040 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 170) took 13374 ms. Trace:
I20260505 20:13:50.810127 9271 rpcz_store.cc:276] 0505 20:13:37.436061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.436126 (+ 65us) service_pool.cc:224] Handling call
0505 20:13:50.736401 (+13300275us) ts_tablet_manager.cc:1151] Deleting tablet d3cd1b7b0456462a80d653dd442589a6
0505 20:13:50.736414 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.767833 (+ 31419us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.808558 (+ 40725us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.809993 (+ 1435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13300123}
I20260505 20:13:50.810482 9271 tablet_replica.cc:333] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.810660 9271 raft_consensus.cc:2243] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.810693 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet d3cd1b7b0456462a80d653dd442589a6 (table default.Table_5dcf10cdc4bc4312b75088ac10f28253 [id=59ac3e5d44d149d4b3a35726a6d6aa4a]) successfully deleted
I20260505 20:13:50.810799 9271 raft_consensus.cc:2272] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.811285 9271 ts_tablet_manager.cc:1916] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.815109 8054 ts_tablet_manager.cc:1434] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.325s user 0.014s sys 0.001s
I20260505 20:13:50.815423 8054 tablet_bootstrap.cc:492] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.816926 8054 tablet_bootstrap.cc:654] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.818324 8053 tablet_bootstrap.cc:492] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.818513 8053 ts_tablet_manager.cc:1403] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.096s user 0.012s sys 0.003s
I20260505 20:13:50.819198 8053 raft_consensus.cc:359] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.819455 8053 raft_consensus.cc:385] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.819561 8053 raft_consensus.cc:740] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.819911 8053 consensus_queue.cc:260] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.820528 8053 ts_tablet_manager.cc:1434] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:50.820935 8053 tablet_bootstrap.cc:492] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.823221 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca1fb1425e347d191f3c5931d9bf224" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.823398 7793 raft_consensus.cc:3060] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.823688 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:50.823889 7790 raft_consensus.cc:2393] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:50.824548 7794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a694c65f90f4499ab96e45fbbaa9e892" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.824796 7800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b6d9b8da2d4550bd5bb37cd0da929b" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.825847 7802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb3d246d6b443b8933648fe4f4aa5c2" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.826268 7793 raft_consensus.cc:2468] T 8ca1fb1425e347d191f3c5931d9bf224 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
I20260505 20:13:50.826733 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 203) took 4153 ms. Trace:
I20260505 20:13:50.826869 7407 rpcz_store.cc:276] 0505 20:13:46.672781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.523928 (+3851147us) service_pool.cc:224] Handling call
0505 20:13:50.609388 (+ 85460us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9741b13 00007f70d01d57c6 00007f70d01d54f5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:50.610078 (+ 690us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.610494 (+ 416us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.661736 (+ 51242us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.826536 (+164800us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.826671 (+ 135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.616090 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.616195 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.616200 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:50.616203 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:50.616285 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.616294 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.616298 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.616365 (+ 67us) tablet.cc:701] Row locks acquired
0505 20:13:50.616368 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.616397 (+ 29us) write_op.cc:270] Start()
0505 20:13:50.616426 (+ 29us) write_op.cc:276] Timestamp: P: 1778012030616525 usec, L: 0
0505 20:13:50.616429 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.652500 (+ 36071us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.652684 (+ 184us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 000000000099a74a 00007f70d1853f22 00007f70d2c3cc55 00007f70d2c3b779 00007f70d2c43ba0 00007f70d2c439ad 0000000000aa4cac 00007f70c5972f6f 00007f70c597628b 00007f70c5976108 0000000000aa4cac
0505 20:13:50.656462 (+ 3778us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.661136 (+ 4674us) write_op.cc:301] APPLY: starting
0505 20:13:50.661151 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.661193 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.661196 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.661340 (+ 144us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.661379 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.661388 (+ 9us) write_op.cc:312] APPLY: finished
0505 20:13:50.661461 (+ 73us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.661529 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.661554 (+ 25us) write_op.cc:454] Released schema lock
0505 20:13:50.661561 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.661629 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.661634 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":195964800,"child_traces":[["op",{"apply.queue_time_us":4617,"apply.run_cpu_time_us":484,"apply.run_wall_time_us":483,"num_ops":2,"prepare.queue_time_us":5115,"prepare.run_cpu_time_us":1099,"prepare.run_wall_time_us":36656,"raft.queue_time_us":249,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":3214,"replication_time_us":39997,"spinlock_wait_cycles":82517248}]]}
I20260505 20:13:50.829685 7407 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_e8c1347ffa404d0c8b75f2aed583716a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.830371 7407 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8c1347ffa404d0c8b75f2aed583716a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.831758 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 206) took 4114 ms. Trace:
I20260505 20:13:50.831887 7408 rpcz_store.cc:276] 0505 20:13:46.717578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.634266 (+3916688us) service_pool.cc:224] Handling call
0505 20:13:50.651456 (+ 17190us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x616000041254. stack: 00007f70c592d086 00007f70c592ce40 00007f70c48e63ad 000000000099adb4 000000000099ad7d 00007f70d4cc36bd 00007f70d4cc37b3 00007f70d1881b21 00007f70d95b5bad 00007f70d9741b13 00007f70d01d57c6 00007f70d01d54f5 00007f70cc92af2e 00007f70cc929e0e 00007f70cc930048 00007f70cc9309af
0505 20:13:50.657929 (+ 6473us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.658760 (+ 831us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.668651 (+ 9891us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.831623 (+162972us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.831711 (+ 88us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.659513 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.659658 (+ 145us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.659665 (+ 7us) write_op.cc:435] Acquired schema lock
0505 20:13:50.659669 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:50.659786 (+ 117us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.659800 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.659807 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.659901 (+ 94us) tablet.cc:701] Row locks acquired
0505 20:13:50.659903 (+ 2us) write_op.cc:260] PREPARE: finished
0505 20:13:50.659930 (+ 27us) write_op.cc:270] Start()
0505 20:13:50.659955 (+ 25us) write_op.cc:276] Timestamp: P: 1778012030660076 usec, L: 0
0505 20:13:50.659958 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.660131 (+ 173us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.666912 (+ 6781us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.667787 (+ 875us) write_op.cc:301] APPLY: starting
0505 20:13:50.667814 (+ 27us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.667856 (+ 42us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.667931 (+ 75us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.668143 (+ 212us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.668195 (+ 52us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.668207 (+ 12us) write_op.cc:312] APPLY: finished
0505 20:13:50.668296 (+ 89us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.668362 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.668386 (+ 24us) write_op.cc:454] Released schema lock
0505 20:13:50.668393 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.668461 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.668464 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":38762240,"child_traces":[["op",{"apply.queue_time_us":796,"apply.run_cpu_time_us":673,"apply.run_wall_time_us":673,"num_ops":2,"prepare.queue_time_us":225,"prepare.run_cpu_time_us":698,"prepare.run_wall_time_us":702,"replication_time_us":6926}]]}
I20260505 20:13:50.833141 8058 tablet_bootstrap.cc:492] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.833290 8058 ts_tablet_manager.cc:1403] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.011s
I20260505 20:13:50.833196 7408 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39198:
name: "default.Table_4db86ed9bd224a92a89c7caad14928f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260505 20:13:50.833835 7408 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4db86ed9bd224a92a89c7caad14928f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260505 20:13:50.834322 8058 raft_consensus.cc:359] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.835353 8058 raft_consensus.cc:385] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.835420 8058 raft_consensus.cc:740] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.836054 8058 consensus_queue.cc:260] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.836576 8058 ts_tablet_manager.cc:1434] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:50.839378 8058 tablet_bootstrap.cc:492] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.840216 9121 ts_tablet_manager.cc:1929] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:50.840277 9704 raft_consensus.cc:493] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.840420 9704 raft_consensus.cc:515] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.841130 9704 leader_election.cc:290] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:50.850726 8058 tablet_bootstrap.cc:654] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.858541 10307 consensus_queue.cc:1048] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.860993 8053 tablet_bootstrap.cc:654] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.850020 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:50.864557 7931 raft_consensus.cc:2393] T d75821282ca446b7b875ccb5a063e784 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:50.858975 10276 consensus_queue.cc:1048] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.865206 9121 log.cc:1199] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/5060bba634d440a09840e36e37a80d46
I20260505 20:13:50.865576 9121 ts_tablet_manager.cc:1950] T 5060bba634d440a09840e36e37a80d46 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:50.866657 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 189) took 11691 ms. Trace:
I20260505 20:13:50.866811 9121 rpcz_store.cc:276] 0505 20:13:39.175195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.175246 (+ 51us) service_pool.cc:224] Handling call
0505 20:13:50.621705 (+11446459us) ts_tablet_manager.cc:1151] Deleting tablet 5060bba634d440a09840e36e37a80d46
0505 20:13:50.621720 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.753946 (+132226us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.840146 (+ 86200us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.866639 (+ 26493us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11396654}
I20260505 20:13:50.867341 9121 tablet_replica.cc:333] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:50.867580 9121 raft_consensus.cc:2243] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.867782 9121 raft_consensus.cc:2272] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.868726 9121 ts_tablet_manager.cc:1916] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.868918 7737 leader_election.cc:304] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.871234 9271 ts_tablet_manager.cc:1929] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.871366 9271 log.cc:1199] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/089517a7c2214dce9367b21beb555733
I20260505 20:13:50.871572 9944 raft_consensus.cc:2804] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.871656 9944 raft_consensus.cc:493] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.871735 9944 raft_consensus.cc:3060] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.872203 9948 consensus_queue.cc:1048] T ede080523cb1482d8a531f4044164475 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.872409 8053 tablet_bootstrap.cc:492] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.872516 8053 ts_tablet_manager.cc:1403] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20260505 20:13:50.872865 7737 leader_election.cc:304] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.873193 8053 raft_consensus.cc:359] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.873286 9948 raft_consensus.cc:2804] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.873358 8053 raft_consensus.cc:385] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.873366 9948 raft_consensus.cc:493] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.873420 8053 raft_consensus.cc:740] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.873447 9948 raft_consensus.cc:3060] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.873607 8053 consensus_queue.cc:260] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.874076 8053 ts_tablet_manager.cc:1434] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.874321 8053 tablet_bootstrap.cc:492] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.875597 8053 tablet_bootstrap.cc:654] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.875849 9948 raft_consensus.cc:515] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.876361 9948 leader_election.cc:290] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.876824 7737 leader_election.cc:304] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.877449 9948 raft_consensus.cc:2804] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.877516 9948 raft_consensus.cc:493] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.877578 9948 raft_consensus.cc:3060] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.878446 10252 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260505 20:13:50.878783 9271 ts_tablet_manager.cc:1950] T 089517a7c2214dce9367b21beb555733 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.879534 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 171) took 13443 ms. Trace:
I20260505 20:13:50.879606 9271 rpcz_store.cc:276] 0505 20:13:37.436581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.436643 (+ 62us) service_pool.cc:224] Handling call
0505 20:13:50.810437 (+13373794us) ts_tablet_manager.cc:1151] Deleting tablet 089517a7c2214dce9367b21beb555733
0505 20:13:50.810447 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.846198 (+ 35751us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.849137 (+ 2939us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.879515 (+ 30378us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13373656}
I20260505 20:13:50.879974 9271 tablet_replica.cc:333] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.880177 9271 raft_consensus.cc:2243] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.880254 9948 raft_consensus.cc:515] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.880481 9944 raft_consensus.cc:515] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.881160 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907b7dccd7a94115aca36915a558b103" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.881258 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.881289 9944 leader_election.cc:290] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.880329 9271 raft_consensus.cc:2272] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:50.881779 7736 leader_election.cc:343] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.881968 7736 leader_election.cc:343] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.882231 9948 leader_election.cc:290] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.882315 9271 ts_tablet_manager.cc:1916] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.882501 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d78ebf153640e4b2f518fb215f1bf1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:50.882596 8058 tablet_bootstrap.cc:492] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.882689 7660 raft_consensus.cc:3060] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.882987 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 089517a7c2214dce9367b21beb555733 (table default.Table_aa714545b11e4ed3a0e546cddc77be98 [id=7fd3bc8f4d484299a9a21b95ada7e77f]) successfully deleted
I20260505 20:13:50.884850 7407 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 207) took 4157 ms. Trace:
I20260505 20:13:50.885314 7407 rpcz_store.cc:276] 0505 20:13:46.727008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.828272 (+4101264us) service_pool.cc:224] Handling call
0505 20:13:50.830483 (+ 2211us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.830979 (+ 496us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.855527 (+ 24548us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.884623 (+ 29096us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.884792 (+ 169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.848215 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.848394 (+ 179us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.848403 (+ 9us) write_op.cc:435] Acquired schema lock
0505 20:13:50.848406 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:50.848540 (+ 134us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.848561 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.848568 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.848680 (+ 112us) tablet.cc:701] Row locks acquired
0505 20:13:50.848684 (+ 4us) write_op.cc:260] PREPARE: finished
0505 20:13:50.848749 (+ 65us) write_op.cc:270] Start()
0505 20:13:50.848819 (+ 70us) write_op.cc:276] Timestamp: P: 1778012030848764 usec, L: 0
0505 20:13:50.848824 (+ 5us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.849077 (+ 253us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.854790 (+ 5713us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.854912 (+ 122us) write_op.cc:301] APPLY: starting
0505 20:13:50.854928 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.854976 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.855034 (+ 58us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.855179 (+ 145us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.855214 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.855221 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:50.855300 (+ 79us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.855367 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.855384 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:50.855389 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.855454 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.855458 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":61,"apply.run_cpu_time_us":540,"apply.run_wall_time_us":539,"mutex_wait_us":480,"num_ops":2,"prepare.queue_time_us":16694,"prepare.run_cpu_time_us":1059,"prepare.run_wall_time_us":1528,"raft.queue_time_us":2578,"raft.run_cpu_time_us":647,"raft.run_wall_time_us":646,"replication_time_us":5931}]]}
I20260505 20:13:50.886359 7407 master_service.cc:954] ReplaceTablet: received request to replace tablet ede080523cb1482d8a531f4044164475 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:50.887835 7660 raft_consensus.cc:2468] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:50.888262 7736 leader_election.cc:304] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:50.889902 7408 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:39198 (request call id 208) took 4154 ms. Trace:
I20260505 20:13:50.890184 7408 rpcz_store.cc:276] 0505 20:13:46.730623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.833022 (+4102399us) service_pool.cc:224] Handling call
0505 20:13:50.833955 (+ 933us) catalog_manager.cc:2101] Acquired catalog manager lock
0505 20:13:50.834432 (+ 477us) catalog_manager.cc:2147] Created new table and tablet info
0505 20:13:50.857557 (+ 23125us) catalog_manager.cc:2207] Wrote table and tablets to system table
0505 20:13:50.885015 (+ 27458us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0505 20:13:50.885091 (+ 76us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.850771 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.850888 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.850893 (+ 5us) write_op.cc:435] Acquired schema lock
0505 20:13:50.850896 (+ 3us) tablet.cc:662] Decoding operations
0505 20:13:50.850984 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.850994 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.850999 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.851084 (+ 85us) tablet.cc:701] Row locks acquired
0505 20:13:50.851087 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.851125 (+ 38us) write_op.cc:270] Start()
0505 20:13:50.851159 (+ 34us) write_op.cc:276] Timestamp: P: 1778012030851145 usec, L: 0
0505 20:13:50.851165 (+ 6us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.851321 (+ 156us) log.cc:844] Serialized 433 byte log entry
0505 20:13:50.856582 (+ 5261us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.857029 (+ 447us) write_op.cc:301] APPLY: starting
0505 20:13:50.857043 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.857079 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.857102 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.857205 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.857234 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0505 20:13:50.857240 (+ 6us) write_op.cc:312] APPLY: finished
0505 20:13:50.857302 (+ 62us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.857367 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.857384 (+ 17us) write_op.cc:454] Released schema lock
0505 20:13:50.857390 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.857452 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.857456 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":385,"apply.run_cpu_time_us":420,"apply.run_wall_time_us":429,"mutex_wait_us":14802,"num_ops":2,"prepare.queue_time_us":15799,"prepare.run_cpu_time_us":651,"prepare.run_wall_time_us":651,"raft.queue_time_us":684,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":5392}]]}
I20260505 20:13:50.890870 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet 266d53c82e3f45abb6e50d2e21948336 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:50.891805 9271 ts_tablet_manager.cc:1929] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.891916 9271 log.cc:1199] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/b17da5cf513647d9b8e582a9b3b460a1
I20260505 20:13:50.892248 9271 ts_tablet_manager.cc:1950] T b17da5cf513647d9b8e582a9b3b460a1 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.893419 10307 raft_consensus.cc:2804] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.893529 10307 raft_consensus.cc:697] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:50.893957 10307 consensus_queue.cc:237] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.898268 7737 leader_election.cc:304] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.898527 9948 raft_consensus.cc:2749] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.900411 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "578a9ebf768d4c73990fb2a28a9d4ccb" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.900812 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 172) took 13463 ms. Trace:
I20260505 20:13:50.900900 9271 rpcz_store.cc:276] 0505 20:13:37.436991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.437059 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:50.879925 (+13442866us) ts_tablet_manager.cc:1151] Deleting tablet b17da5cf513647d9b8e582a9b3b460a1
0505 20:13:50.879935 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.885659 (+ 5724us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.891750 (+ 6091us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.900795 (+ 9045us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13442710}
I20260505 20:13:50.901219 9271 tablet_replica.cc:333] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.901343 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet b17da5cf513647d9b8e582a9b3b460a1 (table default.Table_3320012d7d2d474e8bb80df0f8f7ee59 [id=37a0fe2c6a244790a917bf66649e81ee]) successfully deleted
I20260505 20:13:50.901405 9271 raft_consensus.cc:2243] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:50.901702 9271 raft_consensus.cc:2272] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.902283 9271 ts_tablet_manager.cc:1916] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.903997 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753536034d2647ef90ee3cf280b13855" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.882731 8058 ts_tablet_manager.cc:1403] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260505 20:13:50.906316 8058 raft_consensus.cc:359] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.906633 8058 raft_consensus.cc:385] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.906708 8058 raft_consensus.cc:740] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.906900 8058 consensus_queue.cc:260] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.907461 8058 ts_tablet_manager.cc:1434] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:50.907740 8058 tablet_bootstrap.cc:492] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:50.909586 8058 tablet_bootstrap.cc:654] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.911827 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75821282ca446b7b875ccb5a063e784" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:50.912065 7793 raft_consensus.cc:2393] T d75821282ca446b7b875ccb5a063e784 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:50.915437 7596 leader_election.cc:304] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:50.915782 9704 raft_consensus.cc:3060] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:50.916705 7596 consensus_peers.cc:597] T 8f1505e592e543cca92d8949bdae007e P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f1505e592e543cca92d8949bdae007e. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.917481 7596 leader_election.cc:304] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:50.917585 9270 ts_tablet_manager.cc:1929] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.917757 9270 log.cc:1199] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/2c12a95b0ed445c7b598db136f6ac05c
I20260505 20:13:50.917871 9495 raft_consensus.cc:3060] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.918128 9270 ts_tablet_manager.cc:1950] T 2c12a95b0ed445c7b598db136f6ac05c P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:50.918419 9704 raft_consensus.cc:2749] T 578a9ebf768d4c73990fb2a28a9d4ccb P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.920354 9495 raft_consensus.cc:2749] T 753536034d2647ef90ee3cf280b13855 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.921958 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 5060bba634d440a09840e36e37a80d46 (table default.Table_f7765b40e19645f281ad2da563b7a009 [id=7b7cd6e40cad42b9b2002e608a49d644]) successfully deleted
I20260505 20:13:50.926669 10412 tablet.cc:1724] T 947a4d496d994b799d1688cc258a181d P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:50.927421 10307 raft_consensus.cc:493] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.927553 10307 raft_consensus.cc:515] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.932870 10337 raft_consensus.cc:493] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.933023 10337 raft_consensus.cc:515] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.933574 10337 leader_election.cc:290] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.934108 7869 leader_election.cc:304] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.934315 10337 raft_consensus.cc:2804] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.934388 10337 raft_consensus.cc:493] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.934469 10337 raft_consensus.cc:3060] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.934734 9948 raft_consensus.cc:493] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.934914 9948 raft_consensus.cc:515] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.935829 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f317f62391b422db2bf2a97ef928f99" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.935882 9948 leader_election.cc:290] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:50.936291 7736 leader_election.cc:343] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.936944 9271 ts_tablet_manager.cc:1929] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.937079 9271 log.cc:1199] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/19720f3a29f34515a952e50f4fec9f97
I20260505 20:13:50.936985 10337 raft_consensus.cc:515] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.937232 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:50.937443 8053 tablet_bootstrap.cc:492] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.937484 9271 ts_tablet_manager.cc:1950] T 19720f3a29f34515a952e50f4fec9f97 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.937537 10337 leader_election.cc:290] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.937587 8053 ts_tablet_manager.cc:1403] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.003s
I20260505 20:13:50.938133 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.938416 7870 leader_election.cc:343] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.938805 7870 leader_election.cc:343] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.938866 8053 raft_consensus.cc:359] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.939041 8053 raft_consensus.cc:385] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.939105 8053 raft_consensus.cc:740] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.939112 7869 leader_election.cc:304] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.939266 10307 leader_election.cc:290] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.939332 10337 raft_consensus.cc:2804] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:50.939400 10337 raft_consensus.cc:493] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:50.939291 8053 consensus_queue.cc:260] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.939469 10337 raft_consensus.cc:3060] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.939838 8053 ts_tablet_manager.cc:1434] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:50.940094 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c99f02ea514a2581f0697dc3ef6461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.940541 7736 leader_election.cc:343] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:50.942047 7869 leader_election.cc:343] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.942142 7869 leader_election.cc:304] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.942320 10276 raft_consensus.cc:2749] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.942449 7869 leader_election.cc:304] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.942657 10276 raft_consensus.cc:2804] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.942767 10276 raft_consensus.cc:697] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:50.942968 10276 consensus_queue.cc:237] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.943032 10337 raft_consensus.cc:515] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.943584 10337 leader_election.cc:290] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:50.943753 7869 leader_election.cc:304] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.944416 10031 raft_consensus.cc:2749] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.944566 10031 consensus_queue.cc:1048] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.945168 10031 consensus_queue.cc:1048] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.945459 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc9a6e1c824305869f6634192c5e78" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:50.945859 7869 leader_election.cc:343] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.945963 7869 leader_election.cc:304] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.946151 10031 raft_consensus.cc:2749] T a694c65f90f4499ab96e45fbbaa9e892 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:50.946339 7870 leader_election.cc:343] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.946379 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 173) took 13508 ms. Trace:
W20260505 20:13:50.946475 7869 leader_election.cc:343] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.946453 9271 rpcz_store.cc:276] 0505 20:13:37.437442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.437502 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:50.901173 (+13463671us) ts_tablet_manager.cc:1151] Deleting tablet 19720f3a29f34515a952e50f4fec9f97
0505 20:13:50.901185 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.905304 (+ 4119us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.936881 (+ 31577us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.946357 (+ 9476us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13463530}
I20260505 20:13:50.946597 7869 leader_election.cc:304] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.946795 9271 tablet_replica.cc:333] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.946956 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 19720f3a29f34515a952e50f4fec9f97 (table default.Table_6560bac418ea4f8aad5c9a8257e5b261 [id=ff0a7d8e28664804b1db5842a0dd8eaa]) successfully deleted
I20260505 20:13:50.947009 9271 raft_consensus.cc:2243] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:50.947256 9271 raft_consensus.cc:2272] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:50.947768 9271 ts_tablet_manager.cc:1916] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.949987 8053 tablet_bootstrap.cc:492] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.951741 8053 tablet_bootstrap.cc:654] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.958920 8053 tablet_bootstrap.cc:492] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.959065 8053 ts_tablet_manager.cc:1403] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20260505 20:13:50.959785 8053 raft_consensus.cc:359] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.959975 8053 raft_consensus.cc:385] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.960036 8053 raft_consensus.cc:740] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.960219 8053 consensus_queue.cc:260] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:50.960405 7596 consensus_peers.cc:597] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 004a8e72cab44d31af3369b8df1e434e. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:50.960690 8053 ts_tablet_manager.cc:1434] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:50.960975 8053 tablet_bootstrap.cc:492] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.961709 7596 leader_election.cc:304] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:50.962225 9495 raft_consensus.cc:3060] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:50.962467 8053 tablet_bootstrap.cc:654] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.965335 9495 raft_consensus.cc:2749] T d75821282ca446b7b875ccb5a063e784 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.965696 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 142) took 13591 ms. Trace:
I20260505 20:13:50.966012 8054 tablet_bootstrap.cc:492] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:50.966249 8054 ts_tablet_manager.cc:1403] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.151s user 0.002s sys 0.001s
I20260505 20:13:50.966562 9270 rpcz_store.cc:276] 0505 20:13:37.373965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.374971 (+ 1006us) service_pool.cc:224] Handling call
0505 20:13:50.664832 (+13289861us) ts_tablet_manager.cc:1151] Deleting tablet 2c12a95b0ed445c7b598db136f6ac05c
0505 20:13:50.664845 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.774801 (+109956us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.917529 (+142728us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.965678 (+ 48149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13289714}
I20260505 20:13:50.966941 10307 raft_consensus.cc:493] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.967103 10307 raft_consensus.cc:515] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.968389 10307 leader_election.cc:290] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:50.968750 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:50.969790 7736 leader_election.cc:343] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.970345 9270 tablet_replica.cc:333] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:50.970467 9271 ts_tablet_manager.cc:1929] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.970579 9271 log.cc:1199] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/7214ab77d7904f0e9d37cb8d7a5a53a4
I20260505 20:13:50.971069 9271 ts_tablet_manager.cc:1950] T 7214ab77d7904f0e9d37cb8d7a5a53a4 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.971828 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 163) took 13538 ms. Trace:
I20260505 20:13:50.971818 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 2c12a95b0ed445c7b598db136f6ac05c (table default.Table_207fda948999454b99cc51dc2fca63c6 [id=02ce1f436c084ad2b223165f82de795a]) successfully deleted
I20260505 20:13:50.971920 9271 rpcz_store.cc:276] 0505 20:13:37.433550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.437799 (+ 4249us) service_pool.cc:224] Handling call
0505 20:13:50.946744 (+13508945us) ts_tablet_manager.cc:1151] Deleting tablet 7214ab77d7904f0e9d37cb8d7a5a53a4
0505 20:13:50.946757 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.955099 (+ 8342us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.970395 (+ 15296us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.971811 (+ 1416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13508779}
I20260505 20:13:50.972229 9271 tablet_replica.cc:333] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:50.972301 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 7214ab77d7904f0e9d37cb8d7a5a53a4 (table default.Table_34f1fe8c4f4d4d65a05f2811d1f3a974 [id=5023dca3a2084d33a514ca739ffa7ba3]) successfully deleted
I20260505 20:13:50.972414 9271 raft_consensus.cc:2243] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:50.972563 9271 raft_consensus.cc:2272] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:50.973284 7869 leader_election.cc:343] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:50.973410 7869 leader_election.cc:304] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.973922 7869 leader_election.cc:304] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:50.974897 9271 ts_tablet_manager.cc:1916] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:50.977466 10258 raft_consensus.cc:2749] T e2b6d9b8da2d4550bd5bb37cd0da929b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.977618 10258 raft_consensus.cc:2749] T 0cb3d246d6b443b8933648fe4f4aa5c2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:50.977972 10258 raft_consensus.cc:2804] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:50.978070 10258 raft_consensus.cc:697] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:50.978324 10258 consensus_queue.cc:237] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.979466 8053 tablet_bootstrap.cc:492] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.979588 8053 ts_tablet_manager.cc:1403] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260505 20:13:50.980315 8053 raft_consensus.cc:359] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.980522 8053 raft_consensus.cc:385] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.980571 8053 raft_consensus.cc:740] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.980798 8053 consensus_queue.cc:260] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.981280 8053 ts_tablet_manager.cc:1434] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:50.981700 8053 tablet_bootstrap.cc:492] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:50.982980 8054 raft_consensus.cc:359] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.983676 8053 tablet_bootstrap.cc:654] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.983695 8054 raft_consensus.cc:385] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.983963 8054 raft_consensus.cc:740] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.984393 8054 consensus_queue.cc:260] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:50.987392 7408 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet 266d53c82e3f45abb6e50d2e21948336
I20260505 20:13:50.987883 7408 catalog_manager.cc:6741] ReplaceTablet: tablet 266d53c82e3f45abb6e50d2e21948336 deleted and replaced by tablet 730d5b70ffaa420f8b69bea68172e7ab
I20260505 20:13:50.988015 7408 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 210) took 3927 ms. Trace:
I20260505 20:13:50.988221 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet 266d53c82e3f45abb6e50d2e21948336 with delete_type TABLET_DATA_DELETED (replaced by tablet 730d5b70ffaa420f8b69bea68172e7ab) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:50.988088 7408 rpcz_store.cc:276] 0505 20:13:47.060671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.890810 (+3830139us) service_pool.cc:224] Handling call
0505 20:13:50.987969 (+ 97159us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:50.967841 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:50.967976 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:50.967984 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:50.967986 (+ 2us) tablet.cc:662] Decoding operations
0505 20:13:50.968099 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:50.968114 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:50.968118 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:50.968199 (+ 81us) tablet.cc:701] Row locks acquired
0505 20:13:50.968202 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:50.968240 (+ 38us) write_op.cc:270] Start()
0505 20:13:50.968280 (+ 40us) write_op.cc:276] Timestamp: P: 1778012030968303 usec, L: 0
0505 20:13:50.968284 (+ 4us) op_driver.cc:348] REPLICATION: starting
0505 20:13:50.968455 (+ 171us) log.cc:844] Serialized 625 byte log entry
0505 20:13:50.980426 (+ 11971us) op_driver.cc:464] REPLICATION: finished
0505 20:13:50.980528 (+ 102us) write_op.cc:301] APPLY: starting
0505 20:13:50.980546 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:50.980594 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:50.980641 (+ 47us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:50.980766 (+ 125us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:50.980822 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:50.980829 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:50.980911 (+ 82us) log.cc:844] Serialized 29 byte log entry
0505 20:13:50.980976 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.980999 (+ 23us) write_op.cc:454] Released schema lock
0505 20:13:50.981006 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:50.981079 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:50.981082 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":53,"apply.run_cpu_time_us":540,"apply.run_wall_time_us":539,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":726,"raft.queue_time_us":1273,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":490,"replication_time_us":12109}]]}
I20260505 20:13:50.988776 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet 8e650b297603425184ad97ddf99ec36d from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:50.989116 7408 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 211) took 3689 ms. Trace:
I20260505 20:13:50.989223 7408 rpcz_store.cc:276] 0505 20:13:47.299497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.988703 (+3689206us) service_pool.cc:224] Handling call
0505 20:13:50.989085 (+ 382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:50.989441 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet a0d4e198c91c4a0e99d8b798a1dd3433 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:50.989682 8054 ts_tablet_manager.cc:1434] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260505 20:13:50.991086 8054 tablet_bootstrap.cc:492] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:50.992453 8054 tablet_bootstrap.cc:654] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:50.992950 9271 ts_tablet_manager.cc:1929] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:50.993067 9271 log.cc:1199] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/876496f026c84eff8fef175387d20062
I20260505 20:13:50.993430 9271 ts_tablet_manager.cc:1950] T 876496f026c84eff8fef175387d20062 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:50.971571 8058 tablet_bootstrap.cc:492] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:50.988577 9906 raft_consensus.cc:493] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:50.990127 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet 266d53c82e3f45abb6e50d2e21948336 with delete_type TABLET_DATA_DELETED (replaced by tablet 730d5b70ffaa420f8b69bea68172e7ab) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:50.994607 9906 raft_consensus.cc:515] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.995213 9906 leader_election.cc:290] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:50.996045 7598 leader_election.cc:343] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 359ab1033ccf4445862867f3f8b78ecd
I20260505 20:13:50.996398 8053 tablet_bootstrap.cc:492] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:50.996522 8053 ts_tablet_manager.cc:1403] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260505 20:13:50.996901 10307 consensus_queue.cc:1048] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:50.997200 8053 raft_consensus.cc:359] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.997349 8053 raft_consensus.cc:385] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:50.997350 7408 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 212) took 3176 ms. Trace:
I20260505 20:13:50.997401 8053 raft_consensus.cc:740] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:50.997457 7408 rpcz_store.cc:276] 0505 20:13:47.813736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.989396 (+3175660us) service_pool.cc:224] Handling call
0505 20:13:50.989720 (+ 324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:50.997603 8053 consensus_queue.cc:260] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:50.998097 8053 ts_tablet_manager.cc:1434] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:50.998235 7408 master_service.cc:954] ReplaceTablet: received request to replace tablet b17da5cf513647d9b8e582a9b3b460a1 from {username='slave'} at 127.0.0.1:39198
I20260505 20:13:50.998565 7408 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 213) took 3139 ms. Trace:
I20260505 20:13:50.998914 7408 rpcz_store.cc:276] 0505 20:13:47.859522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.998106 (+3138584us) service_pool.cc:224] Handling call
0505 20:13:50.998536 (+ 430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260505 20:13:50.999574 7408 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f92fa7cbfb9c470fa562c941ef044c19" } modify_external_catalogs: true
I20260505 20:13:50.999783 7408 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_f92fa7cbfb9c470fa562c941ef044c19" } modify_external_catalogs: true
I20260505 20:13:51.004434 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ab1033ccf4445862867f3f8b78ecd" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.004593 7795 raft_consensus.cc:2468] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 0.
I20260505 20:13:51.006958 10307 raft_consensus.cc:493] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.007153 10307 raft_consensus.cc:515] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.008005 10307 leader_election.cc:290] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:51.008376 7398 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a5fcaee384c440bcb3307cba455e2ffa consensus state has no leader
I20260505 20:13:51.010787 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60c74cfa0d4c498ed50daefe3905ab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.011297 9270 raft_consensus.cc:2243] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.011600 9270 raft_consensus.cc:2272] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.012130 9270 ts_tablet_manager.cc:1916] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.015722 8053 tablet_bootstrap.cc:492] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.016041 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 174) took 13577 ms. Trace:
I20260505 20:13:51.016115 9271 rpcz_store.cc:276] 0505 20:13:37.438175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.438223 (+ 48us) service_pool.cc:224] Handling call
0505 20:13:50.972185 (+13533962us) ts_tablet_manager.cc:1151] Deleting tablet 876496f026c84eff8fef175387d20062
0505 20:13:50.972194 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.978022 (+ 5828us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:50.992889 (+ 14867us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.016023 (+ 23134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13533827}
I20260505 20:13:51.016472 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 175) took 13577 ms. Trace:
I20260505 20:13:51.016570 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 876496f026c84eff8fef175387d20062 (table default.Table_69552f9e9e534627b2cf35ce35cc8d3e [id=a751be2c3deb4410bfda0de55efcfc59]) successfully deleted
I20260505 20:13:51.016561 9271 rpcz_store.cc:276] 0505 20:13:37.438587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.438655 (+ 68us) service_pool.cc:224] Handling call
0505 20:13:51.016378 (+13577723us) ts_tablet_manager.cc:1151] Deleting tablet 48cce2fd271641ad83c9b3e4beeb12ee
0505 20:13:51.016389 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.016457 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13577582}
I20260505 20:13:51.016881 9271 tablet_replica.cc:333] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
W20260505 20:13:51.016958 7736 leader_election.cc:343] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.017125 9271 raft_consensus.cc:2243] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.017439 9271 raft_consensus.cc:2272] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.017970 8053 tablet_bootstrap.cc:654] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.018060 9271 ts_tablet_manager.cc:1916] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.020692 7737 leader_election.cc:304] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.021334 9948 raft_consensus.cc:2804] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.021443 9948 raft_consensus.cc:697] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.021679 9948 consensus_queue.cc:237] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.024230 9944 raft_consensus.cc:493] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.024385 8058 ts_tablet_manager.cc:1403] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.000s
I20260505 20:13:51.024349 9944 raft_consensus.cc:515] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.024641 9271 ts_tablet_manager.cc:1929] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.024724 9271 log.cc:1199] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/506b421a774c4929813205dba0fac32b
I20260505 20:13:51.024938 9944 leader_election.cc:290] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.025060 9271 ts_tablet_manager.cc:1950] T 506b421a774c4929813205dba0fac32b P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.025579 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e217456754440cf90a1c5a642eb2627" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.025894 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 176) took 13569 ms. Trace:
I20260505 20:13:51.025978 9271 rpcz_store.cc:276] 0505 20:13:37.456230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.456285 (+ 55us) service_pool.cc:224] Handling call
0505 20:13:51.016836 (+13560551us) ts_tablet_manager.cc:1151] Deleting tablet 506b421a774c4929813205dba0fac32b
0505 20:13:51.016847 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.021328 (+ 4481us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.024596 (+ 3268us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.025875 (+ 1279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13560316}
W20260505 20:13:51.026129 7736 leader_election.cc:343] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.026352 9271 tablet_replica.cc:333] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.026463 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 506b421a774c4929813205dba0fac32b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:51.026628 9271 raft_consensus.cc:2243] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.026787 9271 raft_consensus.cc:2272] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.027381 9271 ts_tablet_manager.cc:1916] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.027287 8058 raft_consensus.cc:359] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.027642 8058 raft_consensus.cc:385] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.027868 8058 raft_consensus.cc:740] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.029930 8058 consensus_queue.cc:260] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.030678 8058 ts_tablet_manager.cc:1434] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260505 20:13:51.035812 7737 leader_election.cc:304] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.036185 7737 leader_election.cc:304] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.037703 7407 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d: Sending DeleteTablet for 3 replicas of tablet ede080523cb1482d8a531f4044164475
I20260505 20:13:51.038297 7407 catalog_manager.cc:6741] ReplaceTablet: tablet ede080523cb1482d8a531f4044164475 deleted and replaced by tablet b9d3b5ff1027458996dd4ad4c8481e2a
I20260505 20:13:51.038443 7407 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:39198 (request call id 209) took 4075 ms. Trace:
I20260505 20:13:51.038661 7771 tablet_service.cc:1558] Processing DeleteTablet for tablet ede080523cb1482d8a531f4044164475 with delete_type TABLET_DATA_DELETED (replaced by tablet b9d3b5ff1027458996dd4ad4c8481e2a) from {username='slave'} at 127.0.0.1:40056
I20260505 20:13:51.039098 7642 tablet_service.cc:1558] Processing DeleteTablet for tablet ede080523cb1482d8a531f4044164475 with delete_type TABLET_DATA_DELETED (replaced by tablet b9d3b5ff1027458996dd4ad4c8481e2a) from {username='slave'} at 127.0.0.1:47850
I20260505 20:13:51.040421 8058 tablet_bootstrap.cc:492] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:51.042085 8058 tablet_bootstrap.cc:654] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.044155 7407 rpcz_store.cc:276] 0505 20:13:46.962540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:50.886272 (+3923732us) service_pool.cc:224] Handling call
0505 20:13:51.038387 (+152115us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0505 20:13:51.026867 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0505 20:13:51.026993 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0505 20:13:51.027001 (+ 8us) write_op.cc:435] Acquired schema lock
0505 20:13:51.027005 (+ 4us) tablet.cc:662] Decoding operations
0505 20:13:51.027143 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0505 20:13:51.027158 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0505 20:13:51.027162 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0505 20:13:51.027278 (+ 116us) tablet.cc:701] Row locks acquired
0505 20:13:51.027281 (+ 3us) write_op.cc:260] PREPARE: finished
0505 20:13:51.027329 (+ 48us) write_op.cc:270] Start()
0505 20:13:51.027365 (+ 36us) write_op.cc:276] Timestamp: P: 1778012031027407 usec, L: 0
0505 20:13:51.027368 (+ 3us) op_driver.cc:348] REPLICATION: starting
0505 20:13:51.027545 (+ 177us) log.cc:844] Serialized 625 byte log entry
0505 20:13:51.035895 (+ 8350us) op_driver.cc:464] REPLICATION: finished
0505 20:13:51.036000 (+ 105us) write_op.cc:301] APPLY: starting
0505 20:13:51.036019 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0505 20:13:51.036076 (+ 57us) tablet.cc:1370] finished BulkCheckPresence
0505 20:13:51.036125 (+ 49us) tablet.cc:1372] starting ApplyRowOperation cycle
0505 20:13:51.036262 (+ 137us) tablet.cc:1383] finished ApplyRowOperation cycle
0505 20:13:51.036318 (+ 56us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0505 20:13:51.036325 (+ 7us) write_op.cc:312] APPLY: finished
0505 20:13:51.036417 (+ 92us) log.cc:844] Serialized 29 byte log entry
0505 20:13:51.036490 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:51.036518 (+ 28us) write_op.cc:454] Released schema lock
0505 20:13:51.036528 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0505 20:13:51.036625 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0505 20:13:51.036632 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":609,"apply.run_wall_time_us":594,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":800,"prepare.run_wall_time_us":799,"raft.queue_time_us":1467,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":496,"replication_time_us":8496}]]}
I20260505 20:13:51.044961 7407 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9f99b5810baf4d94b7f7adab9e3f67f9" } modify_external_catalogs: true
I20260505 20:13:51.045137 7407 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39198:
table { table_name: "default.Table_9f99b5810baf4d94b7f7adab9e3f67f9" } modify_external_catalogs: true
I20260505 20:13:51.047742 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 3870d55d0dad4ac6ab03e7346d2e534b (DEFAULT_TABLE table=default.Table_bd80980cb57c4ada90ee385fb2aba768 [id=d2fe2d7792d04810be4084ffb2af28cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.048023 9271 ts_tablet_manager.cc:1929] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.048127 9271 log.cc:1199] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/aa0b05546a4f47aea5fae1cf767b762d
I20260505 20:13:51.048434 9271 ts_tablet_manager.cc:1950] T aa0b05546a4f47aea5fae1cf767b762d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.049959 7627 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8f5967ceac4249b167d147143f82bd (DEFAULT_TABLE table=default.Table_2b459106b61447888223447c59e0a007 [id=1f5ea9da88bb4e10966ad3e6c6ca1676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.051564 9944 raft_consensus.cc:2804] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.051642 9894 raft_consensus.cc:2804] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.051649 7636 tablet_service.cc:1511] Processing CreateTablet for tablet c547e6ac805e498bafee3ffbd17465aa (DEFAULT_TABLE table=default.Table_40ea5fef14794773a98ea223a7f8115d [id=516eb19ec8d640919a09585e9ae30f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.051776 9894 raft_consensus.cc:697] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.052035 9894 consensus_queue.cc:237] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.052448 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 178) took 13521 ms. Trace:
I20260505 20:13:51.052539 9271 rpcz_store.cc:276] 0505 20:13:37.530905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.531427 (+ 522us) service_pool.cc:224] Handling call
0505 20:13:51.026309 (+13494882us) ts_tablet_manager.cc:1151] Deleting tablet aa0b05546a4f47aea5fae1cf767b762d
0505 20:13:51.026318 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.031044 (+ 4726us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.047958 (+ 16914us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.052428 (+ 4470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20,"tablet-delete.queue_time_us":13494673}
I20260505 20:13:51.052716 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 3870d55d0dad4ac6ab03e7346d2e534b (DEFAULT_TABLE table=default.Table_bd80980cb57c4ada90ee385fb2aba768 [id=d2fe2d7792d04810be4084ffb2af28cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.052950 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 180) took 13507 ms. Trace:
I20260505 20:13:51.051663 9944 raft_consensus.cc:493] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.053112 9944 raft_consensus.cc:3060] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.053321 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8f5967ceac4249b167d147143f82bd (DEFAULT_TABLE table=default.Table_2b459106b61447888223447c59e0a007 [id=1f5ea9da88bb4e10966ad3e6c6ca1676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.053851 7635 tablet_service.cc:1511] Processing CreateTablet for tablet c447c435decd4ec3b701c579cf6e7992 (DEFAULT_TABLE table=default.Table_eabba64f8cfd46b79633f42b297da738 [id=e361bee9655441ada170e0af7ac4015b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.055675 9944 raft_consensus.cc:515] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.056280 9944 leader_election.cc:290] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.056674 9121 ts_tablet_manager.cc:1929] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.056788 9121 log.cc:1199] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/3dbc2221555e4f598d65835ae640fe4a
I20260505 20:13:51.057124 9121 ts_tablet_manager.cc:1950] T 3dbc2221555e4f598d65835ae640fe4a P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
W20260505 20:13:51.061398 7596 consensus_peers.cc:597] T 880cbba188144dd795873186f8cda1e9 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 880cbba188144dd795873186f8cda1e9. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.062562 8054 tablet_bootstrap.cc:492] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.053087 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3870d55d0dad4ac6ab03e7346d2e534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.053017 9271 rpcz_store.cc:276] 0505 20:13:37.545289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.545381 (+ 92us) service_pool.cc:224] Handling call
0505 20:13:51.052834 (+13507453us) ts_tablet_manager.cc:1151] Deleting tablet faf3775c154742c5804daf8ade2ad854
0505 20:13:51.052846 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.052936 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13507179}
I20260505 20:13:51.064262 9271 tablet_replica.cc:333] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.064222 7596 leader_election.cc:304] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:51.064447 9271 raft_consensus.cc:2243] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.064603 9271 raft_consensus.cc:2272] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.064839 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8f5967ceac4249b167d147143f82bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.065129 9271 ts_tablet_manager.cc:1916] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.066303 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet aa0b05546a4f47aea5fae1cf767b762d (table default.Table_e52550e2986d463d9ee1c6f63903b9db [id=c38dabe50bb54733988e75f22fd4e09f]) successfully deleted
W20260505 20:13:51.066550 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet faf3775c154742c5804daf8ade2ad854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf3775c154742c5804daf8ade2ad854 already in progress: creating tablet
I20260505 20:13:51.069250 7776 tablet_service.cc:1511] Processing CreateTablet for tablet c547e6ac805e498bafee3ffbd17465aa (DEFAULT_TABLE table=default.Table_40ea5fef14794773a98ea223a7f8115d [id=516eb19ec8d640919a09585e9ae30f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.069660 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c547e6ac805e498bafee3ffbd17465aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.069734 7638 tablet_service.cc:1511] Processing CreateTablet for tablet ea2219920d55429b870ef8fcbe917fcc (DEFAULT_TABLE table=default.Table_a22be686199c4d04853e7e11967bd0f5 [id=b9b6fec6b9e348a5b5eb67cda572c34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.070744 9271 ts_tablet_manager.cc:1929] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.070845 9271 log.cc:1199] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/d27febef8234419caa855dd7a180fe8f
I20260505 20:13:51.071231 9271 ts_tablet_manager.cc:1950] T d27febef8234419caa855dd7a180fe8f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.071650 7632 tablet_service.cc:1511] Processing CreateTablet for tablet bd9deeadbbc44a74b498eae5033464b7 (DEFAULT_TABLE table=default.Table_feafef8bf3e64e14b0fe7067ffa9c9fc [id=ba1397c6b20749029c2e8d65ddd7043e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.071928 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 183) took 13401 ms. Trace:
I20260505 20:13:51.072017 9271 rpcz_store.cc:276] 0505 20:13:37.670838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.670898 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:51.064212 (+13393314us) ts_tablet_manager.cc:1151] Deleting tablet d27febef8234419caa855dd7a180fe8f
0505 20:13:51.064223 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.067904 (+ 3681us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.070697 (+ 2793us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.071908 (+ 1211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13393124}
I20260505 20:13:51.072309 9271 tablet_replica.cc:333] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.072492 9271 raft_consensus.cc:2243] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.072629 9975 raft_consensus.cc:493] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.072743 9975 raft_consensus.cc:515] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.073240 9975 leader_election.cc:290] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.073216 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ec070a0196451c9564fa24b806516c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:51.072655 9271 raft_consensus.cc:2272] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.069250 7766 tablet_service.cc:1511] Processing CreateTablet for tablet c447c435decd4ec3b701c579cf6e7992 (DEFAULT_TABLE table=default.Table_eabba64f8cfd46b79633f42b297da738 [id=e361bee9655441ada170e0af7ac4015b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.073736 9906 raft_consensus.cc:2804] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.073858 9906 raft_consensus.cc:493] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.073959 9906 raft_consensus.cc:3060] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.073992 9271 ts_tablet_manager.cc:1916] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.075071 7771 tablet_service.cc:1511] Processing CreateTablet for tablet ea2219920d55429b870ef8fcbe917fcc (DEFAULT_TABLE table=default.Table_a22be686199c4d04853e7e11967bd0f5 [id=b9b6fec6b9e348a5b5eb67cda572c34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.075415 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c447c435decd4ec3b701c579cf6e7992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.075688 7780 tablet_service.cc:1511] Processing CreateTablet for tablet bd9deeadbbc44a74b498eae5033464b7 (DEFAULT_TABLE table=default.Table_feafef8bf3e64e14b0fe7067ffa9c9fc [id=ba1397c6b20749029c2e8d65ddd7043e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.076012 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9deeadbbc44a74b498eae5033464b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.076730 9906 raft_consensus.cc:515] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.077328 9906 leader_election.cc:290] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.077931 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet d27febef8234419caa855dd7a180fe8f (table default.Table_f6ef71acc15249d5bdd74eac928d3bcf [id=a4e60d534a9a4f5ab3e9331eb1df0466]) successfully deleted
I20260505 20:13:51.078006 8053 tablet_bootstrap.cc:492] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.078114 8053 ts_tablet_manager.cc:1403] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
W20260505 20:13:51.078753 7736 leader_election.cc:343] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.081574 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be05357416b24dabaaa5f2ce2f33c82e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.082053 7598 leader_election.cc:343] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 359ab1033ccf4445862867f3f8b78ecd
W20260505 20:13:51.082300 7736 leader_election.cc:343] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.085649 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 190) took 11903 ms. Trace:
I20260505 20:13:51.085767 9121 rpcz_store.cc:276] 0505 20:13:39.182516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.182589 (+ 73us) service_pool.cc:224] Handling call
0505 20:13:50.867292 (+11684703us) ts_tablet_manager.cc:1151] Deleting tablet 3dbc2221555e4f598d65835ae640fe4a
0505 20:13:50.867303 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:50.956670 (+ 89367us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.056602 (+ 99932us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.085622 (+ 29020us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11640843}
I20260505 20:13:51.086252 9121 tablet_replica.cc:333] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:51.086454 9121 raft_consensus.cc:2243] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.086618 9121 raft_consensus.cc:2272] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.088356 9121 ts_tablet_manager.cc:1916] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.089102 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2219920d55429b870ef8fcbe917fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.063714 8054 ts_tablet_manager.cc:1403] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.004s
I20260505 20:13:51.090304 8054 raft_consensus.cc:359] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.090478 8054 raft_consensus.cc:385] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.090535 8054 raft_consensus.cc:740] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.090811 8054 consensus_queue.cc:260] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.091288 8054 ts_tablet_manager.cc:1434] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:51.091553 8054 tablet_bootstrap.cc:492] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
W20260505 20:13:51.092475 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 115085us
W20260505 20:13:51.092700 7869 leader_election.cc:343] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.092810 7869 leader_election.cc:304] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.092895 8054 tablet_bootstrap.cc:654] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.093034 10196 raft_consensus.cc:2749] T 369f4a55fdd64e4bb907666bede9f241 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.093555 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb5e21649a4cc39764a3847fa41c21" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.093713 7926 raft_consensus.cc:3060] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.094538 10307 raft_consensus.cc:493] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.095395 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359ab1033ccf4445862867f3f8b78ecd" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:51.095561 7785 raft_consensus.cc:3060] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.096451 7926 raft_consensus.cc:2468] T 09bb5e21649a4cc39764a3847fa41c21 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
W20260505 20:13:51.098065 7596 consensus_peers.cc:597] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28ce3efe875a43d9b30d40623bf8a385. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:51.098513 7596 consensus_peers.cc:597] T 876496f026c84eff8fef175387d20062 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 876496f026c84eff8fef175387d20062. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.100135 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3870d55d0dad4ac6ab03e7346d2e534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.100313 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c447c435decd4ec3b701c579cf6e7992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.101541 7785 raft_consensus.cc:2468] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:51.094655 10307 raft_consensus.cc:515] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.103152 10307 leader_election.cc:290] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.103425 7636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c547e6ac805e498bafee3ffbd17465aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.106137 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8f5967ceac4249b167d147143f82bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.106719 7596 leader_election.cc:304] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:51.107124 9906 raft_consensus.cc:2804] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.107265 9906 raft_consensus.cc:697] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:51.107601 9906 consensus_queue.cc:237] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.109004 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2fb4e615c4486b9d071b2366f85471" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.109480 7736 leader_election.cc:343] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.113392 9270 ts_tablet_manager.cc:1929] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.113562 9270 log.cc:1199] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/bcd289ce979940ae96554d5756d140d7
I20260505 20:13:51.114017 9270 ts_tablet_manager.cc:1950] T bcd289ce979940ae96554d5756d140d7 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.114352 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2219920d55429b870ef8fcbe917fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.114842 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 138) took 13741 ms. Trace:
I20260505 20:13:51.114979 9270 rpcz_store.cc:276] 0505 20:13:37.373537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.373595 (+ 58us) service_pool.cc:224] Handling call
0505 20:13:50.970289 (+13596694us) ts_tablet_manager.cc:1151] Deleting tablet bcd289ce979940ae96554d5756d140d7
0505 20:13:50.970302 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.087017 (+116715us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.113328 (+ 26311us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.114796 (+ 1468us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15795,"tablet-delete.queue_time_us":13595039}
I20260505 20:13:51.115653 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet bcd289ce979940ae96554d5756d140d7 (table default.Table_471e002676d8465fb3a2af7b858cd2c0 [id=3fa488eaad8a4777bfb3ff65aa8b15f2]) successfully deleted
I20260505 20:13:51.116026 9270 tablet_replica.cc:333] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.116261 9270 raft_consensus.cc:2243] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.116568 9270 raft_consensus.cc:2272] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.101580 9271 ts_tablet_manager.cc:1929] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.120863 9271 log.cc:1199] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/1f317f62391b422db2bf2a97ef928f99
I20260505 20:13:51.121238 9271 ts_tablet_manager.cc:1950] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.121695 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 184) took 13300 ms. Trace:
I20260505 20:13:51.121810 9271 rpcz_store.cc:276] 0505 20:13:37.820848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.820900 (+ 52us) service_pool.cc:224] Handling call
0505 20:13:51.072267 (+13251367us) ts_tablet_manager.cc:1151] Deleting tablet 1f317f62391b422db2bf2a97ef928f99
0505 20:13:51.072277 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.098429 (+ 26152us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.101519 (+ 3090us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.121675 (+ 20156us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13251175}
I20260505 20:13:51.122180 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 1f317f62391b422db2bf2a97ef928f99 (table default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]) successfully deleted
I20260505 20:13:51.117931 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9deeadbbc44a74b498eae5033464b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.123893 9271 tablet_replica.cc:333] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.124078 9271 raft_consensus.cc:2243] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.124224 9271 raft_consensus.cc:2272] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.124743 9271 ts_tablet_manager.cc:1916] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.128696 9495 raft_consensus.cc:493] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.128826 9495 raft_consensus.cc:515] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.129379 9495 leader_election.cc:290] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:51.130990 7598 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e32ff17c39f04bc2b1c9c37a1165399b
I20260505 20:13:51.131631 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.131821 7785 raft_consensus.cc:2468] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:51.133555 7596 leader_election.cc:304] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:51.134168 9906 raft_consensus.cc:2804] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:51.134254 9906 raft_consensus.cc:493] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.134333 9906 raft_consensus.cc:3060] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:51.137022 9906 raft_consensus.cc:515] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.138023 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32ff17c39f04bc2b1c9c37a1165399b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:51.138200 7785 raft_consensus.cc:3060] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:51.138597 9270 ts_tablet_manager.cc:1916] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:51.139096 7598 leader_election.cc:343] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: e32ff17c39f04bc2b1c9c37a1165399b
I20260505 20:13:51.139555 9906 leader_election.cc:290] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.140805 7785 raft_consensus.cc:2468] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 2.
I20260505 20:13:51.142028 9121 ts_tablet_manager.cc:1929] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.142138 9121 log.cc:1199] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/59f5348c229744ab98f0de3da40de6c5
I20260505 20:13:51.142397 9121 ts_tablet_manager.cc:1950] T 59f5348c229744ab98f0de3da40de6c5 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:51.143067 9271 ts_tablet_manager.cc:1929] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.143569 9271 log.cc:1199] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/7f34a3f1f30b4165a0c60fab482dce36
I20260505 20:13:51.143666 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:51.144155 9271 ts_tablet_manager.cc:1950] T 7f34a3f1f30b4165a0c60fab482dce36 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.143998 7409 catalog_manager.cc:5671] T 38822ad83f51454f9203fc17ed93a32f P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:51.144523 7409 catalog_manager.cc:5671] T 663d16be712b40859aa92277eab0c4a2 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:51.144950 7409 catalog_manager.cc:5671] T a5fcaee384c440bcb3307cba455e2ffa P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.145243 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:51.145983 7596 leader_election.cc:304] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546
I20260505 20:13:51.145931 8053 raft_consensus.cc:359] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.146086 8053 raft_consensus.cc:385] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.146131 8053 raft_consensus.cc:740] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.146308 8053 consensus_queue.cc:260] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.147054 9495 raft_consensus.cc:493] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.147208 9495 raft_consensus.cc:515] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.147776 9495 leader_election.cc:290] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:51.147959 9495 raft_consensus.cc:2804] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader election won for term 2
I20260505 20:13:51.148089 9495 raft_consensus.cc:697] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Becoming Leader. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Running, Role: LEADER
I20260505 20:13:51.148320 9495 consensus_queue.cc:237] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.149586 8053 ts_tablet_manager.cc:1434] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.071s user 0.002s sys 0.000s
I20260505 20:13:51.149922 8053 tablet_bootstrap.cc:492] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.150192 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.150856 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 185) took 13321 ms. Trace:
I20260505 20:13:51.150960 9271 rpcz_store.cc:276] 0505 20:13:37.829627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.829678 (+ 51us) service_pool.cc:224] Handling call
0505 20:13:51.123636 (+13293958us) ts_tablet_manager.cc:1151] Deleting tablet 7f34a3f1f30b4165a0c60fab482dce36
0505 20:13:51.123850 (+ 214us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.130022 (+ 6172us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.143016 (+ 12994us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.150832 (+ 7816us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13293743}
I20260505 20:13:51.151742 8053 tablet_bootstrap.cc:654] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.153509 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]) successfully deleted
I20260505 20:13:51.153609 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 199) took 12663 ms. Trace:
I20260505 20:13:51.153680 9271 rpcz_store.cc:276] 0505 20:13:38.490417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.490605 (+ 188us) service_pool.cc:224] Handling call
0505 20:13:51.153485 (+12662880us) ts_tablet_manager.cc:1151] Deleting tablet a114db19f63346d9a67e9e3a8225caa4
0505 20:13:51.153494 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.153592 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12662612}
W20260505 20:13:51.154127 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet a114db19f63346d9a67e9e3a8225caa4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a114db19f63346d9a67e9e3a8225caa4 already in progress: creating tablet
I20260505 20:13:51.154578 9271 tablet_replica.cc:333] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.154799 9271 raft_consensus.cc:2243] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.154911 10307 consensus_queue.cc:1048] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.145625 7409 catalog_manager.cc:5671] T 1d417bb8f3ac4343807e9ff4971eb2ad P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:51.158013 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c689df9f8285487da25b32b6c02df003" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.158231 7785 raft_consensus.cc:2393] T c689df9f8285487da25b32b6c02df003 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:51.158090 7409 catalog_manager.cc:5671] T 71a30738cb354b2c839f76b5d3b3be96 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:51.158675 7409 catalog_manager.cc:5671] T 010c399e14624550bf02ea248d653538 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.159029 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:51.158602 7596 leader_election.cc:304] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.159288 7409 catalog_manager.cc:5671] T a25cb36420534396a0850aef61706ae1 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.159623 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:51.159871 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:51.160172 9495 raft_consensus.cc:3060] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.160075 7409 catalog_manager.cc:5671] T 997f2f9cf76a4311ab233cb7d8bc8e3c P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.160332 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:51.160630 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:51.160960 7409 catalog_manager.cc:5671] T d5f27d918f0945208e780bd9583f529e P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.161266 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d78ebf153640e4b2f518fb215f1bf1" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.161446 7931 raft_consensus.cc:3060] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.161463 7409 catalog_manager.cc:5671] T 5bdd0cf6cefa43388b22cbd1cee820b6 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:51.161859 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:51.162253 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
I20260505 20:13:51.162434 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:51.162690 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:51.162710 9495 raft_consensus.cc:2749] T c689df9f8285487da25b32b6c02df003 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.163033 7409 catalog_manager.cc:5671] T 7e9bd035b077474294d274a8f8cb38fd P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.163374 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:51.163821 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67]). Expected version 1 got 0
I20260505 20:13:51.164018 7409 catalog_manager.cc:5671] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.164209 7931 raft_consensus.cc:2468] T f4d78ebf153640e4b2f518fb215f1bf1 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.164440 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:51.164662 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:51.164819 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:51.165001 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:51.165077 8058 tablet_bootstrap.cc:492] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:51.165208 8058 ts_tablet_manager.cc:1403] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.125s user 0.003s sys 0.000s
I20260505 20:13:51.165218 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:51.166826 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.167093 7931 raft_consensus.cc:2393] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:51.168767 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 191) took 11859 ms. Trace:
I20260505 20:13:51.168898 9121 rpcz_store.cc:276] 0505 20:13:39.309542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.309624 (+ 82us) service_pool.cc:224] Handling call
0505 20:13:51.086200 (+11776576us) ts_tablet_manager.cc:1151] Deleting tablet 59f5348c229744ab98f0de3da40de6c5
0505 20:13:51.086209 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.138467 (+ 52258us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.141978 (+ 3511us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.168754 (+ 26776us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11776270}
I20260505 20:13:51.169376 9121 tablet_replica.cc:333] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:51.169610 9121 raft_consensus.cc:2243] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.169853 9121 raft_consensus.cc:2272] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.170406 9121 ts_tablet_manager.cc:1916] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.171432 8054 tablet_bootstrap.cc:492] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.171646 8054 ts_tablet_manager.cc:1403] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.000s
I20260505 20:13:51.172420 8054 raft_consensus.cc:359] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.172648 8054 raft_consensus.cc:385] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.172751 8054 raft_consensus.cc:740] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.172922 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907b7dccd7a94115aca36915a558b103" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.172978 8054 consensus_queue.cc:260] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.173128 7931 raft_consensus.cc:3060] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.175186 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c (table default.Table_859d395c7b674d92b89e3f922f7b8db5 [id=801a4657329f44c7900ab019555c1af8]). Expected version 1 got 0
I20260505 20:13:51.175448 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:51.175693 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 06ad0e52c8b346cd920b35701fb23328 (table default.Table_a41cab9b68a142c9b7665c88d0d0ca7d [id=0c2a5400bd6e4ace87172b06b922cec3]). Expected version 1 got 0
I20260505 20:13:51.175823 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_c4f910d5074640b49ae08dc7c5966877 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 2 got 0
I20260505 20:13:51.175995 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:51.176113 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:51.176311 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 1205ac0117464cff99a742ac112a2178 (table default.Table_478f5ae54e9e41f0987ddb6bd06ca657 [id=f6b57ed30eb544e194c52687afdc0a8a]). Expected version 1 got 0
I20260505 20:13:51.176478 7931 raft_consensus.cc:2468] T 907b7dccd7a94115aca36915a558b103 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.177057 8054 ts_tablet_manager.cc:1434] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260505 20:13:51.177132 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:51.177424 8054 tablet_bootstrap.cc:492] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.178870 8054 tablet_bootstrap.cc:654] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:51.179579 7598 consensus_peers.cc:597] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3dbc2221555e4f598d65835ae640fe4a. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.180536 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c99f02ea514a2581f0697dc3ef6461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.180709 7931 raft_consensus.cc:2468] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.181862 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.182013 7921 raft_consensus.cc:2468] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.185461 8058 raft_consensus.cc:359] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.185626 8058 raft_consensus.cc:385] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.185675 8058 raft_consensus.cc:740] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.185930 8058 consensus_queue.cc:260] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.186457 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:51.186519 8058 ts_tablet_manager.cc:1434] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260505 20:13:51.186801 8058 tablet_bootstrap.cc:492] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:51.186919 7409 catalog_manager.cc:5671] T 8b3ebd96dc184e0db04b3e063d5b9b2d P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.187651 7409 catalog_manager.cc:5671] T 92ed62f9b81e48459c6d55664ddf1cc6 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: HEALTHY } } }
I20260505 20:13:51.188051 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:51.188268 8058 tablet_bootstrap.cc:654] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.188266 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:51.188714 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:51.188962 7409 catalog_manager.cc:5671] T ab52fb4e7c73420fa58cb6da23372adc P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.189364 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:51.189596 8053 tablet_bootstrap.cc:492] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.189599 7409 catalog_manager.cc:5671] T 7447c40ad6914e75a1b1376213218624 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.189896 8053 ts_tablet_manager.cc:1403] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.004s
I20260505 20:13:51.190567 8053 raft_consensus.cc:359] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.190784 8053 raft_consensus.cc:385] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.190869 8053 raft_consensus.cc:740] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.191084 8053 consensus_queue.cc:260] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.191565 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60c74cfa0d4c498ed50daefe3905ab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.191721 7921 raft_consensus.cc:2468] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.192459 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e217456754440cf90a1c5a642eb2627" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.192596 7921 raft_consensus.cc:2468] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.192971 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ec070a0196451c9564fa24b806516c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.193095 7921 raft_consensus.cc:3060] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.195415 8053 ts_tablet_manager.cc:1434] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260505 20:13:51.195772 8053 tablet_bootstrap.cc:492] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.198001 7921 raft_consensus.cc:2468] T 05ec070a0196451c9564fa24b806516c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.204362 8053 tablet_bootstrap.cc:654] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.210628 9270 ts_tablet_manager.cc:1929] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.210829 9270 log.cc:1199] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f4d78ebf153640e4b2f518fb215f1bf1
I20260505 20:13:51.211191 9270 ts_tablet_manager.cc:1950] T f4d78ebf153640e4b2f518fb215f1bf1 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.214553 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 147) took 13790 ms. Trace:
I20260505 20:13:51.228242 9270 rpcz_store.cc:276] 0505 20:13:37.424003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.424060 (+ 57us) service_pool.cc:224] Handling call
0505 20:13:51.115960 (+13691900us) ts_tablet_manager.cc:1151] Deleting tablet f4d78ebf153640e4b2f518fb215f1bf1
0505 20:13:51.115969 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.141419 (+ 25450us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.210565 (+ 69146us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.214532 (+ 3967us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13691697}
W20260505 20:13:51.230958 7596 consensus_peers.cc:597] T 7f34a3f1f30b4165a0c60fab482dce36 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f34a3f1f30b4165a0c60fab482dce36. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.235172 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 149) took 13810 ms. Trace:
I20260505 20:13:51.235213 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f4d78ebf153640e4b2f518fb215f1bf1 (table default.Table_f0619ce8ca3745c29c9e7c7e3d9f97cf [id=ce67d81dbf7049bbb005069ee91d338a]) successfully deleted
I20260505 20:13:51.235957 8053 tablet_bootstrap.cc:492] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.236090 8053 ts_tablet_manager.cc:1403] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.000s
I20260505 20:13:51.236475 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2fb4e615c4486b9d071b2366f85471" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.236665 7926 raft_consensus.cc:2468] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.237795 8053 raft_consensus.cc:359] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.237979 8053 raft_consensus.cc:385] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.238029 8053 raft_consensus.cc:740] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.238260 8053 consensus_queue.cc:260] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.238729 8053 ts_tablet_manager.cc:1434] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:51.238862 9270 rpcz_store.cc:276] 0505 20:13:37.424802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.424852 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:51.235038 (+13810186us) ts_tablet_manager.cc:1151] Deleting tablet faf3775c154742c5804daf8ade2ad854
0505 20:13:51.235051 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.235152 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13810023}
I20260505 20:13:51.239190 9270 tablet_replica.cc:333] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.239383 9270 raft_consensus.cc:2243] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260505 20:13:51.239389 7398 catalog_manager.cc:4982] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): delete failed for tablet faf3775c154742c5804daf8ade2ad854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faf3775c154742c5804daf8ade2ad854 already in progress: creating tablet
I20260505 20:13:51.239554 9270 raft_consensus.cc:2272] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.240093 9270 ts_tablet_manager.cc:1916] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.242017 8053 tablet_bootstrap.cc:492] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.243878 8054 tablet_bootstrap.cc:492] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.243894 8053 tablet_bootstrap.cc:654] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.244004 8054 ts_tablet_manager.cc:1403] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260505 20:13:51.244669 8054 raft_consensus.cc:359] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.244837 8054 raft_consensus.cc:385] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.244890 8054 raft_consensus.cc:740] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.245080 8054 consensus_queue.cc:260] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.246157 9271 raft_consensus.cc:2272] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.249511 10428 raft_consensus.cc:493] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.249653 10428 raft_consensus.cc:515] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.250289 10428 leader_election.cc:290] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:51.250403 9271 ts_tablet_manager.cc:1916] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.250882 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.251184 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce500f525c748d999d591390dd6094b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.251387 7785 raft_consensus.cc:2393] T 3ce500f525c748d999d591390dd6094b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:51.252636 7596 leader_election.cc:304] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.258590 10428 raft_consensus.cc:3060] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.261251 10428 raft_consensus.cc:2749] T 3ce500f525c748d999d591390dd6094b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.261657 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.261914 7785 raft_consensus.cc:2468] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 0.
I20260505 20:13:51.263058 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:51.263236 7785 raft_consensus.cc:2393] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:51.263424 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc9a6e1c824305869f6634192c5e78" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:51.263584 7793 raft_consensus.cc:3060] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.265918 10337 raft_consensus.cc:493] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.266094 10337 raft_consensus.cc:515] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.266701 10337 leader_election.cc:290] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.267434 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cd8f1a6124d2e89e170c5e1ff2385" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.267966 7793 raft_consensus.cc:2468] T 25fc9a6e1c824305869f6634192c5e78 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 974ed93a43c54ccbb58e60bfdae7c546 in term 1.
W20260505 20:13:51.268064 7870 leader_election.cc:343] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.270124 8053 tablet_bootstrap.cc:492] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.270315 8053 ts_tablet_manager.cc:1403] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20260505 20:13:51.271158 8053 raft_consensus.cc:359] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.271371 8053 raft_consensus.cc:385] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.271461 8053 raft_consensus.cc:740] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.271699 8053 consensus_queue.cc:260] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.272528 8053 ts_tablet_manager.cc:1434] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:51.272852 8053 tablet_bootstrap.cc:492] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.275308 8053 tablet_bootstrap.cc:654] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.279089 8054 ts_tablet_manager.cc:1434] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260505 20:13:51.283083 9975 consensus_queue.cc:1048] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.285513 10281 raft_consensus.cc:493] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.285665 10281 raft_consensus.cc:515] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.286319 10281 leader_election.cc:290] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:51.286599 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 3dbc2221555e4f598d65835ae640fe4a (table default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3]) successfully deleted
I20260505 20:13:51.286876 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 59f5348c229744ab98f0de3da40de6c5 (table default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]) successfully deleted
I20260505 20:13:51.287331 7737 leader_election.cc:304] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.287640 9975 raft_consensus.cc:2804] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.287765 9975 raft_consensus.cc:697] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
W20260505 20:13:51.288025 7737 leader_election.cc:343] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 359ab1033ccf4445862867f3f8b78ecd
I20260505 20:13:51.287998 9975 consensus_queue.cc:237] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.288060 9944 consensus_queue.cc:1048] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.288129 7737 leader_election.cc:304] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.288409 9944 raft_consensus.cc:2749] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.289158 9944 consensus_queue.cc:1048] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.289413 7737 leader_election.cc:304] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.289624 9944 raft_consensus.cc:2749] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.289785 7737 leader_election.cc:304] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.289999 9944 raft_consensus.cc:2804] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.290104 9944 raft_consensus.cc:697] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
W20260505 20:13:51.290184 7737 leader_election.cc:343] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 1f317f62391b422db2bf2a97ef928f99
I20260505 20:13:51.290263 7737 leader_election.cc:304] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:51.290396 7737 raft_consensus.cc:2686] T 1f317f62391b422db2bf2a97ef928f99 P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:51.290333 9944 consensus_queue.cc:237] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.291035 7737 leader_election.cc:304] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.291249 9948 raft_consensus.cc:2804] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.291314 9948 raft_consensus.cc:493] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.291392 9948 raft_consensus.cc:3060] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.294991 9948 raft_consensus.cc:515] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.296083 9948 leader_election.cc:290] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.296244 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c99f02ea514a2581f0697dc3ef6461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:51.296733 7737 leader_election.cc:304] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:51.296792 7736 leader_election.cc:343] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.297724 10298 raft_consensus.cc:2804] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.297832 10298 raft_consensus.cc:493] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.297897 10298 raft_consensus.cc:3060] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
W20260505 20:13:51.299728 7598 leader_election.cc:343] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: aa0b05546a4f47aea5fae1cf767b762d
I20260505 20:13:51.300953 10298 raft_consensus.cc:515] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.300992 7409 catalog_manager.cc:5671] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.301357 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:51.301527 10298 leader_election.cc:290] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.302331 7409 catalog_manager.cc:5671] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195). New cstate: current_term: 1 leader_uuid: "974ed93a43c54ccbb58e60bfdae7c546" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.302783 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.303355 7736 leader_election.cc:343] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.303850 7737 leader_election.cc:304] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.304157 10298 raft_consensus.cc:2804] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.304267 10298 raft_consensus.cc:493] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.304395 10298 raft_consensus.cc:3060] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.305466 9270 ts_tablet_manager.cc:1929] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.305581 9270 log.cc:1199] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/2540ed5144664ec0bfe0b548a5386176
I20260505 20:13:51.307547 10298 raft_consensus.cc:515] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.308560 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60c74cfa0d4c498ed50daefe3905ab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:51.308842 9948 consensus_queue.cc:1048] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:51.309041 7736 leader_election.cc:343] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.309321 7737 leader_election.cc:304] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.309736 9948 raft_consensus.cc:2804] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.309569 10298 leader_election.cc:290] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.309872 9948 raft_consensus.cc:493] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.309876 7737 leader_election.cc:304] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.310058 9948 raft_consensus.cc:3060] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.313313 9948 raft_consensus.cc:515] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.313398 10307 raft_consensus.cc:2804] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.313604 10307 raft_consensus.cc:697] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.313877 10307 consensus_queue.cc:237] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.314994 9894 consensus_queue.cc:1048] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:51.316031 7737 leader_election.cc:343] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: be05357416b24dabaaa5f2ce2f33c82e
I20260505 20:13:51.316196 7737 leader_election.cc:304] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
W20260505 20:13:51.316394 7737 raft_consensus.cc:2686] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:51.316663 7737 leader_election.cc:304] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.321121 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e217456754440cf90a1c5a642eb2627" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.321590 7736 leader_election.cc:343] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.322398 9894 raft_consensus.cc:2804] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.322485 9894 raft_consensus.cc:493] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.322541 9894 raft_consensus.cc:3060] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.322678 9948 leader_election.cc:290] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.325423 9894 raft_consensus.cc:515] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.326025 9894 leader_election.cc:290] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.326977 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2fb4e615c4486b9d071b2366f85471" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.327724 7736 leader_election.cc:343] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.328933 9894 consensus_queue.cc:1048] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.330410 8053 tablet_bootstrap.cc:492] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.333436 8053 ts_tablet_manager.cc:1403] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260505 20:13:51.334746 8053 raft_consensus.cc:359] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.335162 8053 raft_consensus.cc:385] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.335273 8053 raft_consensus.cc:740] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.336671 8054 tablet_bootstrap.cc:492] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.335561 8053 consensus_queue.cc:260] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.338919 8054 tablet_bootstrap.cc:654] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.339262 8053 ts_tablet_manager.cc:1434] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260505 20:13:51.341778 8053 tablet_bootstrap.cc:492] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:51.341910 7596 consensus_peers.cc:597] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1aaff49cb0ff4298be24603b2015c8a4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.342126 9270 ts_tablet_manager.cc:1950] T 2540ed5144664ec0bfe0b548a5386176 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.342954 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 153) took 13916 ms. Trace:
I20260505 20:13:51.343061 9270 rpcz_store.cc:276] 0505 20:13:37.426445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.426504 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:51.239142 (+13812638us) ts_tablet_manager.cc:1151] Deleting tablet 2540ed5144664ec0bfe0b548a5386176
0505 20:13:51.239154 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.265241 (+ 26087us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.305407 (+ 40166us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.342933 (+ 37526us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13812473}
I20260505 20:13:51.343508 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 2540ed5144664ec0bfe0b548a5386176 (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]) successfully deleted
I20260505 20:13:51.343725 9270 tablet_replica.cc:333] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.343991 9270 raft_consensus.cc:2243] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.344349 9270 pending_rounds.cc:70] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:51.344477 9270 pending_rounds.cc:77] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7282737262682361856 op_type: NO_OP noop_request { }
I20260505 20:13:51.344637 9270 raft_consensus.cc:2889] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:51.344779 9270 raft_consensus.cc:2272] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:51.345446 7596 leader_election.cc:343] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: aa0b05546a4f47aea5fae1cf767b762d
I20260505 20:13:51.345564 7596 leader_election.cc:304] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.345885 10281 raft_consensus.cc:2749] T aa0b05546a4f47aea5fae1cf767b762d P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.348024 9894 raft_consensus.cc:493] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.348136 9894 raft_consensus.cc:515] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.348330 9975 raft_consensus.cc:493] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.348400 9270 ts_tablet_manager.cc:1916] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.348445 9975 raft_consensus.cc:515] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.348790 9894 leader_election.cc:290] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.348924 9894 raft_consensus.cc:493] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.349095 9975 leader_election.cc:290] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.349067 9894 raft_consensus.cc:515] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.349593 9894 leader_election.cc:290] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.350136 8053 tablet_bootstrap.cc:654] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.350431 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a96ed0d53064aa480d93420c6b41bc2" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.350625 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0943621b2d14346ad79d1b7a74e4d47" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.350530 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b143e4943343d5b151f2804cccecfb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.350888 7736 leader_election.cc:343] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:51.351692 7736 leader_election.cc:343] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:51.351918 7736 leader_election.cc:343] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.352348 9271 ts_tablet_manager.cc:1929] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.352494 9271 log.cc:1199] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/be05357416b24dabaaa5f2ce2f33c82e
I20260505 20:13:51.352813 9271 ts_tablet_manager.cc:1950] T be05357416b24dabaaa5f2ce2f33c82e P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.353128 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 200) took 12862 ms. Trace:
I20260505 20:13:51.353227 9271 rpcz_store.cc:276] 0505 20:13:38.490543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.490932 (+ 389us) service_pool.cc:224] Handling call
0505 20:13:51.154534 (+12663602us) ts_tablet_manager.cc:1151] Deleting tablet be05357416b24dabaaa5f2ce2f33c82e
0505 20:13:51.154543 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.348618 (+194075us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.352299 (+ 3681us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.353081 (+ 782us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91183,"tablet-delete.queue_time_us":12663461}
I20260505 20:13:51.353672 9271 tablet_replica.cc:333] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.353823 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet be05357416b24dabaaa5f2ce2f33c82e (table default.Table_aa427cba6f1643a9a1e198aa07362d05 [id=0ecfdba7d4e7473c8a4a95eea4d7ece4]) successfully deleted
I20260505 20:13:51.354035 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
W20260505 20:13:51.354395 7596 consensus_peers.cc:597] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 089517a7c2214dce9367b21beb555733. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.354398 7409 catalog_manager.cc:5763] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859) does not have the latest schema for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_62ee92145c3c4d44950043e4f19c5b15 [id=3734c4511d224584aeed0efd6bac453d]). Expected version 2 got 1
I20260505 20:13:51.354761 7409 catalog_manager.cc:5671] T 22b7c02a4bd84e788d9fc92781c161a1 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.355377 7409 catalog_manager.cc:5671] T 3535f0c31ad5451ea5bceeb50f756eef P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to cab133462c2f46309dc8f0792122bad9 (127.7.33.193). New cstate: current_term: 1 leader_uuid: "cab133462c2f46309dc8f0792122bad9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.355917 7409 catalog_manager.cc:5671] T 5b3595eb9b1144d9b802f1f563d01461 P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } }
I20260505 20:13:51.356416 7409 catalog_manager.cc:5671] T 9845d42fafa14457bd6c54d7477786aa P 974ed93a43c54ccbb58e60bfdae7c546 reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } }
I20260505 20:13:51.361132 10418 raft_consensus.cc:493] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.361284 10418 raft_consensus.cc:515] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.361321 10196 consensus_queue.cc:1048] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.361827 10418 leader_election.cc:290] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.362015 10418 raft_consensus.cc:493] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.362104 10418 raft_consensus.cc:515] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.362375 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382e748682547b1a41781ff05c6733d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.362568 10418 leader_election.cc:290] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
W20260505 20:13:51.362983 7870 leader_election.cc:343] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.363256 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3257f86264120b145263525d260a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.363720 7870 leader_election.cc:343] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.364632 8054 tablet_bootstrap.cc:492] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.364642 8058 tablet_bootstrap.cc:492] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:51.364769 8058 ts_tablet_manager.cc:1403] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.178s user 0.003s sys 0.000s
I20260505 20:13:51.365430 8053 tablet_bootstrap.cc:492] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.365412 8058 raft_consensus.cc:359] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.365581 8058 raft_consensus.cc:385] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.365650 8058 raft_consensus.cc:740] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.365901 8058 consensus_queue.cc:260] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.366384 8054 ts_tablet_manager.cc:1403] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20260505 20:13:51.366505 8058 ts_tablet_manager.cc:1434] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:51.366767 8053 ts_tablet_manager.cc:1403] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260505 20:13:51.367743 8058 tablet_bootstrap.cc:492] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:51.369659 8058 tablet_bootstrap.cc:654] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.372258 7905 tablet_service.cc:1558] Processing DeleteTablet for tablet 266d53c82e3f45abb6e50d2e21948336 with delete_type TABLET_DATA_DELETED (replaced by tablet 730d5b70ffaa420f8b69bea68172e7ab) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:51.372514 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 3870d55d0dad4ac6ab03e7346d2e534b (DEFAULT_TABLE table=default.Table_bd80980cb57c4ada90ee385fb2aba768 [id=d2fe2d7792d04810be4084ffb2af28cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.372895 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3870d55d0dad4ac6ab03e7346d2e534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.372535 7902 tablet_service.cc:1558] Processing DeleteTablet for tablet ede080523cb1482d8a531f4044164475 with delete_type TABLET_DATA_DELETED (replaced by tablet b9d3b5ff1027458996dd4ad4c8481e2a) from {username='slave'} at 127.0.0.1:42188
I20260505 20:13:51.375986 10428 raft_consensus.cc:493] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.376118 10428 raft_consensus.cc:515] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.376684 10428 leader_election.cc:290] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:51.377718 7596 consensus_peers.cc:597] T d3cd1b7b0456462a80d653dd442589a6 P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3cd1b7b0456462a80d653dd442589a6. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:51.378754 7598 leader_election.cc:343] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 59f5348c229744ab98f0de3da40de6c5
I20260505 20:13:51.379032 9270 ts_tablet_manager.cc:1929] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260505 20:13:51.379312 7904 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8f5967ceac4249b167d147143f82bd (DEFAULT_TABLE table=default.Table_2b459106b61447888223447c59e0a007 [id=1f5ea9da88bb4e10966ad3e6c6ca1676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.379739 7904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8f5967ceac4249b167d147143f82bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.376263 9894 raft_consensus.cc:493] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.381431 9894 raft_consensus.cc:515] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.382041 9894 leader_election.cc:290] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.378135 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f5348c229744ab98f0de3da40de6c5" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.383615 8053 raft_consensus.cc:359] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.384248 8054 raft_consensus.cc:359] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.384480 8054 raft_consensus.cc:385] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.384573 8054 raft_consensus.cc:740] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.382706 7596 leader_election.cc:304] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.385027 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6dc9ec93ddb406ab956389518a9a7b3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.385357 9495 raft_consensus.cc:2749] T 59f5348c229744ab98f0de3da40de6c5 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.385424 8053 raft_consensus.cc:385] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.385464 9121 ts_tablet_manager.cc:1929] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.385488 8053 raft_consensus.cc:740] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.385563 9121 log.cc:1199] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/5b6326375bac48f0944eeeaa9b39682c
I20260505 20:13:51.384832 8054 consensus_queue.cc:260] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.385901 8053 consensus_queue.cc:260] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:51.386005 7736 leader_election.cc:343] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.386317 9270 log.cc:1199] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/41fdaa9781ef4331bf3f0a7f8db4c1a0
I20260505 20:13:51.386652 8054 ts_tablet_manager.cc:1434] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260505 20:13:51.386969 8054 tablet_bootstrap.cc:492] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.388043 9495 raft_consensus.cc:493] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.388160 9495 raft_consensus.cc:515] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.388362 8054 tablet_bootstrap.cc:654] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.388686 9495 leader_election.cc:290] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
I20260505 20:13:51.389204 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.389389 7926 raft_consensus.cc:2393] T b6a3078a3ec94043b84de3d39a1f5233 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:51.389441 8053 ts_tablet_manager.cc:1434] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260505 20:13:51.389735 8053 tablet_bootstrap.cc:492] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.389994 9270 ts_tablet_manager.cc:1950] T 41fdaa9781ef4331bf3f0a7f8db4c1a0 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:51.390334 7596 consensus_peers.cc:597] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e650b297603425184ad97ddf99ec36d. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.390306 7902 tablet_service.cc:1511] Processing CreateTablet for tablet c547e6ac805e498bafee3ffbd17465aa (DEFAULT_TABLE table=default.Table_40ea5fef14794773a98ea223a7f8115d [id=516eb19ec8d640919a09585e9ae30f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.390656 7902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c547e6ac805e498bafee3ffbd17465aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.390785 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 152) took 13964 ms. Trace:
I20260505 20:13:51.390877 9270 rpcz_store.cc:276] 0505 20:13:37.426356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.426583 (+ 227us) service_pool.cc:224] Handling call
0505 20:13:51.343677 (+13917094us) ts_tablet_manager.cc:1151] Deleting tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0
0505 20:13:51.343687 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.351711 (+ 8024us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.378969 (+ 27258us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.390765 (+ 11796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3019,"tablet-delete.queue_time_us":13916935}
I20260505 20:13:51.391160 8053 tablet_bootstrap.cc:654] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.391400 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 41fdaa9781ef4331bf3f0a7f8db4c1a0 (table default.Table_d7d6dfb1719442dab808da26e3a7e10d [id=895576b19e464ebfb28952b918db2cc0]) successfully deleted
I20260505 20:13:51.393563 9270 tablet_replica.cc:333] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.393905 9270 raft_consensus.cc:2243] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.394140 9270 raft_consensus.cc:2272] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.395942 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a3078a3ec94043b84de3d39a1f5233" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.396221 7793 raft_consensus.cc:2393] T b6a3078a3ec94043b84de3d39a1f5233 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:51.396680 7596 leader_election.cc:304] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.396966 7902 tablet_service.cc:1511] Processing CreateTablet for tablet c447c435decd4ec3b701c579cf6e7992 (DEFAULT_TABLE table=default.Table_eabba64f8cfd46b79633f42b297da738 [id=e361bee9655441ada170e0af7ac4015b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.397130 9495 raft_consensus.cc:3060] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.397408 7902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c447c435decd4ec3b701c579cf6e7992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.399727 9495 raft_consensus.cc:2749] T b6a3078a3ec94043b84de3d39a1f5233 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.399966 9270 ts_tablet_manager.cc:1916] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:51.401363 7598 consensus_peers.cc:597] T 089517a7c2214dce9367b21beb555733 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 089517a7c2214dce9367b21beb555733. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:51.402125 8053 tablet_bootstrap.cc:492] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.402302 8053 ts_tablet_manager.cc:1403] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260505 20:13:51.403079 8053 raft_consensus.cc:359] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.403302 8053 raft_consensus.cc:385] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.403405 8053 raft_consensus.cc:740] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.403680 8053 consensus_queue.cc:260] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.404299 8053 ts_tablet_manager.cc:1434] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:51.404717 8053 tablet_bootstrap.cc:492] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.405351 10196 raft_consensus.cc:493] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.405527 10196 raft_consensus.cc:515] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.406344 8053 tablet_bootstrap.cc:654] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.406697 10196 leader_election.cc:290] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.406791 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c4620970434e49b4fd3d21f309a48c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.407395 7870 leader_election.cc:343] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.408839 10196 consensus_queue.cc:1048] T 6f3a4294f4c34ac886a136c2ece31531 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.409374 7869 leader_election.cc:304] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.409600 10196 raft_consensus.cc:2804] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.409669 10196 raft_consensus.cc:493] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.409762 10196 raft_consensus.cc:3060] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.412171 7905 tablet_service.cc:1511] Processing CreateTablet for tablet bd9deeadbbc44a74b498eae5033464b7 (DEFAULT_TABLE table=default.Table_feafef8bf3e64e14b0fe7067ffa9c9fc [id=ba1397c6b20749029c2e8d65ddd7043e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.412572 7905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9deeadbbc44a74b498eae5033464b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:51.413153 10196 raft_consensus.cc:515] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.413790 10196 leader_election.cc:290] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.414414 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.414978 7870 leader_election.cc:343] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.416132 9944 raft_consensus.cc:493] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.417174 7658 raft_consensus.cc:3060] T e1e4b516283f441bb77f038816afa4ed P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.418128 9121 ts_tablet_manager.cc:1950] T 5b6326375bac48f0944eeeaa9b39682c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:51.419008 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 192) took 12104 ms. Trace:
I20260505 20:13:51.419109 9121 rpcz_store.cc:276] 0505 20:13:39.314639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.314699 (+ 60us) service_pool.cc:224] Handling call
0505 20:13:51.169334 (+11854635us) ts_tablet_manager.cc:1151] Deleting tablet 5b6326375bac48f0944eeeaa9b39682c
0505 20:13:51.169342 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.204746 (+ 35404us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.385410 (+180664us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.418987 (+ 33577us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11854401}
I20260505 20:13:51.419494 9121 tablet_replica.cc:333] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:51.419700 9121 raft_consensus.cc:2243] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.420018 9121 raft_consensus.cc:2272] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.420285 9944 raft_consensus.cc:515] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.420692 9121 ts_tablet_manager.cc:1916] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.420714 9894 consensus_queue.cc:1048] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.420986 9944 leader_election.cc:290] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.421867 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81319ed5eed64dafb9b2a121661da9ea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.422344 7736 leader_election.cc:343] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.434037 8053 tablet_bootstrap.cc:492] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.434257 8053 ts_tablet_manager.cc:1403] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.003s
I20260505 20:13:51.435223 8053 raft_consensus.cc:359] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.435493 8053 raft_consensus.cc:385] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.435591 8053 raft_consensus.cc:740] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.435861 8053 consensus_queue.cc:260] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.436502 8053 ts_tablet_manager.cc:1434] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:51.436810 8053 tablet_bootstrap.cc:492] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.444041 10428 raft_consensus.cc:493] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:51.444247 10428 raft_consensus.cc:515] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.445032 10428 leader_election.cc:290] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859), c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991)
W20260505 20:13:51.445806 7598 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: b6ed7c0220d147c7853c7afc1ef09607
W20260505 20:13:51.446090 7596 leader_election.cc:343] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: b6ed7c0220d147c7853c7afc1ef09607
I20260505 20:13:51.446228 7596 leader_election.cc:304] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.446949 10428 raft_consensus.cc:2749] T b6ed7c0220d147c7853c7afc1ef09607 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:51.450091 7869 leader_election.cc:304] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.450471 7869 leader_election.cc:304] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.450687 10418 raft_consensus.cc:2749] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.450851 10418 raft_consensus.cc:2804] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.450947 10418 raft_consensus.cc:697] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 LEADER]: Becoming Leader. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Running, Role: LEADER
I20260505 20:13:51.451216 10418 consensus_queue.cc:237] T 25fc9a6e1c824305869f6634192c5e78 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:51.454185 7598 consensus_peers.cc:597] T 1aaff49cb0ff4298be24603b2015c8a4 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1aaff49cb0ff4298be24603b2015c8a4. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.455502 9270 ts_tablet_manager.cc:1929] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:51.455629 9270 log.cc:1199] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/4e91e29eb2e6462a975adcf9a379c421
I20260505 20:13:51.463940 9270 ts_tablet_manager.cc:1950] T 4e91e29eb2e6462a975adcf9a379c421 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.471957 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 154) took 14045 ms. Trace:
I20260505 20:13:51.472363 8053 tablet_bootstrap.cc:654] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.477160 8053 tablet_bootstrap.cc:492] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.477563 8053 ts_tablet_manager.cc:1403] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.002s
I20260505 20:13:51.478350 8053 raft_consensus.cc:359] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.478611 8053 raft_consensus.cc:385] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.478673 8053 raft_consensus.cc:740] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.478914 8053 consensus_queue.cc:260] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.480412 8053 ts_tablet_manager.cc:1434] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260505 20:13:51.480710 8053 tablet_bootstrap.cc:492] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.481393 9270 rpcz_store.cc:276] 0505 20:13:37.426539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.426783 (+ 244us) service_pool.cc:224] Handling call
0505 20:13:51.393502 (+13966719us) ts_tablet_manager.cc:1151] Deleting tablet 4e91e29eb2e6462a975adcf9a379c421
0505 20:13:51.393515 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.411491 (+ 17976us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.455427 (+ 43936us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.471923 (+ 16496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13966595}
I20260505 20:13:51.482441 8053 tablet_bootstrap.cc:654] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.483016 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 4e91e29eb2e6462a975adcf9a379c421 (table default.Table_0f5f9bf433a14811882fb1e5a2f93aba [id=6cdd177b6b79450ea461ad6a2ae78aa4]) successfully deleted
I20260505 20:13:51.483171 9270 tablet_replica.cc:333] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.483392 9270 raft_consensus.cc:2243] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Raft consensus shutting down.
W20260505 20:13:51.486644 7598 consensus_peers.cc:597] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdda1cc266cd47c993b5d1a0a78c7df9. This is attempt 6: this message will repeat every 5th retry.
I20260505 20:13:51.487162 9270 pending_rounds.cc:70] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:51.488546 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7382e748682547b1a41781ff05c6733d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.488907 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a3257f86264120b145263525d260a4" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.489001 9270 pending_rounds.cc:77] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7282737263257579520 op_type: NO_OP noop_request { }
I20260505 20:13:51.489168 9270 raft_consensus.cc:2889] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:51.489264 9270 raft_consensus.cc:2272] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.489931 9270 ts_tablet_manager.cc:1916] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.490279 7789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c4620970434e49b4fd3d21f309a48c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.491739 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:51.491834 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 5b6326375bac48f0944eeeaa9b39682c (table default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853]) successfully deleted
I20260505 20:13:51.491940 7787 raft_consensus.cc:2393] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 974ed93a43c54ccbb58e60bfdae7c546 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
I20260505 20:13:51.494385 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "616cd8f1a6124d2e89e170c5e1ff2385" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
W20260505 20:13:51.504244 7985 tablet.cc:2404] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:51.515843 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:51.518019 9270 ts_tablet_manager.cc:1929] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:51.518296 9270 log.cc:1199] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/bde33085759f4fd8a130d80878d1e564
I20260505 20:13:51.518890 9270 ts_tablet_manager.cc:1950] T bde33085759f4fd8a130d80878d1e564 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.519304 7902 tablet_service.cc:1511] Processing CreateTablet for tablet ea2219920d55429b870ef8fcbe917fcc (DEFAULT_TABLE table=default.Table_a22be686199c4d04853e7e11967bd0f5 [id=b9b6fec6b9e348a5b5eb67cda572c34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:51.519796 9975 raft_consensus.cc:493] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.519941 9975 raft_consensus.cc:515] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.520584 9975 leader_election.cc:290] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.520985 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93512b85b764438aeb7bca9fe339442" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.521099 7902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2219920d55429b870ef8fcbe917fcc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260505 20:13:51.521605 7736 leader_election.cc:343] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.532446 8058 tablet_bootstrap.cc:492] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:51.532618 8058 ts_tablet_manager.cc:1403] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.165s user 0.002s sys 0.000s
I20260505 20:13:51.533679 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 151) took 14107 ms. Trace:
I20260505 20:13:51.536929 9270 rpcz_store.cc:276] 0505 20:13:37.426229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.426917 (+ 688us) service_pool.cc:224] Handling call
0505 20:13:51.483098 (+14056181us) ts_tablet_manager.cc:1151] Deleting tablet bde33085759f4fd8a130d80878d1e564
0505 20:13:51.483112 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.514902 (+ 31790us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.517955 (+ 3053us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.533657 (+ 15702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14056055}
I20260505 20:13:51.537489 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet bde33085759f4fd8a130d80878d1e564 (table default.Table_f1c1f40aa3044bdbbaa23ae22445214b [id=53e038ba0a4441ec9746e5dff6df39dc]) successfully deleted
I20260505 20:13:51.538995 9270 tablet_replica.cc:333] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.539304 8058 raft_consensus.cc:359] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.539630 8058 raft_consensus.cc:385] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.539763 8058 raft_consensus.cc:740] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.540146 8058 consensus_queue.cc:260] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.542832 8058 ts_tablet_manager.cc:1434] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260505 20:13:51.543205 8058 tablet_bootstrap.cc:492] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:51.544821 8058 tablet_bootstrap.cc:654] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.548935 9271 raft_consensus.cc:2243] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.549124 9271 raft_consensus.cc:2272] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.549316 7984 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:51.549677 9271 ts_tablet_manager.cc:1916] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.545059 9270 raft_consensus.cc:2243] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.550559 9270 raft_consensus.cc:2272] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.551201 9270 ts_tablet_manager.cc:1916] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.556684 9271 ts_tablet_manager.cc:1929] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.556800 9271 log.cc:1199] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/359ab1033ccf4445862867f3f8b78ecd
I20260505 20:13:51.557065 9271 ts_tablet_manager.cc:1950] T 359ab1033ccf4445862867f3f8b78ecd P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.557996 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 201) took 13063 ms. Trace:
I20260505 20:13:51.558100 9271 rpcz_store.cc:276] 0505 20:13:38.494834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.494907 (+ 73us) service_pool.cc:224] Handling call
0505 20:13:51.353575 (+12858668us) ts_tablet_manager.cc:1151] Deleting tablet 359ab1033ccf4445862867f3f8b78ecd
0505 20:13:51.353585 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.553830 (+200245us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.556631 (+ 2801us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.557974 (+ 1343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12858395}
I20260505 20:13:51.558457 9271 tablet_replica.cc:333] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.558570 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 359ab1033ccf4445862867f3f8b78ecd (table default.Table_5bb1f646bb2b47d8a6a36d6964937b3d [id=43496ef5c80a4178b227a11f10098926]) successfully deleted
I20260505 20:13:51.558779 9271 raft_consensus.cc:2243] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.558946 9271 raft_consensus.cc:2272] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.559499 9271 ts_tablet_manager.cc:1916] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.559808 8054 tablet_bootstrap.cc:492] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.559958 8054 ts_tablet_manager.cc:1403] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.173s user 0.028s sys 0.038s
I20260505 20:13:51.560698 8054 raft_consensus.cc:359] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.560896 8054 raft_consensus.cc:385] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.560963 8054 raft_consensus.cc:740] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.561173 8054 consensus_queue.cc:260] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.561664 8054 ts_tablet_manager.cc:1434] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:51.562608 8054 tablet_bootstrap.cc:492] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.564232 8054 tablet_bootstrap.cc:654] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.566272 9271 ts_tablet_manager.cc:1929] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.566383 9271 log.cc:1199] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/ec3374a8f51d4c1a94dbd24d4a9da0af
I20260505 20:13:51.566696 9271 ts_tablet_manager.cc:1950] T ec3374a8f51d4c1a94dbd24d4a9da0af P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.567088 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 202) took 13058 ms. Trace:
I20260505 20:13:51.567175 9271 rpcz_store.cc:276] 0505 20:13:38.508943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.509021 (+ 78us) service_pool.cc:224] Handling call
0505 20:13:51.558406 (+13049385us) ts_tablet_manager.cc:1151] Deleting tablet ec3374a8f51d4c1a94dbd24d4a9da0af
0505 20:13:51.558417 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.563290 (+ 4873us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.566223 (+ 2933us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.567072 (+ 849us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13049126}
I20260505 20:13:51.567679 9271 tablet_replica.cc:333] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.567842 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet ec3374a8f51d4c1a94dbd24d4a9da0af (table default.Table_230d8eb90a074722ae79ec83c16b757b [id=86f7f9ca66a94e0fbf7c2c6de8540c54]) successfully deleted
I20260505 20:13:51.567898 9271 raft_consensus.cc:2243] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.568269 9271 raft_consensus.cc:2272] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.568866 9271 ts_tablet_manager.cc:1916] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.573571 9270 ts_tablet_manager.cc:1929] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.573868 9270 log.cc:1199] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/1f27847d940e46778ad10a2f4cf40d27
I20260505 20:13:51.574280 9270 ts_tablet_manager.cc:1950] T 1f27847d940e46778ad10a2f4cf40d27 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.582669 10337 consensus_queue.cc:1048] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.581728 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:51.588526 7303 master-stress-test.cc:577] Killing test thread 1/25
I20260505 20:13:51.593894 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2c99f02ea514a2581f0697dc3ef6461" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.594102 7921 raft_consensus.cc:3060] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.597003 7921 raft_consensus.cc:2468] T e2c99f02ea514a2581f0697dc3ef6461 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.598489 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28caca1a9a044701991ebda53cf75499" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.598717 8053 tablet_bootstrap.cc:492] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.598857 7921 raft_consensus.cc:2393] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c59c731e012f4f9fbfd7151790b9a5bb in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:51.598901 8053 ts_tablet_manager.cc:1403] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.009s
I20260505 20:13:51.616348 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b60c74cfa0d4c498ed50daefe3905ab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.616604 7919 raft_consensus.cc:3060] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.620162 7919 raft_consensus.cc:2468] T 5b60c74cfa0d4c498ed50daefe3905ab P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.626384 9271 ts_tablet_manager.cc:1929] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.626533 9271 log.cc:1199] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/35ada922a36f4f329a5ff8b328dbef5f
I20260505 20:13:51.627249 9271 ts_tablet_manager.cc:1950] T 35ada922a36f4f329a5ff8b328dbef5f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.631664 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e217456754440cf90a1c5a642eb2627" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.631866 7930 raft_consensus.cc:3060] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.634649 7930 raft_consensus.cc:2468] T 9e217456754440cf90a1c5a642eb2627 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.635262 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2fb4e615c4486b9d071b2366f85471" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:51.635540 7930 raft_consensus.cc:3060] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.638959 7930 raft_consensus.cc:2468] T ad2fb4e615c4486b9d071b2366f85471 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:51.639436 10418 raft_consensus.cc:493] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.639586 10418 raft_consensus.cc:515] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.640178 10418 leader_election.cc:290] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.640816 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f71198bf544c11b7566a5864e2d43d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.641481 7870 leader_election.cc:343] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.642316 9894 raft_consensus.cc:493] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.642457 9894 raft_consensus.cc:515] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.643085 9894 leader_election.cc:290] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.643951 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97a8c35af23454a9cf63193f763381e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.644477 7736 leader_election.cc:343] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.645468 8053 raft_consensus.cc:359] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.645676 8053 raft_consensus.cc:385] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.645757 8053 raft_consensus.cc:740] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.645968 8053 consensus_queue.cc:260] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.646521 8053 ts_tablet_manager.cc:1434] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.048s user 0.001s sys 0.000s
I20260505 20:13:51.649808 9975 raft_consensus.cc:493] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.649922 9975 raft_consensus.cc:515] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.650447 9975 leader_election.cc:290] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.651083 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaade50115e4ea69db6e50443cfea0e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.652094 7736 leader_election.cc:343] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.655154 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b143e4943343d5b151f2804cccecfb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.655211 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0943621b2d14346ad79d1b7a74e4d47" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.655377 7934 raft_consensus.cc:2468] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.655400 7933 raft_consensus.cc:2468] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.655875 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6dc9ec93ddb406ab956389518a9a7b3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.656016 7933 raft_consensus.cc:2468] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.657197 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81319ed5eed64dafb9b2a121661da9ea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.657392 7933 raft_consensus.cc:2468] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.657675 9975 raft_consensus.cc:493] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.657823 9975 raft_consensus.cc:515] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.658419 9975 leader_election.cc:290] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.659031 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca16deae2e4f4f9a9069822b57c5bc7f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.659593 7736 leader_election.cc:343] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.660192 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 155) took 14232 ms. Trace:
I20260505 20:13:51.660290 9270 rpcz_store.cc:276] 0505 20:13:37.427514 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.427628 (+ 114us) service_pool.cc:224] Handling call
0505 20:13:51.537493 (+14109865us) ts_tablet_manager.cc:1151] Deleting tablet 1f27847d940e46778ad10a2f4cf40d27
0505 20:13:51.538929 (+ 1436us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.555442 (+ 16513us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.573502 (+ 18060us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.660169 (+ 86667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5749,"tablet-delete.queue_time_us":14109712}
I20260505 20:13:51.660699 9270 tablet_replica.cc:333] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.660893 9270 raft_consensus.cc:2243] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.661056 9270 raft_consensus.cc:2272] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.661690 9270 ts_tablet_manager.cc:1916] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.663359 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 1f27847d940e46778ad10a2f4cf40d27 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]) successfully deleted
I20260505 20:13:51.670408 9270 ts_tablet_manager.cc:1929] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:51.670624 9270 log.cc:1199] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/bd01314146a34257b444a622829b2fe4
I20260505 20:13:51.671193 9270 ts_tablet_manager.cc:1950] T bd01314146a34257b444a622829b2fe4 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.672003 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 156) took 14244 ms. Trace:
I20260505 20:13:51.672155 9270 rpcz_store.cc:276] 0505 20:13:37.427592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.428019 (+ 427us) service_pool.cc:224] Handling call
0505 20:13:51.660646 (+14232627us) ts_tablet_manager.cc:1151] Deleting tablet bd01314146a34257b444a622829b2fe4
0505 20:13:51.660659 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.666019 (+ 5360us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.670350 (+ 4331us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.671981 (+ 1631us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14232478}
I20260505 20:13:51.672731 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet bd01314146a34257b444a622829b2fe4 (table default.Table_61d9b0e280f5450ea9007d9a0d283072 [id=ce2bc68d504645e88e71fa515e60f385]) successfully deleted
I20260505 20:13:51.673092 9270 tablet_replica.cc:333] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:51.678432 8054 tablet_bootstrap.cc:492] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.678666 8054 ts_tablet_manager.cc:1403] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.005s
I20260505 20:13:51.679421 8054 raft_consensus.cc:359] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.682168 9270 raft_consensus.cc:2243] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.682830 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 203) took 13168 ms. Trace:
I20260505 20:13:51.682971 9271 rpcz_store.cc:276] 0505 20:13:38.514071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:38.514160 (+ 89us) service_pool.cc:224] Handling call
0505 20:13:51.567629 (+13053469us) ts_tablet_manager.cc:1151] Deleting tablet 35ada922a36f4f329a5ff8b328dbef5f
0505 20:13:51.567640 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.571837 (+ 4197us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.626288 (+ 54451us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.682801 (+ 56513us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":13053152}
I20260505 20:13:51.683478 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 204) took 12482 ms. Trace:
I20260505 20:13:51.683573 9271 rpcz_store.cc:276] 0505 20:13:39.201411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.201476 (+ 65us) service_pool.cc:224] Handling call
0505 20:13:51.683331 (+12481855us) ts_tablet_manager.cc:1151] Deleting tablet 5060bba634d440a09840e36e37a80d46
0505 20:13:51.683345 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.683460 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12481599}
I20260505 20:13:51.683720 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 35ada922a36f4f329a5ff8b328dbef5f (table default.Table_9be38cc8ceb7408d9d7853cba373f215 [id=ba42d9870f0a4ffe859ae11df6e4b5e6]) successfully deleted
I20260505 20:13:51.683890 9271 tablet_replica.cc:333] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.684158 9271 raft_consensus.cc:2243] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.684361 9271 raft_consensus.cc:2272] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:51.684504 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 5060bba634d440a09840e36e37a80d46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5060bba634d440a09840e36e37a80d46 already in progress: creating tablet
I20260505 20:13:51.685858 9270 raft_consensus.cc:2272] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.690347 9271 ts_tablet_manager.cc:1916] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.690752 9975 raft_consensus.cc:493] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.690889 9975 raft_consensus.cc:515] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.691529 9975 leader_election.cc:290] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.694257 8054 raft_consensus.cc:385] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.695472 9975 consensus_queue.cc:1048] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.692382 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54b7c83e66c473db8470e5c4c4decab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.696225 7736 leader_election.cc:343] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.696753 9270 ts_tablet_manager.cc:1916] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.696954 8054 raft_consensus.cc:740] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.694499 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93512b85b764438aeb7bca9fe339442" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.695107 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaade50115e4ea69db6e50443cfea0e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.697321 7934 raft_consensus.cc:2468] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.697502 7933 raft_consensus.cc:2468] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.695267 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54b7c83e66c473db8470e5c4c4decab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.695288 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca16deae2e4f4f9a9069822b57c5bc7f" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.697669 7922 raft_consensus.cc:2468] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.697721 7931 raft_consensus.cc:2468] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.695546 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97a8c35af23454a9cf63193f763381e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.698056 7926 raft_consensus.cc:2468] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.679754 7919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a96ed0d53064aa480d93420c6b41bc2" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:51.698387 7919 raft_consensus.cc:2468] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:51.698514 8054 consensus_queue.cc:260] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.700457 8054 ts_tablet_manager.cc:1434] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260505 20:13:51.700801 8054 tablet_bootstrap.cc:492] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.702126 8053 tablet_bootstrap.cc:492] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.704102 9271 ts_tablet_manager.cc:1929] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.704247 9271 log.cc:1199] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/3dbc2221555e4f598d65835ae640fe4a
I20260505 20:13:51.704627 9271 ts_tablet_manager.cc:1950] T 3dbc2221555e4f598d65835ae640fe4a P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.705524 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 205) took 12503 ms. Trace:
I20260505 20:13:51.705619 9271 rpcz_store.cc:276] 0505 20:13:39.202023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.202061 (+ 38us) service_pool.cc:224] Handling call
0505 20:13:51.683836 (+12481775us) ts_tablet_manager.cc:1151] Deleting tablet 3dbc2221555e4f598d65835ae640fe4a
0505 20:13:51.683847 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.697834 (+ 13987us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.701690 (+ 3856us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.705502 (+ 3812us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12481619}
I20260505 20:13:51.706008 9271 tablet_replica.cc:333] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.706218 9271 raft_consensus.cc:2243] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.706454 9271 pending_rounds.cc:70] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Trying to abort 1 pending ops.
I20260505 20:13:51.706349 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 3dbc2221555e4f598d65835ae640fe4a (table default.Table_cc693952864d4827804cf959c57b2435 [id=d491ba42b35d485193d04d4a239504e3]) successfully deleted
I20260505 20:13:51.706494 9271 pending_rounds.cc:77] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737279192145920 op_type: NO_OP noop_request { }
I20260505 20:13:51.706584 9271 raft_consensus.cc:2889] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:51.706656 9271 raft_consensus.cc:2272] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.707468 9271 ts_tablet_manager.cc:1916] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.708982 7737 leader_election.cc:304] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.709236 9975 raft_consensus.cc:2804] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.709340 9975 raft_consensus.cc:697] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.704120 8053 tablet_bootstrap.cc:654] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.709575 9975 consensus_queue.cc:237] T e2c99f02ea514a2581f0697dc3ef6461 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.709867 7737 leader_election.cc:304] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c59c731e012f4f9fbfd7151790b9a5bb; no voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.710189 9894 raft_consensus.cc:2749] T 28caca1a9a044701991ebda53cf75499 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.710678 7737 leader_election.cc:304] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.711122 9894 raft_consensus.cc:2804] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.711265 9894 raft_consensus.cc:697] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.711537 9894 consensus_queue.cc:237] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.713441 9271 ts_tablet_manager.cc:1929] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.713532 9271 log.cc:1199] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/59f5348c229744ab98f0de3da40de6c5
I20260505 20:13:51.713887 9271 ts_tablet_manager.cc:1950] T 59f5348c229744ab98f0de3da40de6c5 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.714741 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 206) took 12416 ms. Trace:
I20260505 20:13:51.714833 9271 rpcz_store.cc:276] 0505 20:13:39.298128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.298181 (+ 53us) service_pool.cc:224] Handling call
0505 20:13:51.705958 (+12407777us) ts_tablet_manager.cc:1151] Deleting tablet 59f5348c229744ab98f0de3da40de6c5
0505 20:13:51.705968 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.710458 (+ 4490us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.713397 (+ 2939us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.714722 (+ 1325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12407571}
I20260505 20:13:51.715158 9271 tablet_replica.cc:333] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.715454 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 59f5348c229744ab98f0de3da40de6c5 (table default.Table_225b81788b06457ba1ad9809609dc97d [id=00a791c32151416e9fc52631fd4966fe]) successfully deleted
I20260505 20:13:51.716089 9271 raft_consensus.cc:2243] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.716259 9271 raft_consensus.cc:2272] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.716660 7737 leader_election.cc:304] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.716782 9271 ts_tablet_manager.cc:1916] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.716886 9975 raft_consensus.cc:2804] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.716992 9975 raft_consensus.cc:697] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.717193 9975 consensus_queue.cc:237] T 9e217456754440cf90a1c5a642eb2627 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.723294 9271 ts_tablet_manager.cc:1929] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:51.723410 9271 log.cc:1199] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/6166653cbc58470c8ba4926048ba1384
I20260505 20:13:51.723798 9271 ts_tablet_manager.cc:1950] T 6166653cbc58470c8ba4926048ba1384 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.725363 8053 tablet_bootstrap.cc:492] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.725476 8053 ts_tablet_manager.cc:1403] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260505 20:13:51.726120 8053 raft_consensus.cc:359] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.726289 8053 raft_consensus.cc:385] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.726332 8053 raft_consensus.cc:740] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.726495 8053 consensus_queue.cc:260] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.726833 8053 ts_tablet_manager.cc:1434] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260505 20:13:51.727078 8053 tablet_bootstrap.cc:492] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.727988 9944 raft_consensus.cc:493] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.728106 9944 raft_consensus.cc:515] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.728470 8053 tablet_bootstrap.cc:654] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.728649 9944 leader_election.cc:290] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.730166 7737 leader_election.cc:304] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.730684 9894 raft_consensus.cc:2804] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:51.730782 9894 raft_consensus.cc:697] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:51.731491 9894 consensus_queue.cc:237] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.734462 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 208) took 12399 ms. Trace:
I20260505 20:13:51.734591 9271 rpcz_store.cc:276] 0505 20:13:39.334639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.334801 (+ 162us) service_pool.cc:224] Handling call
0505 20:13:51.715112 (+12380311us) ts_tablet_manager.cc:1151] Deleting tablet 6166653cbc58470c8ba4926048ba1384
0505 20:13:51.715122 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.720046 (+ 4924us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.723232 (+ 3186us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.734436 (+ 11204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5978,"tablet-delete.queue_time_us":12380070}
I20260505 20:13:51.734932 9271 tablet_replica.cc:333] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.735121 9271 raft_consensus.cc:2243] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.735273 9271 raft_consensus.cc:2272] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.735561 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]) successfully deleted
I20260505 20:13:51.735826 9271 ts_tablet_manager.cc:1916] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.705346 8058 tablet_bootstrap.cc:492] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:51.729359 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e116486fb4b34e88b564fbb46e8b0faf" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.739576 8058 ts_tablet_manager.cc:1403] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.196s user 0.040s sys 0.021s
W20260505 20:13:51.740015 7736 leader_election.cc:343] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.740424 8058 raft_consensus.cc:359] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.740597 8058 raft_consensus.cc:385] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.740653 8058 raft_consensus.cc:740] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.740882 8058 consensus_queue.cc:260] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.741353 8058 ts_tablet_manager.cc:1434] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:51.741617 8058 tablet_bootstrap.cc:492] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:51.743193 8058 tablet_bootstrap.cc:654] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.744560 9271 ts_tablet_manager.cc:1929] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:51.744673 9271 log.cc:1199] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/ca16deae2e4f4f9a9069822b57c5bc7f
I20260505 20:13:51.744964 9271 ts_tablet_manager.cc:1950] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.748283 8053 tablet_bootstrap.cc:492] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.748438 8053 ts_tablet_manager.cc:1403] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.005s
I20260505 20:13:51.749090 8058 tablet_bootstrap.cc:492] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:51.749221 8058 ts_tablet_manager.cc:1403] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260505 20:13:51.749132 8053 raft_consensus.cc:359] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.749290 8053 raft_consensus.cc:385] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.749356 8053 raft_consensus.cc:740] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.749557 8053 consensus_queue.cc:260] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.750072 8053 ts_tablet_manager.cc:1434] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:51.750346 8053 tablet_bootstrap.cc:492] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.752173 7737 leader_election.cc:304] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.752380 10276 raft_consensus.cc:493] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.752512 10276 raft_consensus.cc:515] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.752645 7737 leader_election.cc:304] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.752970 9894 raft_consensus.cc:2804] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.753043 9894 raft_consensus.cc:493] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.753103 9894 raft_consensus.cc:3060] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.753162 10306 raft_consensus.cc:2804] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.753242 10306 raft_consensus.cc:493] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.753319 10306 raft_consensus.cc:3060] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.753612 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff52f8570dd436c9de8c16b98aa660c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.756258 10306 raft_consensus.cc:515] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.756441 10276 leader_election.cc:290] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.756876 10306 leader_election.cc:290] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.757179 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0943621b2d14346ad79d1b7a74e4d47" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:51.757293 7737 leader_election.cc:304] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:51.757661 7736 leader_election.cc:343] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.757688 7737 leader_election.cc:304] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:51.757764 7870 leader_election.cc:343] T 9ff52f8570dd436c9de8c16b98aa660c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.758014 9948 raft_consensus.cc:2804] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.758081 9948 raft_consensus.cc:493] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.758137 9948 raft_consensus.cc:3060] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.758502 9944 raft_consensus.cc:2804] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.758572 9944 raft_consensus.cc:493] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.758631 9944 raft_consensus.cc:3060] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.760541 9948 raft_consensus.cc:515] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.761068 9948 leader_election.cc:290] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.761032 9944 raft_consensus.cc:515] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.761528 9944 leader_election.cc:290] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.761785 8053 tablet_bootstrap.cc:654] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.763909 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f71198bf544c11b7566a5864e2d43d" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.766630 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 209) took 12431 ms. Trace:
I20260505 20:13:51.766762 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6dc9ec93ddb406ab956389518a9a7b3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:51.766903 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81319ed5eed64dafb9b2a121661da9ea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
I20260505 20:13:51.766723 9271 rpcz_store.cc:276] 0505 20:13:39.334744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.334853 (+ 109us) service_pool.cc:224] Handling call
0505 20:13:51.734886 (+12400033us) ts_tablet_manager.cc:1151] Deleting tablet ca16deae2e4f4f9a9069822b57c5bc7f
0505 20:13:51.734897 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.739482 (+ 4585us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.744499 (+ 5017us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.766612 (+ 22113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12399822}
W20260505 20:13:51.767490 7736 leader_election.cc:343] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.767617 9271 tablet_replica.cc:333] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
W20260505 20:13:51.767695 7736 leader_election.cc:343] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.767808 9271 raft_consensus.cc:2243] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.767868 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet ca16deae2e4f4f9a9069822b57c5bc7f (table default.Table_b05a62cc3a7e446e915328413ead238d [id=13c456c402f444bc97f01c7428024341]) successfully deleted
I20260505 20:13:51.768014 9271 raft_consensus.cc:2272] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.768721 9271 ts_tablet_manager.cc:1916] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.768991 8053 tablet_bootstrap.cc:492] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.769119 8053 ts_tablet_manager.cc:1403] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20260505 20:13:51.769768 9121 ts_tablet_manager.cc:1929] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260505 20:13:51.769773 8053 raft_consensus.cc:359] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.769963 8053 raft_consensus.cc:385] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.770040 8053 raft_consensus.cc:740] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.770092 9121 log.cc:1199] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/6166653cbc58470c8ba4926048ba1384
I20260505 20:13:51.770234 8053 consensus_queue.cc:260] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.770871 9121 ts_tablet_manager.cc:1950] T 6166653cbc58470c8ba4926048ba1384 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:51.770877 8053 ts_tablet_manager.cc:1434] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:51.771116 8053 tablet_bootstrap.cc:492] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.771787 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 193) took 12410 ms. Trace:
W20260505 20:13:51.771938 10469 log.cc:927] Time spent T 578a9ebf768d4c73990fb2a28a9d4ccb P 974ed93a43c54ccbb58e60bfdae7c546: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260505 20:13:51.772790 8053 tablet_bootstrap.cc:654] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.773288 9121 rpcz_store.cc:276] 0505 20:13:39.360973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.361156 (+ 183us) service_pool.cc:224] Handling call
0505 20:13:51.419444 (+12058288us) ts_tablet_manager.cc:1151] Deleting tablet 6166653cbc58470c8ba4926048ba1384
0505 20:13:51.419454 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.424010 (+ 4556us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.768293 (+344283us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.771743 (+ 3450us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12057925}
I20260505 20:13:51.773787 9121 tablet_replica.cc:333] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:51.778333 8054 tablet_bootstrap.cc:654] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:51.779222 7869 leader_election.cc:343] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.779443 7869 leader_election.cc:304] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.779729 10337 raft_consensus.cc:2749] T 7382e748682547b1a41781ff05c6733d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260505 20:13:51.780228 7869 leader_election.cc:343] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.780421 7869 leader_election.cc:304] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.780725 10337 raft_consensus.cc:2749] T 55a3257f86264120b145263525d260a4 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.781227 10337 consensus_queue.cc:1048] T 799f3fc33c48436da61cc0cfbf0b0218 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:51.781980 7869 leader_election.cc:343] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.782310 7869 leader_election.cc:304] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.782742 10337 raft_consensus.cc:2749] T d8c4620970434e49b4fd3d21f309a48c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.783731 8053 tablet_bootstrap.cc:492] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.783757 7869 leader_election.cc:304] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.783869 8053 ts_tablet_manager.cc:1403] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s
I20260505 20:13:51.784097 10337 raft_consensus.cc:2749] T 28caca1a9a044701991ebda53cf75499 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.784503 8053 raft_consensus.cc:359] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.784657 8053 raft_consensus.cc:385] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.784610 10337 consensus_queue.cc:1048] T c689df9f8285487da25b32b6c02df003 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.784698 8053 raft_consensus.cc:740] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.784868 8053 consensus_queue.cc:260] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.785349 8053 ts_tablet_manager.cc:1434] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260505 20:13:51.785364 7869 leader_election.cc:343] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.785625 8053 tablet_bootstrap.cc:492] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.785595 7869 leader_election.cc:304] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.785938 10337 raft_consensus.cc:2749] T 616cd8f1a6124d2e89e170c5e1ff2385 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.787403 8053 tablet_bootstrap.cc:654] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.788269 9271 ts_tablet_manager.cc:1929] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.788378 9271 log.cc:1199] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/5b6326375bac48f0944eeeaa9b39682c
I20260505 20:13:51.788758 9271 ts_tablet_manager.cc:1950] T 5b6326375bac48f0944eeeaa9b39682c P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.789371 9948 raft_consensus.cc:493] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.789506 9948 raft_consensus.cc:515] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.789714 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 207) took 12455 ms. Trace:
I20260505 20:13:51.789824 9271 rpcz_store.cc:276] 0505 20:13:39.334486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.335082 (+ 596us) service_pool.cc:224] Handling call
0505 20:13:51.767564 (+12432482us) ts_tablet_manager.cc:1151] Deleting tablet 5b6326375bac48f0944eeeaa9b39682c
0505 20:13:51.767575 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.771771 (+ 4196us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.788204 (+ 16433us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.789694 (+ 1490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54,"tablet-delete.queue_time_us":12432345}
I20260505 20:13:51.790257 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 223) took 11461 ms. Trace:
I20260505 20:13:51.790339 9271 rpcz_store.cc:276] 0505 20:13:40.328842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.328889 (+ 47us) service_pool.cc:224] Handling call
0505 20:13:51.790123 (+11461234us) ts_tablet_manager.cc:1151] Deleting tablet 7f344c87342e4b34bb0fc4126f84c7c6
0505 20:13:51.790135 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.790242 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11461053}
I20260505 20:13:51.790680 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 224) took 11461 ms. Trace:
I20260505 20:13:51.790750 9271 rpcz_store.cc:276] 0505 20:13:40.329235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.329280 (+ 45us) service_pool.cc:224] Handling call
0505 20:13:51.790580 (+11461300us) ts_tablet_manager.cc:1151] Deleting tablet 848160f5d68542ab98d2cc21353ddc62
0505 20:13:51.790589 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.790664 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11461082}
I20260505 20:13:51.790995 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 225) took 11461 ms. Trace:
I20260505 20:13:51.790992 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 5b6326375bac48f0944eeeaa9b39682c (table default.Table_2329ffef76eb4466bffb67019f9ad8ca [id=474410be3ba244a5b6adeb2a730b4853]) successfully deleted
I20260505 20:13:51.791059 9271 rpcz_store.cc:276] 0505 20:13:40.329644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.329685 (+ 41us) service_pool.cc:224] Handling call
0505 20:13:51.790919 (+11461234us) ts_tablet_manager.cc:1151] Deleting tablet e295edfdcbfe489281dff1b86ab990f1
0505 20:13:51.790926 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.790985 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11461057}
I20260505 20:13:51.791330 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 226) took 11461 ms. Trace:
I20260505 20:13:51.791455 9948 leader_election.cc:290] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.791750 9271 rpcz_store.cc:276] 0505 20:13:40.330003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.330054 (+ 51us) service_pool.cc:224] Handling call
0505 20:13:51.791261 (+11461207us) ts_tablet_manager.cc:1151] Deleting tablet 7766caea43904162a2c289b7b17405d4
0505 20:13:51.791269 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.791317 (+ 48us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11461031}
I20260505 20:13:51.755781 9894 raft_consensus.cc:515] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.792253 9271 tablet_replica.cc:333] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
W20260505 20:13:51.792411 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 7f344c87342e4b34bb0fc4126f84c7c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f344c87342e4b34bb0fc4126f84c7c6 already in progress: creating tablet
I20260505 20:13:51.792465 9271 raft_consensus.cc:2243] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
W20260505 20:13:51.792646 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 848160f5d68542ab98d2cc21353ddc62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 848160f5d68542ab98d2cc21353ddc62 already in progress: creating tablet
I20260505 20:13:51.792766 9271 raft_consensus.cc:2272] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260505 20:13:51.792882 7397 catalog_manager.cc:4982] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet e295edfdcbfe489281dff1b86ab990f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e295edfdcbfe489281dff1b86ab990f1 already in progress: creating tablet
W20260505 20:13:51.793119 7397 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 7766caea43904162a2c289b7b17405d4 because the tablet was not found. No further retry: Not found: Tablet not found: 7766caea43904162a2c289b7b17405d4
I20260505 20:13:51.793288 9271 ts_tablet_manager.cc:1916] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.793598 9894 leader_election.cc:290] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.794247 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc695d3e3f941bbbe0d208c9f3572ee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.794270 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b143e4943343d5b151f2804cccecfb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.794898 7736 leader_election.cc:343] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:51.795172 7736 leader_election.cc:343] T 26b143e4943343d5b151f2804cccecfb P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:51.796402 7736 consensus_peers.cc:597] T f4d78ebf153640e4b2f518fb215f1bf1 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4d78ebf153640e4b2f518fb215f1bf1. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.796974 8053 tablet_bootstrap.cc:492] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.797092 8053 ts_tablet_manager.cc:1403] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260505 20:13:51.797802 8053 raft_consensus.cc:359] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.797955 8053 raft_consensus.cc:385] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.798007 8053 raft_consensus.cc:740] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.798292 8053 consensus_queue.cc:260] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.798777 8053 ts_tablet_manager.cc:1434] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260505 20:13:51.799022 8053 tablet_bootstrap.cc:492] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.800706 8053 tablet_bootstrap.cc:654] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.802754 9271 ts_tablet_manager.cc:1929] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.802860 9271 log.cc:1199] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/f0ca8cc557674992b88f3379cc1db652
I20260505 20:13:51.803251 9271 ts_tablet_manager.cc:1950] T f0ca8cc557674992b88f3379cc1db652 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:51.806532 9121 raft_consensus.cc:2243] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:51.807377 9121 raft_consensus.cc:2272] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.808109 9121 ts_tablet_manager.cc:1916] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.809394 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 227) took 11479 ms. Trace:
I20260505 20:13:51.809530 9271 rpcz_store.cc:276] 0505 20:13:40.330352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.330389 (+ 37us) service_pool.cc:224] Handling call
0505 20:13:51.791989 (+11461600us) ts_tablet_manager.cc:1151] Deleting tablet f0ca8cc557674992b88f3379cc1db652
0505 20:13:51.792208 (+ 219us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.799698 (+ 7490us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.802707 (+ 3009us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.809372 (+ 6665us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11461439}
I20260505 20:13:51.810104 9271 tablet_replica.cc:333] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.810340 9271 raft_consensus.cc:2243] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.810524 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet f0ca8cc557674992b88f3379cc1db652 (table default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]) successfully deleted
I20260505 20:13:51.810792 9271 raft_consensus.cc:2272] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.811497 9271 ts_tablet_manager.cc:1916] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.812963 8058 raft_consensus.cc:359] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.813156 8058 raft_consensus.cc:385] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.813226 8058 raft_consensus.cc:740] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.820053 8058 consensus_queue.cc:260] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.820603 8058 ts_tablet_manager.cc:1434] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.071s user 0.001s sys 0.000s
I20260505 20:13:51.824048 9271 ts_tablet_manager.cc:1929] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.827513 9271 log.cc:1199] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/944eaa335fcf49be975baee21c715642
I20260505 20:13:51.830137 9271 ts_tablet_manager.cc:1950] T 944eaa335fcf49be975baee21c715642 P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
W20260505 20:13:51.836229 7598 consensus_peers.cc:597] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b6326375bac48f0944eeeaa9b39682c. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.839066 8058 tablet_bootstrap.cc:492] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:51.839275 9495 raft_consensus.cc:493] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:51.839399 9495 raft_consensus.cc:515] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.839982 9495 leader_election.cc:290] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:51.840608 7596 leader_election.cc:343] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 096ca710e3564d4b8db50f29dd56a5d4
W20260505 20:13:51.841264 7598 leader_election.cc:343] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:51.841363 7598 leader_election.cc:304] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:51.841780 9704 raft_consensus.cc:2749] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:51.842648 8058 tablet_bootstrap.cc:654] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.844219 8053 tablet_bootstrap.cc:492] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.844354 8053 ts_tablet_manager.cc:1403] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.018s
I20260505 20:13:51.845049 8053 raft_consensus.cc:359] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.845225 8053 raft_consensus.cc:385] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.845280 8053 raft_consensus.cc:740] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.845492 8053 consensus_queue.cc:260] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.845990 8053 ts_tablet_manager.cc:1434] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260505 20:13:51.847637 7869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 61330.9us
W20260505 20:13:51.847985 7869 leader_election.cc:343] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.848292 7869 leader_election.cc:304] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546; no voters: c59c731e012f4f9fbfd7151790b9a5bb, cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.850103 10337 raft_consensus.cc:2749] T 64f71198bf544c11b7566a5864e2d43d P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:51.854254 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a5fcaee384c440bcb3307cba455e2ffa (table default.Table_d230cae490dd484187dccd1014a710f5 [id=2b4a4163adc847139f13c1221f58d86a]). Expected version 1 got 0
I20260505 20:13:51.854480 7737 leader_election.cc:304] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.854724 9894 raft_consensus.cc:2804] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.854805 9894 raft_consensus.cc:493] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.854862 9894 raft_consensus.cc:3060] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.854820 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 010c399e14624550bf02ea248d653538 (table default.Table_b2504b0b75a543b38871f8112aad5cf1 [id=15b05f0bcd1b404b96dd77363daecb84]). Expected version 3 got 0
I20260505 20:13:51.855196 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a25cb36420534396a0850aef61706ae1 (table default.Table_5fb8878551e44d388cc76ea4d43d13e9 [id=9a219602b64942a8af58f84cf59a5cdb]). Expected version 1 got 0
I20260505 20:13:51.855517 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 997f2f9cf76a4311ab233cb7d8bc8e3c (table default.Table_8e0d06e5e3a94117911e112f93d23c32 [id=36e21ce35e2d4f7f9e41ad963dc7fbd8]). Expected version 1 got 0
I20260505 20:13:51.855850 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 051c258c37544e639000578b1b017abb (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]). Expected version 1 got 0
I20260505 20:13:51.855816 10337 raft_consensus.cc:493] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.856030 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d49e4bb0c885499cbe30f86e15f12989 (table default.Table_ab36587e41634b89bc812f829f573ddf [id=48be793440d142f287ca28d23b4f996a]). Expected version 2 got 0
I20260505 20:13:51.856040 10337 raft_consensus.cc:515] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.856599 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 335acbbc84624d61b779a422f29919fa (table default.Table_0432c9aaef794e18aacbe94ea9a7ff5c [id=f81d5f61b838445e8d76768331ddb175]). Expected version 1 got 0
I20260505 20:13:51.857198 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet ab52fb4e7c73420fa58cb6da23372adc (table default.Table_ab61868a8dcf4a8ea31488afb5c5f401 [id=49136339e3bb4afda5cdcc665309b087]). Expected version 1 got 0
I20260505 20:13:51.857450 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b78fbe740a4478a5638bea70268125" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.857568 9894 raft_consensus.cc:515] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
W20260505 20:13:51.858173 7870 leader_election.cc:343] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.858453 9894 leader_election.cc:290] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.858388 10337 leader_election.cc:290] T 82b78fbe740a4478a5638bea70268125 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.860153 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaade50115e4ea69db6e50443cfea0e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.860989 7736 leader_election.cc:343] T dbaade50115e4ea69db6e50443cfea0e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.862852 8058 tablet_bootstrap.cc:492] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:51.862986 8058 ts_tablet_manager.cc:1403] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260505 20:13:51.863621 8058 raft_consensus.cc:359] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.863782 8058 raft_consensus.cc:385] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.863835 8058 raft_consensus.cc:740] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.864308 8058 consensus_queue.cc:260] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.864885 8058 ts_tablet_manager.cc:1434] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:51.866672 9894 raft_consensus.cc:493] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.866842 9894 raft_consensus.cc:515] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.867889 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1315273f76db4405bb2c82a8164bc325" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.868400 7736 leader_election.cc:343] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.868855 9894 leader_election.cc:290] T 1315273f76db4405bb2c82a8164bc325 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.869849 8054 tablet_bootstrap.cc:492] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.870069 8054 ts_tablet_manager.cc:1403] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.169s user 0.004s sys 0.000s
I20260505 20:13:51.870855 8054 raft_consensus.cc:359] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.871119 8054 raft_consensus.cc:385] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.871233 8054 raft_consensus.cc:740] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.871517 8054 consensus_queue.cc:260] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.872175 8054 ts_tablet_manager.cc:1434] T 74d5ef7ac5f44d1c9c77e2e50ab2ea5e P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:51.872502 7737 leader_election.cc:304] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.872917 9894 raft_consensus.cc:2804] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.873023 9894 raft_consensus.cc:493] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.873138 9894 raft_consensus.cc:3060] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.877033 8054 tablet_bootstrap.cc:492] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.880662 8054 tablet_bootstrap.cc:654] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.881692 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet c398f3abe1a5439195a23dd655843720 (table default.Table_4e8ba9e1b7b9468aa1f333bb0e64198d [id=e63a0d697e7f4e53adf694d76f0a008a]). Expected version 1 got 0
W20260505 20:13:51.882704 7598 consensus_peers.cc:597] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5dfabb36fa5499780b0d15c71404307. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.876749 9894 raft_consensus.cc:515] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.883781 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93512b85b764438aeb7bca9fe339442" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.884277 7736 leader_election.cc:343] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.884732 9894 leader_election.cc:290] T c93512b85b764438aeb7bca9fe339442 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.822089 9270 ts_tablet_manager.cc:1929] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:51.886543 9270 log.cc:1199] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/cdda1cc266cd47c993b5d1a0a78c7df9
I20260505 20:13:51.887003 9270 ts_tablet_manager.cc:1950] T cdda1cc266cd47c993b5d1a0a78c7df9 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:51.887538 7737 leader_election.cc:304] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.888105 7737 leader_election.cc:304] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
W20260505 20:13:51.888278 7737 raft_consensus.cc:2686] T ca16deae2e4f4f9a9069822b57c5bc7f P c59c731e012f4f9fbfd7151790b9a5bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260505 20:13:51.889036 7737 leader_election.cc:304] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.889266 10306 raft_consensus.cc:2804] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.889333 10306 raft_consensus.cc:493] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.889400 10306 raft_consensus.cc:3060] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.889678 7737 leader_election.cc:304] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:51.890409 7793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff52f8570dd436c9de8c16b98aa660c" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:51.891955 10306 raft_consensus.cc:515] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.892379 9948 raft_consensus.cc:2804] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.892467 9948 raft_consensus.cc:493] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.892529 9948 raft_consensus.cc:3060] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.892551 10306 leader_election.cc:290] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.892697 10306 raft_consensus.cc:2804] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:51.892750 10306 raft_consensus.cc:493] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:51.892814 10306 raft_consensus.cc:3060] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.893150 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54b7c83e66c473db8470e5c4c4decab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.893599 7736 leader_election.cc:343] T f54b7c83e66c473db8470e5c4c4decab P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.895073 9948 raft_consensus.cc:515] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.895654 9948 leader_election.cc:290] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.896118 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97a8c35af23454a9cf63193f763381e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.896651 7736 leader_election.cc:343] T a97a8c35af23454a9cf63193f763381e P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.897778 10306 raft_consensus.cc:515] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.898468 10306 leader_election.cc:290] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.898716 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a96ed0d53064aa480d93420c6b41bc2" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9"
W20260505 20:13:51.899168 7736 leader_election.cc:343] T 3a96ed0d53064aa480d93420c6b41bc2 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.892580 7399 catalog_manager.cc:5002] TS 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): tablet 6166653cbc58470c8ba4926048ba1384 (table default.Table_a8cef891e16545e2839c4d00a91de994 [id=5dea091296724ac28a69478051119890]) successfully deleted
I20260505 20:13:51.901623 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e2c99f02ea514a2581f0697dc3ef6461 (table default.Table_dbca8d5382b04c119856038b4a11f047 [id=1d5de4af363848f8b609c10fbebd975a]). Expected version 1 got 0
I20260505 20:13:51.901968 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 3a96ed0d53064aa480d93420c6b41bc2 (table default.Table_dd9c3e8b30b640158efe23f97a264373 [id=68a78a47955345e5832fbef128cbe20e]). Expected version 1 got 0
I20260505 20:13:51.902465 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8da300a3c6a743829936ecbfcd9439b5 (table default.Table_96790cf9e7a04a219203c4bbefd569b4 [id=573a8468a590436f90382cb8cccbfc67]). Expected version 1 got 0
I20260505 20:13:51.902720 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 95c591e3f33d4606be7181e380fadcf6 (table default.Table_894ee5b4e56442d3b7a1cbd3ffd8acfc [id=73e0bdfe9dc54036b928ccd1804f6ccb]). Expected version 1 got 0
I20260505 20:13:51.903191 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet a694c65f90f4499ab96e45fbbaa9e892 (table default.Table_73a05203cc244d53b4fdb4628f087d00 [id=a0fabcaa463f404cb5ed63d85fa82e6e]). Expected version 3 got 0
I20260505 20:13:51.903367 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 616cd8f1a6124d2e89e170c5e1ff2385 (table default.Table_c78f870417f04deb8a5bd52ab26ba784 [id=42e490450ed34cac8cab5430f0df45b9]). Expected version 1 got 0
I20260505 20:13:51.903664 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 68718abc133e452495567232e51fb55b (table default.Table_89d3067a6f7a4267948a7c6c40726e8e [id=cae3b5584bf84c9685dc2f8bca8d2c69]). Expected version 1 got 0
I20260505 20:13:51.903916 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet d8c4620970434e49b4fd3d21f309a48c (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]). Expected version 1 got 0
I20260505 20:13:51.909868 8053 tablet_bootstrap.cc:492] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
W20260505 20:13:51.913168 7598 consensus_peers.cc:597] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e32ff17c39f04bc2b1c9c37a1165399b. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:51.916217 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 06ad0e52c8b346cd920b35701fb23328 (table default.Table_a41cab9b68a142c9b7665c88d0d0ca7d [id=0c2a5400bd6e4ace87172b06b922cec3]). Expected version 1 got 0
I20260505 20:13:51.916479 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 907b7dccd7a94115aca36915a558b103 (table default.Table_c4f910d5074640b49ae08dc7c5966877 [id=8f922183d9054257a9e0cb61880d57cf]). Expected version 2 got 0
I20260505 20:13:51.916780 7410 catalog_manager.cc:5671] T 578a9ebf768d4c73990fb2a28a9d4ccb P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.917447 9948 raft_consensus.cc:493] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.917527 8053 tablet_bootstrap.cc:654] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.917650 9948 raft_consensus.cc:515] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.917773 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 228) took 11587 ms. Trace:
I20260505 20:13:51.917923 9271 rpcz_store.cc:276] 0505 20:13:40.330670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.330711 (+ 41us) service_pool.cc:224] Handling call
0505 20:13:51.810043 (+11479332us) ts_tablet_manager.cc:1151] Deleting tablet 944eaa335fcf49be975baee21c715642
0505 20:13:51.810056 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.819954 (+ 9898us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.823979 (+ 4025us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.917735 (+ 93756us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11479135}
I20260505 20:13:51.918242 9271 tablet_replica.cc:333] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:51.918421 9271 raft_consensus.cc:2243] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:51.918718 9271 raft_consensus.cc:2272] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:51.919219 9271 ts_tablet_manager.cc:1916] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:51.922057 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 944eaa335fcf49be975baee21c715642 (table default.Table_1954f3a3b7034c16b51824755e5e357f [id=20fc114e5acb483c98a375c3eacc59e9]) successfully deleted
I20260505 20:13:51.922958 8054 tablet_bootstrap.cc:492] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:51.923008 9948 leader_election.cc:290] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.923249 8054 ts_tablet_manager.cc:1403] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20260505 20:13:51.923573 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf3775c154742c5804daf8ade2ad854" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.924054 7736 leader_election.cc:343] T faf3775c154742c5804daf8ade2ad854 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.924121 8054 raft_consensus.cc:359] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.924574 8054 raft_consensus.cc:385] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.924727 8054 raft_consensus.cc:740] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.925110 7663 raft_consensus.cc:3060] T 76178d1c329b4bf59fe3955f2893cd39 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.926800 8054 consensus_queue.cc:260] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.927426 8054 ts_tablet_manager.cc:1434] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260505 20:13:51.927762 8054 tablet_bootstrap.cc:492] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:51.928608 8053 tablet_bootstrap.cc:492] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:51.928727 8053 ts_tablet_manager.cc:1403] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.000s
I20260505 20:13:51.929087 10276 consensus_queue.cc:1048] T 76178d1c329b4bf59fe3955f2893cd39 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.929096 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 578a9ebf768d4c73990fb2a28a9d4ccb (table default.Table_1cdb392893914c328c22a672aa564e6c [id=267a96cb67ed4025aff2c3d34f233da1]). Expected version 2 got 0
I20260505 20:13:51.929406 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 0cb3d246d6b443b8933648fe4f4aa5c2 (table default.Table_f2d015cb493f4183a7d05923517efc02 [id=c9231e82f5154f8ba2a1051de93491dc]). Expected version 1 got 0
I20260505 20:13:51.929436 8053 raft_consensus.cc:359] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.929602 8053 raft_consensus.cc:385] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:51.929654 8053 raft_consensus.cc:740] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:51.929708 8054 tablet_bootstrap.cc:654] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.929860 8053 consensus_queue.cc:260] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.929951 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 1205ac0117464cff99a742ac112a2178 (table default.Table_478f5ae54e9e41f0987ddb6bd06ca657 [id=f6b57ed30eb544e194c52687afdc0a8a]). Expected version 1 got 0
I20260505 20:13:51.930348 8053 ts_tablet_manager.cc:1434] T a114db19f63346d9a67e9e3a8225caa4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:51.930627 8053 tablet_bootstrap.cc:492] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:51.930601 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 9e6c46a2b6fe4edf857b2a4570dbee7c (table default.Table_859d395c7b674d92b89e3f922f7b8db5 [id=801a4657329f44c7900ab019555c1af8]). Expected version 1 got 0
I20260505 20:13:51.931022 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ff674539e1045408c212b533ca8a3db (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0]). Expected version 1 got 0
I20260505 20:13:51.931596 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 369f4a55fdd64e4bb907666bede9f241 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]). Expected version 6 got 0
I20260505 20:13:51.932348 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 76178d1c329b4bf59fe3955f2893cd39 (table default.Table_3c21552826bd4c568e9dcf7fb6a7a7e3 [id=8a90ca18bf294706a81e213ac3a7e450]). Expected version 1 got 0
I20260505 20:13:51.932519 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 6c20374c4df742799110a12f3fea5daa (table default.Table_845141420b9849e2ad45bce8bf2b9ddc [id=f767d2b232d84c08b169b41a1c443199]). Expected version 3 got 0
I20260505 20:13:51.932622 10418 raft_consensus.cc:493] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.932772 10418 raft_consensus.cc:515] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:51.932716 7410 catalog_manager.cc:5671] T e1e4b516283f441bb77f038816afa4ed P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.933091 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet e1e4b516283f441bb77f038816afa4ed (table default.Table_d060494d3ac54935b43caaa840049305 [id=a89cd6133fe5494cbf2d3520bc8c744a]). Expected version 1 got 0
I20260505 20:13:51.933732 10418 leader_election.cc:290] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:51.935010 8053 tablet_bootstrap.cc:654] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:51.935707 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb672b1dfe7e4ed6ab9e73d328349238" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.936417 7870 leader_election.cc:343] T cb672b1dfe7e4ed6ab9e73d328349238 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.939424 7660 raft_consensus.cc:3060] T 8ca1fb1425e347d191f3c5931d9bf224 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.944929 10276 consensus_queue.cc:1048] T 8ca1fb1425e347d191f3c5931d9bf224 P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.949930 7410 catalog_manager.cc:5671] T 01ed3ee8c7a048979f5c620bc21f5b96 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.950593 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 01ed3ee8c7a048979f5c620bc21f5b96 (table default.Table_c1e4ac7ed1ca4ac993a5dc8815dc5775 [id=67accc85180f48418217cf187d1fee88]). Expected version 1 got 0
I20260505 20:13:51.950979 7410 catalog_manager.cc:5671] T bc112545c3eb4e0189cb1ea45edd4fd0 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.951458 7785 raft_consensus.cc:1275] T e32ff17c39f04bc2b1c9c37a1165399b P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Refusing update from remote peer cab133462c2f46309dc8f0792122bad9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260505 20:13:51.951592 7410 catalog_manager.cc:5671] T 6d1fa4131acf4d23ad35aaae5ebfa5ca P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.952509 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 8ca1fb1425e347d191f3c5931d9bf224 (table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]). Expected version 1 got 0
I20260505 20:13:51.955745 7410 catalog_manager.cc:5671] T 4860b4f80ef34a799fa9f9607aac844a P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.956429 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 86c9aaca827442cc8cc605f56c222860 (table default.Table_a6dcb45454814d749d55a423415118b2 [id=d030dcbee7ac4ba5b1317a173ba9ad48]). Expected version 1 got 0
I20260505 20:13:51.957199 7410 catalog_manager.cc:5671] T 753536034d2647ef90ee3cf280b13855 P c59c731e012f4f9fbfd7151790b9a5bb reported cstate change: term changed from 0 to 1, leader changed from <none> to c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194). New cstate: current_term: 1 leader_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20260505 20:13:51.957422 9704 consensus_queue.cc:1048] T e32ff17c39f04bc2b1c9c37a1165399b P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:51.958405 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet f54b7c83e66c473db8470e5c4c4decab (table default.Table_8f0bb844a18341278a0bc6b469a01b87 [id=698b1130292f4bf985a8b746cbd5013f]). Expected version 1 got 0
I20260505 20:13:51.958654 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 947a4d496d994b799d1688cc258a181d (table default.Table_62ee92145c3c4d44950043e4f19c5b15 [id=3734c4511d224584aeed0efd6bac453d]). Expected version 2 got 1
I20260505 20:13:51.959060 7410 catalog_manager.cc:5763] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991) does not have the latest schema for tablet 7e9bd035b077474294d274a8f8cb38fd (table default.Table_a91e1a8b17584952ba88c0b5b69ef059 [id=b11d0432d00747cba7ee33cdf0d4881c]). Expected version 1 got 0
I20260505 20:13:51.960551 7663 raft_consensus.cc:3060] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:51.978255 10428 consensus_queue.cc:1048] T f5dfabb36fa5499780b0d15c71404307 P cab133462c2f46309dc8f0792122bad9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260505 20:13:51.980106 7850 tablet.cc:2404] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:51.987442 9948 raft_consensus.cc:493] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.987721 9948 raft_consensus.cc:515] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.988844 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c591e3f33d4606be7181e380fadcf6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:51.988910 9948 leader_election.cc:290] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:51.989369 7736 leader_election.cc:343] T 95c591e3f33d4606be7181e380fadcf6 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:51.995324 10306 raft_consensus.cc:493] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:51.995862 10306 raft_consensus.cc:515] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:51.996999 10306 leader_election.cc:290] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:51.998392 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c20374c4df742799110a12f3fea5daa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:51.998939 7736 leader_election.cc:343] T 6c20374c4df742799110a12f3fea5daa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.006001 10428 raft_consensus.cc:493] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:52.006191 10428 raft_consensus.cc:515] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.006800 10428 leader_election.cc:290] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:52.007858 7598 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:52.015697 9948 raft_consensus.cc:493] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260505 20:13:52.016541 7596 leader_election.cc:343] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 50c1f63c849c48438abdaa965ab051f9
I20260505 20:13:52.016752 7596 leader_election.cc:304] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:52.017025 10281 raft_consensus.cc:2749] T 50c1f63c849c48438abdaa965ab051f9 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260505 20:13:52.017850 9948 raft_consensus.cc:515] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.019170 7657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1425e08c7c342e3bc05074645969b2c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:52.019799 7736 leader_election.cc:343] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.020287 9948 leader_election.cc:290] T f1425e08c7c342e3bc05074645969b2c P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:52.021178 7598 consensus_peers.cc:597] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 -> Peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Couldn't send request to peer 974ed93a43c54ccbb58e60bfdae7c546. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 359ab1033ccf4445862867f3f8b78ecd. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.024345 9271 ts_tablet_manager.cc:1929] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.024466 9271 log.cc:1199] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/feef367085954816b312d4f1cdd80b1d
I20260505 20:13:52.024822 9271 ts_tablet_manager.cc:1950] T feef367085954816b312d4f1cdd80b1d P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:52.028244 7632 tablet_service.cc:1511] Processing CreateTablet for tablet 79312333ae3341e9b627c103149a9362 (DEFAULT_TABLE table=default.Table_4db86ed9bd224a92a89c7caad14928f2 [id=6d4b4bd85db04abcb43a1c9c85beb95b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.032996 9704 raft_consensus.cc:493] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.033205 9704 raft_consensus.cc:515] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.034102 9704 leader_election.cc:290] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.035867 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.036085 7930 raft_consensus.cc:2468] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cab133462c2f46309dc8f0792122bad9 in term 1.
I20260505 20:13:52.036695 7598 leader_election.cc:304] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, cab133462c2f46309dc8f0792122bad9; no voters:
I20260505 20:13:52.037122 9495 raft_consensus.cc:2804] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260505 20:13:52.037195 9495 raft_consensus.cc:493] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:52.037250 9495 raft_consensus.cc:3060] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:52.040354 9495 raft_consensus.cc:515] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.041649 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 7ccc996623e64445a051745f5f85b853 (DEFAULT_TABLE table=default.Table_3cb536c7aee840079709caef1337d17e [id=d301a192b78f4eeb909f9d2f3eeb6722]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.041941 9495 leader_election.cc:290] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 election: Requested vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.041894 7771 tablet_service.cc:1511] Processing CreateTablet for tablet 79312333ae3341e9b627c103149a9362 (DEFAULT_TABLE table=default.Table_4db86ed9bd224a92a89c7caad14928f2 [id=6d4b4bd85db04abcb43a1c9c85beb95b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.043282 7930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.043337 7766 tablet_service.cc:1511] Processing CreateTablet for tablet 7ccc996623e64445a051745f5f85b853 (DEFAULT_TABLE table=default.Table_3cb536c7aee840079709caef1337d17e [id=d301a192b78f4eeb909f9d2f3eeb6722]), partition=RANGE (key) PARTITION UNBOUNDED
W20260505 20:13:52.049595 7712 tablet.cc:2404] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260505 20:13:52.056313 7635 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf782e1fc72462aa195a4a16eab12cf (DEFAULT_TABLE table=default.Table_07c3fedf259d4cb78e5ea08bd6799bb9 [id=f6085b02be1a42c7bff77214253119c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.057688 7780 tablet_service.cc:1511] Processing CreateTablet for tablet 3bf782e1fc72462aa195a4a16eab12cf (DEFAULT_TABLE table=default.Table_07c3fedf259d4cb78e5ea08bd6799bb9 [id=f6085b02be1a42c7bff77214253119c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.059401 7638 tablet_service.cc:1511] Processing CreateTablet for tablet b9d3b5ff1027458996dd4ad4c8481e2a (DEFAULT_TABLE table=default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.061020 7775 tablet_service.cc:1511] Processing CreateTablet for tablet b9d3b5ff1027458996dd4ad4c8481e2a (DEFAULT_TABLE table=default.Table_848180169f224c6b9abf96c5088933ea [id=72b09d089796457380f9b002112c830e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.062417 7627 tablet_service.cc:1511] Processing CreateTablet for tablet a58c1a1184a942f7b3859ea519aaa293 (DEFAULT_TABLE table=default.Table_e8c1347ffa404d0c8b75f2aed583716a [id=5447afbc5a024e4493140b107ab39d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.063736 7776 tablet_service.cc:1511] Processing CreateTablet for tablet a58c1a1184a942f7b3859ea519aaa293 (DEFAULT_TABLE table=default.Table_e8c1347ffa404d0c8b75f2aed583716a [id=5447afbc5a024e4493140b107ab39d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.063880 8058 tablet_bootstrap.cc:492] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:52.065379 8058 tablet_bootstrap.cc:654] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.070632 7632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79312333ae3341e9b627c103149a9362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.073968 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ccc996623e64445a051745f5f85b853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.077359 7635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf782e1fc72462aa195a4a16eab12cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.080864 7638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d3b5ff1027458996dd4ad4c8481e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.083127 10306 consensus_queue.cc:1048] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:52.084172 7659 raft_consensus.cc:1240] T 68718abc133e452495567232e51fb55b P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Rejecting Update request from peer c59c731e012f4f9fbfd7151790b9a5bb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260505 20:13:52.085105 10306 consensus_queue.cc:1059] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:52.085388 10306 raft_consensus.cc:3055] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Stepping down as leader of term 1
I20260505 20:13:52.085469 10306 raft_consensus.cc:740] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:52.085835 10306 consensus_queue.cc:260] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.086230 10306 raft_consensus.cc:3060] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:52.088872 7627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58c1a1184a942f7b3859ea519aaa293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.090291 7795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:52.090538 7795 raft_consensus.cc:2410] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260505 20:13:52.090574 7787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68718abc133e452495567232e51fb55b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb"
I20260505 20:13:52.090775 7787 raft_consensus.cc:2410] T 68718abc133e452495567232e51fb55b P c59c731e012f4f9fbfd7151790b9a5bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260505 20:13:52.091171 7771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79312333ae3341e9b627c103149a9362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.097427 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ccc996623e64445a051745f5f85b853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.097656 7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58c1a1184a942f7b3859ea519aaa293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.101853 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d3b5ff1027458996dd4ad4c8481e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.105868 7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf782e1fc72462aa195a4a16eab12cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.109721 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 157) took 14681 ms. Trace:
I20260505 20:13:52.109864 9270 rpcz_store.cc:276] 0505 20:13:37.428300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.428342 (+ 42us) service_pool.cc:224] Handling call
0505 20:13:51.673043 (+14244701us) ts_tablet_manager.cc:1151] Deleting tablet cdda1cc266cd47c993b5d1a0a78c7df9
0505 20:13:51.673054 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.818740 (+145686us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:51.822037 (+ 3297us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.109695 (+287658us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14244550}
I20260505 20:13:52.112702 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet cdda1cc266cd47c993b5d1a0a78c7df9 (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:52.112836 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 229) took 11781 ms. Trace:
I20260505 20:13:52.112931 9271 rpcz_store.cc:276] 0505 20:13:40.331038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.331078 (+ 40us) service_pool.cc:224] Handling call
0505 20:13:51.918196 (+11587118us) ts_tablet_manager.cc:1151] Deleting tablet feef367085954816b312d4f1cdd80b1d
0505 20:13:51.918206 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.948032 (+ 29826us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.024278 (+ 76246us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.112815 (+ 88537us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11586956}
I20260505 20:13:52.113370 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet feef367085954816b312d4f1cdd80b1d (table default.Table_e9e7a12e4d6f4298b0eb12cb31fbf72e [id=bb29d0a7cf114a8296a5af3e56dddf0c]) successfully deleted
I20260505 20:13:52.113760 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 230) took 11751 ms. Trace:
I20260505 20:13:52.113864 9271 rpcz_store.cc:276] 0505 20:13:40.362411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.362745 (+ 334us) service_pool.cc:224] Handling call
0505 20:13:52.113641 (+11750896us) ts_tablet_manager.cc:1151] Deleting tablet 79ce82aca20d44819f28785322e935ae
0505 20:13:52.113653 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.113721 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11750465}
W20260505 20:13:52.114327 7397 catalog_manager.cc:4969] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): delete failed for tablet 79ce82aca20d44819f28785322e935ae because the tablet was not found. No further retry: Not found: Tablet not found: 79ce82aca20d44819f28785322e935ae
I20260505 20:13:52.115259 9271 tablet_replica.cc:333] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: stopping tablet replica
I20260505 20:13:52.115471 9270 tablet_replica.cc:333] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.115526 9271 raft_consensus.cc:2243] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.115694 9271 raft_consensus.cc:2272] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.116230 9270 raft_consensus.cc:2243] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.117439 9270 pending_rounds.cc:70] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:52.118379 9270 pending_rounds.cc:77] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7282737272654004224 op_type: NO_OP noop_request { }
I20260505 20:13:52.119199 9270 raft_consensus.cc:2889] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:52.119649 9270 raft_consensus.cc:2272] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.121467 8058 tablet_bootstrap.cc:492] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:52.121646 8058 ts_tablet_manager.cc:1403] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.001s
I20260505 20:13:52.122797 8058 raft_consensus.cc:359] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.123052 8058 raft_consensus.cc:385] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.123358 8058 raft_consensus.cc:740] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.123602 8058 consensus_queue.cc:260] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.124092 8058 ts_tablet_manager.cc:1434] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:52.124378 8058 tablet_bootstrap.cc:492] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:52.125919 8058 tablet_bootstrap.cc:654] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.126072 9270 ts_tablet_manager.cc:1916] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.127236 7642 tablet_service.cc:1511] Processing CreateTablet for tablet 730d5b70ffaa420f8b69bea68172e7ab (DEFAULT_TABLE table=default.Table_e93051733d2d4ef6aa1fb89a96110372 [id=794ebe252f2e4c748b5ea330de57525b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.128407 7642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730d5b70ffaa420f8b69bea68172e7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.135878 10428 raft_consensus.cc:493] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c59c731e012f4f9fbfd7151790b9a5bb)
I20260505 20:13:52.136113 10428 raft_consensus.cc:515] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.136780 10428 leader_election.cc:290] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:52.139181 7598 leader_election.cc:343] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859): Not found: Tablet not found: 608bffbbc10141e8bd19f475b95bdc65
I20260505 20:13:52.140544 7775 tablet_service.cc:1511] Processing CreateTablet for tablet 730d5b70ffaa420f8b69bea68172e7ab (DEFAULT_TABLE table=default.Table_e93051733d2d4ef6aa1fb89a96110372 [id=794ebe252f2e4c748b5ea330de57525b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260505 20:13:52.140955 7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730d5b70ffaa420f8b69bea68172e7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260505 20:13:52.141153 8058 tablet_bootstrap.cc:492] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:52.141273 8058 ts_tablet_manager.cc:1403] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.002s
W20260505 20:13:52.141299 7736 consensus_peers.cc:597] T 05ec070a0196451c9564fa24b806516c P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.142017 8058 raft_consensus.cc:359] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.142197 8058 raft_consensus.cc:385] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.142243 8058 raft_consensus.cc:740] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.144351 9270 ts_tablet_manager.cc:1929] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.144452 9270 log.cc:1199] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/ae8bd19470294a1db91855afe49be6a5
I20260505 20:13:52.144824 9270 ts_tablet_manager.cc:1950] T ae8bd19470294a1db91855afe49be6a5 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.145576 8058 consensus_queue.cc:260] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.146700 8058 ts_tablet_manager.cc:1434] T 25fc9a6e1c824305869f6634192c5e78 P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260505 20:13:52.146996 8058 tablet_bootstrap.cc:492] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:52.147828 10276 consensus_queue.cc:1048] T 3ce500f525c748d999d591390dd6094b P 974ed93a43c54ccbb58e60bfdae7c546 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:52.148406 8058 tablet_bootstrap.cc:654] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
W20260505 20:13:52.150660 7596 leader_election.cc:343] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Not found: Tablet not found: 608bffbbc10141e8bd19f475b95bdc65
I20260505 20:13:52.153592 9121 ts_tablet_manager.cc:1929] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:52.157078 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 150) took 14731 ms. Trace:
I20260505 20:13:52.163080 7596 leader_election.cc:304] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:52.163125 9270 rpcz_store.cc:276] 0505 20:13:37.425532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.429703 (+ 4171us) service_pool.cc:224] Handling call
0505 20:13:52.114983 (+14685280us) ts_tablet_manager.cc:1151] Deleting tablet ae8bd19470294a1db91855afe49be6a5
0505 20:13:52.114997 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.141386 (+ 26389us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.144305 (+ 2919us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.157038 (+ 12733us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14684980}
I20260505 20:13:52.163483 10428 raft_consensus.cc:2749] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260505 20:13:52.163800 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet ae8bd19470294a1db91855afe49be6a5 (table default.Table_76da2dbee8874c39a6c5c0726eefda6b [id=eb1074459abe4155ba3931f91365bc9a]) successfully deleted
I20260505 20:13:52.164292 9270 tablet_replica.cc:333] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.164605 9270 raft_consensus.cc:2243] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.164868 9270 raft_consensus.cc:2272] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.165566 9270 ts_tablet_manager.cc:1916] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.170728 7659 raft_consensus.cc:3060] T 09bb5e21649a4cc39764a3847fa41c21 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.175997 9894 consensus_queue.cc:1048] T 09bb5e21649a4cc39764a3847fa41c21 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260505 20:13:52.187021 9270 ts_tablet_manager.cc:1929] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.188206 9270 log.cc:1199] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/608bffbbc10141e8bd19f475b95bdc65
I20260505 20:13:52.188791 9270 ts_tablet_manager.cc:1950] T 608bffbbc10141e8bd19f475b95bdc65 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.192157 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 159) took 14761 ms. Trace:
I20260505 20:13:52.192979 9270 rpcz_store.cc:276] 0505 20:13:37.430575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.430699 (+ 124us) service_pool.cc:224] Handling call
0505 20:13:52.164218 (+14733519us) ts_tablet_manager.cc:1151] Deleting tablet 608bffbbc10141e8bd19f475b95bdc65
0505 20:13:52.164238 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.172675 (+ 8437us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.186933 (+ 14258us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.192135 (+ 5202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14733369}
I20260505 20:13:52.193845 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 608bffbbc10141e8bd19f475b95bdc65 (table default.Table_1612c41337614a9c9edcd92892fd1c68 [id=79032ad4a3c549559bc0ec51b54172d5]) successfully deleted
I20260505 20:13:52.194278 9270 tablet_replica.cc:333] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.194664 9270 raft_consensus.cc:2243] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.200717 9270 raft_consensus.cc:2272] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.202061 9270 ts_tablet_manager.cc:1916] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.213266 9894 raft_consensus.cc:493] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.213431 9894 raft_consensus.cc:515] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.214205 9894 leader_election.cc:290] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
W20260505 20:13:52.216118 7596 consensus_peers.cc:597] T 359ab1033ccf4445862867f3f8b78ecd P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 359ab1033ccf4445862867f3f8b78ecd. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.224647 9271 ts_tablet_manager.cc:1916] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.230505 9270 ts_tablet_manager.cc:1929] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:52.230899 9270 log.cc:1199] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e98c0e648c98488e8c5509b296824bea
I20260505 20:13:52.231528 9270 ts_tablet_manager.cc:1950] T e98c0e648c98488e8c5509b296824bea P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.232386 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 160) took 14801 ms. Trace:
I20260505 20:13:52.233004 9270 rpcz_store.cc:276] 0505 20:13:37.430663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.430873 (+ 210us) service_pool.cc:224] Handling call
0505 20:13:52.194227 (+14763354us) ts_tablet_manager.cc:1151] Deleting tablet e98c0e648c98488e8c5509b296824bea
0505 20:13:52.194238 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.218713 (+ 24475us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.221710 (+ 2997us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.232364 (+ 10654us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14763235}
I20260505 20:13:52.234069 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e98c0e648c98488e8c5509b296824bea (table default.Table_2fea05446c6145fc9065f0db527efe94 [id=a812e64a033a470eaf1861fb213b4ceb]) successfully deleted
I20260505 20:13:52.234606 9270 tablet_replica.cc:333] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.235145 9270 raft_consensus.cc:2243] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.236366 9270 raft_consensus.cc:2272] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.237985 9270 ts_tablet_manager.cc:1916] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.219873 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd2235cec9d41f299d04398c097ae42" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:52.249614 7736 leader_election.cc:343] T ddd2235cec9d41f299d04398c097ae42 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.253710 9270 ts_tablet_manager.cc:1929] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.254215 9270 log.cc:1199] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/56bd0f4254424c979f90da0400e0ec70
I20260505 20:13:52.254813 9270 ts_tablet_manager.cc:1950] T 56bd0f4254424c979f90da0400e0ec70 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.255646 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 162) took 14824 ms. Trace:
I20260505 20:13:52.256194 9270 rpcz_store.cc:276] 0505 20:13:37.431517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.431702 (+ 185us) service_pool.cc:224] Handling call
0505 20:13:52.234554 (+14802852us) ts_tablet_manager.cc:1151] Deleting tablet 56bd0f4254424c979f90da0400e0ec70
0505 20:13:52.234566 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.244980 (+ 10414us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.253645 (+ 8665us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.255626 (+ 1981us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14802702}
I20260505 20:13:52.257079 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 56bd0f4254424c979f90da0400e0ec70 (table default.Table_cfe51d65e3714a898d30eb1ee2551e7d [id=f935045ccef64c1bbe5278ca4d4e715b]) successfully deleted
I20260505 20:13:52.257557 9270 tablet_replica.cc:333] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.258014 9270 raft_consensus.cc:2243] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.258731 9270 raft_consensus.cc:2272] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.259740 9270 ts_tablet_manager.cc:1916] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:52.293457 7596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.194:41991, user_credentials={real_user=slave}} blocked reactor thread for 61682.1us
I20260505 20:13:52.307716 9975 raft_consensus.cc:493] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.307868 9975 raft_consensus.cc:515] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.308437 9975 leader_election.cc:290] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.313606 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753489e300e743c48485cb5d3d19b8b9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:52.165957 7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e116486fb4b34e88b564fbb46e8b0faf" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.316918 7926 raft_consensus.cc:2468] T e116486fb4b34e88b564fbb46e8b0faf P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.167588 7931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0943621b2d14346ad79d1b7a74e4d47" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.317250 7931 raft_consensus.cc:3060] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.320009 7931 raft_consensus.cc:2468] T d0943621b2d14346ad79d1b7a74e4d47 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.168274 7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6dc9ec93ddb406ab956389518a9a7b3" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.320297 7922 raft_consensus.cc:3060] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.323382 7922 raft_consensus.cc:2468] T b6dc9ec93ddb406ab956389518a9a7b3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.168656 7933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81319ed5eed64dafb9b2a121661da9ea" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.323676 7933 raft_consensus.cc:3060] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.326185 7933 raft_consensus.cc:2468] T 81319ed5eed64dafb9b2a121661da9ea P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.227766 7934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc695d3e3f941bbbe0d208c9f3572ee" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.326808 7934 raft_consensus.cc:2468] T 8cc695d3e3f941bbbe0d208c9f3572ee P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.228399 7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b143e4943343d5b151f2804cccecfb" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.327294 7921 raft_consensus.cc:3060] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.228874 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbaade50115e4ea69db6e50443cfea0e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.329859 7928 raft_consensus.cc:3060] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.332450 7928 raft_consensus.cc:2468] T dbaade50115e4ea69db6e50443cfea0e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.229405 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1315273f76db4405bb2c82a8164bc325" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.332711 7936 raft_consensus.cc:2468] T 1315273f76db4405bb2c82a8164bc325 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.229477 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93512b85b764438aeb7bca9fe339442" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.332932 7924 raft_consensus.cc:3060] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.335285 7924 raft_consensus.cc:2468] T c93512b85b764438aeb7bca9fe339442 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.229895 7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54b7c83e66c473db8470e5c4c4decab" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.335522 7920 raft_consensus.cc:3060] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.229974 7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97a8c35af23454a9cf63193f763381e" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.337908 7923 raft_consensus.cc:3060] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.230108 7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a96ed0d53064aa480d93420c6b41bc2" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546"
I20260505 20:13:52.338248 7927 raft_consensus.cc:3060] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.339058 9975 raft_consensus.cc:493] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.339251 9975 raft_consensus.cc:515] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.340035 9975 leader_election.cc:290] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.341871 7920 raft_consensus.cc:2468] T f54b7c83e66c473db8470e5c4c4decab P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.345032 7923 raft_consensus.cc:2468] T a97a8c35af23454a9cf63193f763381e P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.348322 7927 raft_consensus.cc:2468] T 3a96ed0d53064aa480d93420c6b41bc2 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.350502 7921 raft_consensus.cc:2468] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 1.
I20260505 20:13:52.237341 10276 raft_consensus.cc:493] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.350944 10276 raft_consensus.cc:515] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.351842 10276 leader_election.cc:290] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:52.352361 10505 raft_consensus.cc:493] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.352483 10505 raft_consensus.cc:515] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.352958 10505 leader_election.cc:290] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:52.363536 9121 log.cc:1199] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/ca16deae2e4f4f9a9069822b57c5bc7f
I20260505 20:13:52.364032 9121 ts_tablet_manager.cc:1950] T ca16deae2e4f4f9a9069822b57c5bc7f P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:52.365208 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 194) took 13004 ms. Trace:
I20260505 20:13:52.365423 9121 rpcz_store.cc:276] 0505 20:13:39.361074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.361136 (+ 62us) service_pool.cc:224] Handling call
0505 20:13:51.773679 (+12412543us) ts_tablet_manager.cc:1151] Deleting tablet ca16deae2e4f4f9a9069822b57c5bc7f
0505 20:13:51.773688 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:51.816423 (+ 42735us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.153509 (+337086us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.365152 (+211643us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32408,"tablet-delete.queue_time_us":12412125}
I20260505 20:13:52.366158 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 207) took 12475 ms. Trace:
I20260505 20:13:52.366319 9121 rpcz_store.cc:276] 0505 20:13:39.890467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.890526 (+ 59us) service_pool.cc:224] Handling call
0505 20:13:52.365954 (+12475428us) ts_tablet_manager.cc:1151] Deleting tablet 7f344c87342e4b34bb0fc4126f84c7c6
0505 20:13:52.365968 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.366108 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12475197}
I20260505 20:13:52.366794 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 208) took 12467 ms. Trace:
I20260505 20:13:52.366966 9121 rpcz_store.cc:276] 0505 20:13:39.899273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.899324 (+ 51us) service_pool.cc:224] Handling call
0505 20:13:52.366656 (+12467332us) ts_tablet_manager.cc:1151] Deleting tablet 848160f5d68542ab98d2cc21353ddc62
0505 20:13:52.366667 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.366749 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12467094}
W20260505 20:13:52.367869 7736 leader_election.cc:343] T 753489e300e743c48485cb5d3d19b8b9 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.353156 9270 ts_tablet_manager.cc:1929] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.368805 9270 log.cc:1199] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/e083f131eca54d98852e5685e08ef46b
I20260505 20:13:52.369215 9270 ts_tablet_manager.cc:1950] T e083f131eca54d98852e5685e08ef46b P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.370023 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 163) took 14910 ms. Trace:
I20260505 20:13:52.370168 9270 rpcz_store.cc:276] 0505 20:13:37.459554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.459754 (+ 200us) service_pool.cc:224] Handling call
0505 20:13:52.257500 (+14797746us) ts_tablet_manager.cc:1151] Deleting tablet e083f131eca54d98852e5685e08ef46b
0505 20:13:52.257513 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.335695 (+ 78182us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.353086 (+ 17391us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.369999 (+ 16913us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14797509}
I20260505 20:13:52.370714 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet e083f131eca54d98852e5685e08ef46b (table default.Table_51fcf065d7704d8c9a54e578cce315d4 [id=44f7f9f11ebb427db990437f24a5662c]) successfully deleted
I20260505 20:13:52.371446 9270 tablet_replica.cc:333] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.384105 7659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91496ff1e14e4cfdbaadb34d25ad8b68" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
W20260505 20:13:52.384799 7736 leader_election.cc:343] T 91496ff1e14e4cfdbaadb34d25ad8b68 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.401266 9270 raft_consensus.cc:2243] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.401863 9270 raft_consensus.cc:2272] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.404544 9270 ts_tablet_manager.cc:1916] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:52.417160 7399 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 7f34a3f1f30b4165a0c60fab482dce36 (table default.Table_e621645c928d4718bda596265ef8ab3f [id=935ce41925944dffab526cf8d8ea98d0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f34a3f1f30b4165a0c60fab482dce36 consensus state has no leader
I20260505 20:13:52.435570 9270 ts_tablet_manager.cc:1929] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.437472 9270 log.cc:1199] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
I20260505 20:13:52.444938 9270 ts_tablet_manager.cc:1950] T 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.446811 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 164) took 14987 ms. Trace:
I20260505 20:13:52.460978 9270 rpcz_store.cc:276] 0505 20:13:37.459696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.460481 (+ 785us) service_pool.cc:224] Handling call
0505 20:13:52.371049 (+14910568us) ts_tablet_manager.cc:1151] Deleting tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6
0505 20:13:52.371395 (+ 346us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.408937 (+ 37542us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.435486 (+ 26549us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.446782 (+ 11296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14910378}
I20260505 20:13:52.462034 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 6ca74b1f5ccb4f02a11b5d2a1bf2d5a6 (table default.Table_f3ed0fb723674f06869eefa958b4bf71 [id=4cd4fd352ad747f4b7fc43a0d7f15322]) successfully deleted
I20260505 20:13:52.462111 9270 tablet_replica.cc:333] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.462329 9270 raft_consensus.cc:2243] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.462378 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee71b5d9ebb4081b98bf5514edb7f28" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:52.463316 9270 raft_consensus.cc:2272] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.464052 7658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a6b85007c4f468ca18028a66395dc45" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:52.464251 9270 ts_tablet_manager.cc:1916] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:52.469862 8053 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.534s user 0.085s sys 0.104s
W20260505 20:13:52.469978 8053 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.534s user 0.085s sys 0.104s
W20260505 20:13:52.480731 7596 consensus_peers.cc:597] T 3dbc2221555e4f598d65835ae640fe4a P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3dbc2221555e4f598d65835ae640fe4a. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.488124 10520 tablet.cc:1724] T 86c9aaca827442cc8cc605f56c222860 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:52.490624 9975 raft_consensus.cc:493] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.490810 9975 raft_consensus.cc:515] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.490895 10521 tablet.cc:1724] T 86c9aaca827442cc8cc605f56c222860 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:52.491483 9975 leader_election.cc:290] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.497219 9270 ts_tablet_manager.cc:1929] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.502179 9270 log.cc:1199] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/8c8754580368453aa0aae021d8c665da
I20260505 20:13:52.502702 9270 ts_tablet_manager.cc:1950] T 8c8754580368453aa0aae021d8c665da P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
W20260505 20:13:52.506034 7598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.33.195:39859, user_credentials={real_user=slave}} blocked reactor thread for 67530.3us
I20260505 20:13:52.510814 9975 raft_consensus.cc:493] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.511011 9975 raft_consensus.cc:515] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.511816 9975 leader_election.cc:290] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.520844 10523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4615fa5639440fc820498f897adf17d)
I20260505 20:13:52.521149 10523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:52.522233 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 169) took 15059 ms. Trace:
I20260505 20:13:52.522403 9270 rpcz_store.cc:276] 0505 20:13:37.462486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.462550 (+ 64us) service_pool.cc:224] Handling call
0505 20:13:52.462059 (+14999509us) ts_tablet_manager.cc:1151] Deleting tablet 8c8754580368453aa0aae021d8c665da
0505 20:13:52.462071 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.476142 (+ 14071us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.497140 (+ 20998us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.522205 (+ 25065us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":14999336}
I20260505 20:13:52.523015 9270 tablet_replica.cc:333] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.523365 8053 tablet_bootstrap.cc:492] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.523381 9270 raft_consensus.cc:2243] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.523556 8053 ts_tablet_manager.cc:1403] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.593s user 0.086s sys 0.104s
I20260505 20:13:52.524005 9270 raft_consensus.cc:2272] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.524355 8053 raft_consensus.cc:359] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.524528 8053 raft_consensus.cc:385] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.524576 8053 raft_consensus.cc:740] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.524749 8053 consensus_queue.cc:260] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.525267 8053 ts_tablet_manager.cc:1434] T 55a3257f86264120b145263525d260a4 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:52.525657 8053 tablet_bootstrap.cc:492] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.526746 10521 tablet.cc:1724] T d49e4bb0c885499cbe30f86e15f12989 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:52.528023 10523 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:52.529834 8053 tablet_bootstrap.cc:654] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.530124 10520 tablet.cc:1724] T d49e4bb0c885499cbe30f86e15f12989 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:52.533986 7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432b497141ed46ba9112b2b74f895238" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:52.534296 7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ee820d24ec4ba1b3ae17388f75341b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:52.533860 9270 ts_tablet_manager.cc:1916] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.540596 10522 raft_consensus.cc:493] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4615fa5639440fc820498f897adf17d)
I20260505 20:13:52.541177 9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 845 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967" is_pre_election: true
I20260505 20:13:52.542217 10522 raft_consensus.cc:515] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:52.542891 9568 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29603775b6d74153b21e0bbcc535ff98 in term 2.
I20260505 20:13:52.543926 8053 tablet_bootstrap.cc:492] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.544118 8053 ts_tablet_manager.cc:1403] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.006s
I20260505 20:13:52.544780 8053 raft_consensus.cc:359] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.545003 8053 raft_consensus.cc:385] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.545090 8053 raft_consensus.cc:740] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.545168 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "73028cd481e446daa9432a35522a7967" candidate_term: 3 candidate_status { last_received { term: 2 index: 845 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
I20260505 20:13:52.545388 8053 consensus_queue.cc:260] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.546044 8053 ts_tablet_manager.cc:1434] T a694c65f90f4499ab96e45fbbaa9e892 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:52.546406 8053 tablet_bootstrap.cc:492] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.550844 7849 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:52.556412 8261 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98, 73028cd481e446daa9432a35522a7967; no voters:
I20260505 20:13:52.557165 8053 tablet_bootstrap.cc:654] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.557824 8058 tablet_bootstrap.cc:492] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9: No bootstrap required, opened a new log
I20260505 20:13:52.557976 8058 ts_tablet_manager.cc:1403] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9: Time spent bootstrapping tablet: real 0.411s user 0.047s sys 0.075s
I20260505 20:13:52.558058 10523 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260505 20:13:52.558266 10523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4615fa5639440fc820498f897adf17d)
I20260505 20:13:52.558430 10523 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 2 FOLLOWER]: Advancing to term 3
I20260505 20:13:52.558746 8058 raft_consensus.cc:359] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.558938 8058 raft_consensus.cc:385] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.558997 8058 raft_consensus.cc:740] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cab133462c2f46309dc8f0792122bad9, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.559226 8058 consensus_queue.cc:260] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.559717 8058 ts_tablet_manager.cc:1434] T be05357416b24dabaaa5f2ce2f33c82e P cab133462c2f46309dc8f0792122bad9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260505 20:13:52.560009 8058 tablet_bootstrap.cc:492] T 9e217456754440cf90a1c5a642eb2627 P cab133462c2f46309dc8f0792122bad9: Bootstrap starting.
I20260505 20:13:52.421672 7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c591e3f33d4606be7181e380fadcf6" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.561440 7927 raft_consensus.cc:2468] T 95c591e3f33d4606be7181e380fadcf6 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.422150 7920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c20374c4df742799110a12f3fea5daa" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.561720 7920 raft_consensus.cc:2468] T 6c20374c4df742799110a12f3fea5daa P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.423065 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1425e08c7c342e3bc05074645969b2c" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.562019 7924 raft_consensus.cc:2468] T f1425e08c7c342e3bc05074645969b2c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.427861 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd2235cec9d41f299d04398c097ae42" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
W20260505 20:13:52.466799 7870 leader_election.cc:343] T 3ee71b5d9ebb4081b98bf5514edb7f28 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.520394 10524 tablet.cc:1724] T 86c9aaca827442cc8cc605f56c222860 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:52.562245 7936 raft_consensus.cc:2468] T ddd2235cec9d41f299d04398c097ae42 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
W20260505 20:13:52.562285 7870 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.33.193:40347, user_credentials={real_user=slave}} blocked reactor thread for 95565.4us
I20260505 20:13:52.562845 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 209) took 12640 ms. Trace:
I20260505 20:13:52.562915 9121 rpcz_store.cc:276] 0505 20:13:39.922277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:39.922327 (+ 50us) service_pool.cc:224] Handling call
0505 20:13:52.562718 (+12640391us) ts_tablet_manager.cc:1151] Deleting tablet e295edfdcbfe489281dff1b86ab990f1
0505 20:13:52.562730 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.562830 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12640199}
W20260505 20:13:52.563205 7870 leader_election.cc:343] T 3a6b85007c4f468ca18028a66395dc45 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.563469 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 210) took 12501 ms. Trace:
I20260505 20:13:52.563550 9121 rpcz_store.cc:276] 0505 20:13:40.062401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.062601 (+ 200us) service_pool.cc:224] Handling call
0505 20:13:52.563143 (+12500542us) ts_tablet_manager.cc:1151] Deleting tablet c7085351ba8e4c78b684894460cec8e3
0505 20:13:52.563151 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.563454 (+ 303us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12500349}
I20260505 20:13:52.563623 10505 raft_consensus.cc:493] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.563762 10505 raft_consensus.cc:515] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.564493 10505 leader_election.cc:290] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347)
I20260505 20:13:52.576524 10523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:52.563776 9121 tablet_replica.cc:333] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:52.577293 9121 raft_consensus.cc:2243] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.578058 9121 raft_consensus.cc:2272] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.581458 9568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 845 } } ignore_live_leader: false dest_uuid: "73028cd481e446daa9432a35522a7967"
I20260505 20:13:52.581662 9568 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 2 FOLLOWER]: Advancing to term 3
I20260505 20:13:52.578341 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753489e300e743c48485cb5d3d19b8b9" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.582001 7928 raft_consensus.cc:2468] T 753489e300e743c48485cb5d3d19b8b9 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.580698 7936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432b497141ed46ba9112b2b74f895238" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.582237 7936 raft_consensus.cc:2468] T 432b497141ed46ba9112b2b74f895238 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.582238 10523 leader_election.cc:290] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 election: Requested vote from peers 73028cd481e446daa9432a35522a7967 (127.7.33.254:38755), f4615fa5639440fc820498f897adf17d (127.7.33.253:39345)
I20260505 20:13:52.581281 7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ee820d24ec4ba1b3ae17388f75341b" candidate_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.582410 7924 raft_consensus.cc:2468] T 81ee820d24ec4ba1b3ae17388f75341b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59c731e012f4f9fbfd7151790b9a5bb in term 0.
I20260505 20:13:52.582722 9121 ts_tablet_manager.cc:1916] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:52.583621 7596 consensus_peers.cc:597] T 4816f1ccb82e4641b2dcfe9ce9b55fae P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.584816 7661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d805583f5c64ea7a9fe2f658079b5c5" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cab133462c2f46309dc8f0792122bad9" is_pre_election: true
I20260505 20:13:52.584956 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b78fbe740a4478a5638bea70268125" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:52.585536 9568 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29603775b6d74153b21e0bbcc535ff98 in term 3.
I20260505 20:13:52.585989 8261 leader_election.cc:304] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29603775b6d74153b21e0bbcc535ff98, 73028cd481e446daa9432a35522a7967; no voters:
W20260505 20:13:52.587021 7870 leader_election.cc:343] T 6d805583f5c64ea7a9fe2f658079b5c5 P 974ed93a43c54ccbb58e60bfdae7c546 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.587350 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb672b1dfe7e4ed6ab9e73d328349238" candidate_uuid: "974ed93a43c54ccbb58e60bfdae7c546" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:52.600314 8053 tablet_bootstrap.cc:492] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.600481 8053 ts_tablet_manager.cc:1403] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.008s
I20260505 20:13:52.601188 8053 raft_consensus.cc:359] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.601362 8053 raft_consensus.cc:385] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.601413 8053 raft_consensus.cc:740] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.601603 8053 consensus_queue.cc:260] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.601927 10523 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 3 FOLLOWER]: Leader election won for term 3
I20260505 20:13:52.602159 8053 ts_tablet_manager.cc:1434] T ae79f58b6c874103afffa963c45891a1 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:52.602433 8053 tablet_bootstrap.cc:492] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.602784 10522 leader_election.cc:290] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4615fa5639440fc820498f897adf17d (127.7.33.253:39345), 29603775b6d74153b21e0bbcc535ff98 (127.7.33.252:42521)
I20260505 20:13:52.603434 10428 raft_consensus.cc:493] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.603583 10428 raft_consensus.cc:515] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.604060 8053 tablet_bootstrap.cc:654] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.604159 10428 leader_election.cc:290] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.605410 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:52.605669 7785 raft_consensus.cc:2393] T c398f3abe1a5439195a23dd655843720 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
W20260505 20:13:52.606050 7736 consensus_peers.cc:597] T 907b7dccd7a94115aca36915a558b103 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:52.606240 7736 consensus_peers.cc:597] T ad2fb4e615c4486b9d071b2366f85471 P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260505 20:13:52.606575 7736 leader_election.cc:343] T 432b497141ed46ba9112b2b74f895238 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
W20260505 20:13:52.606736 7736 leader_election.cc:343] T 81ee820d24ec4ba1b3ae17388f75341b P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Illegal state: must be running to vote when last-logged opid is not known
I20260505 20:13:52.610556 7928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c398f3abe1a5439195a23dd655843720" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.610821 7928 raft_consensus.cc:2393] T c398f3abe1a5439195a23dd655843720 P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:52.612381 7422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 845 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d"
I20260505 20:13:52.612511 7423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29603775b6d74153b21e0bbcc535ff98" candidate_term: 3 candidate_status { last_received { term: 2 index: 845 } } ignore_live_leader: false dest_uuid: "f4615fa5639440fc820498f897adf17d" is_pre_election: true
W20260505 20:13:52.621933 8054 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.691s user 0.051s sys 0.077s
W20260505 20:13:52.622056 8054 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.691s user 0.051s sys 0.077s
I20260505 20:13:52.623030 8053 tablet_bootstrap.cc:492] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.623070 9568 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 73028cd481e446daa9432a35522a7967 [term 3 FOLLOWER]: Rejecting Update request from peer f4615fa5639440fc820498f897adf17d for earlier term 2. Current term is 3. Ops: []
I20260505 20:13:52.623270 8053 ts_tablet_manager.cc:1403] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260505 20:13:52.624044 8053 raft_consensus.cc:359] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.624219 8053 raft_consensus.cc:385] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.624274 8053 raft_consensus.cc:740] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.624537 8053 consensus_queue.cc:260] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.625177 8053 ts_tablet_manager.cc:1434] T 369f4a55fdd64e4bb907666bede9f241 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:52.625459 8053 tablet_bootstrap.cc:492] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.625720 9121 ts_tablet_manager.cc:1929] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.625957 9121 log.cc:1199] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f697fa87e7fe4da0b70bfa42a8818660
I20260505 20:13:52.626408 9121 ts_tablet_manager.cc:1950] T f697fa87e7fe4da0b70bfa42a8818660 P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:52.627233 8053 tablet_bootstrap.cc:654] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.625233 9270 ts_tablet_manager.cc:1929] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.627336 9270 log.cc:1199] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/28ce3efe875a43d9b30d40623bf8a385
I20260505 20:13:52.626679 8054 tablet_bootstrap.cc:492] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:52.627628 8054 ts_tablet_manager.cc:1403] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.700s user 0.053s sys 0.078s
I20260505 20:13:52.628268 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 211) took 12565 ms. Trace:
I20260505 20:13:52.628844 10525 consensus_queue.cc:1059] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 }, Status: INVALID_TERM, Last received: 2.845, Next index: 846, Last known committed idx: 845, Time since last communication: 0.001s
I20260505 20:13:52.629426 10523 raft_consensus.cc:697] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 3 LEADER]: Becoming Leader. State: Replica: 29603775b6d74153b21e0bbcc535ff98, State: Running, Role: LEADER
I20260505 20:13:52.630225 9270 ts_tablet_manager.cc:1950] T 28ce3efe875a43d9b30d40623bf8a385 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.630587 9121 rpcz_store.cc:276] 0505 20:13:40.062543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.062829 (+ 286us) service_pool.cc:224] Handling call
0505 20:13:52.563737 (+12500908us) ts_tablet_manager.cc:1151] Deleting tablet f697fa87e7fe4da0b70bfa42a8818660
0505 20:13:52.563746 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.592722 (+ 28976us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.625660 (+ 32938us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.628244 (+ 2584us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12500794}
I20260505 20:13:52.631223 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 212) took 12565 ms. Trace:
I20260505 20:13:52.631287 10523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 845, Committed index: 845, Last appended: 2.845, Last appended by leader: 845, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:52.631443 9121 rpcz_store.cc:276] 0505 20:13:40.066101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.066625 (+ 524us) service_pool.cc:224] Handling call
0505 20:13:52.631097 (+12564472us) ts_tablet_manager.cc:1151] Deleting tablet 249cad23ecfe4b9dbbd34f2a1fa899e3
0505 20:13:52.631109 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.631204 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12564274}
I20260505 20:13:52.631909 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 214) took 12565 ms. Trace:
I20260505 20:13:52.632042 9121 rpcz_store.cc:276] 0505 20:13:40.066360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.066850 (+ 490us) service_pool.cc:224] Handling call
0505 20:13:52.631806 (+12564956us) ts_tablet_manager.cc:1151] Deleting tablet b8d50ceda0ff4bb6b49920c922dfee9e
0505 20:13:52.631819 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.631895 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12564822}
I20260505 20:13:52.632390 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 215) took 12565 ms. Trace:
I20260505 20:13:52.632827 8053 tablet_bootstrap.cc:492] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.632961 8053 ts_tablet_manager.cc:1403] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260505 20:13:52.632934 9121 rpcz_store.cc:276] 0505 20:13:40.066466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.067021 (+ 555us) service_pool.cc:224] Handling call
0505 20:13:52.632312 (+12565291us) ts_tablet_manager.cc:1151] Deleting tablet f62626fb4f8445e3a6e2822277181762
0505 20:13:52.632320 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.632376 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12565170}
I20260505 20:13:52.633327 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 216) took 12566 ms. Trace:
I20260505 20:13:52.633595 8053 raft_consensus.cc:359] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.633769 8053 raft_consensus.cc:385] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.633831 8053 raft_consensus.cc:740] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.633872 9121 rpcz_store.cc:276] 0505 20:13:40.066574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.067179 (+ 605us) service_pool.cc:224] Handling call
0505 20:13:52.633253 (+12566074us) ts_tablet_manager.cc:1151] Deleting tablet bd01314146a34257b444a622829b2fe4
0505 20:13:52.633262 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.633313 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12565961}
I20260505 20:13:52.634065 8053 consensus_queue.cc:260] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.634675 8053 ts_tablet_manager.cc:1434] T 160aa46d629247d0a46f433ef4088643 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260505 20:13:52.634882 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 213) took 12568 ms. Trace:
I20260505 20:13:52.634970 8053 tablet_bootstrap.cc:492] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.634997 9121 rpcz_store.cc:276] 0505 20:13:40.066245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.067751 (+ 1506us) service_pool.cc:224] Handling call
0505 20:13:52.634195 (+12566444us) ts_tablet_manager.cc:1151] Deleting tablet 949fecb197084426b5a6adb959f5c886
0505 20:13:52.634206 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.634866 (+ 660us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":12566287}
I20260505 20:13:52.635349 9121 tablet_replica.cc:333] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:52.636543 8053 tablet_bootstrap.cc:654] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.636539 9121 raft_consensus.cc:2243] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.636804 9121 raft_consensus.cc:2272] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.637421 9121 ts_tablet_manager.cc:1916] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.642011 10525 raft_consensus.cc:3055] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 2 LEADER]: Stepping down as leader of term 2
I20260505 20:13:52.642269 10525 raft_consensus.cc:740] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4615fa5639440fc820498f897adf17d, State: Running, Role: LEADER
I20260505 20:13:52.645305 10531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29603775b6d74153b21e0bbcc535ff98. Latest consensus state: current_term: 3 leader_uuid: "29603775b6d74153b21e0bbcc535ff98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } } }
I20260505 20:13:52.645594 10531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [sys.catalog]: This master's current role is: LEADER
I20260505 20:13:52.645799 7711 heartbeater.cc:499] Master 127.7.33.253:39345 was elected leader, sending a full tablet report...
I20260505 20:13:52.645980 8322 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 29603775b6d74153b21e0bbcc535ff98 [term 3 LEADER]: Rejecting Update request from peer f4615fa5639440fc820498f897adf17d for earlier term 2. Current term is 3. Ops: []
I20260505 20:13:52.651135 8053 tablet_bootstrap.cc:492] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.628566 8054 raft_consensus.cc:359] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.651667 8054 raft_consensus.cc:385] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.651772 8054 raft_consensus.cc:740] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.651621 8053 ts_tablet_manager.cc:1403] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.007s
I20260505 20:13:52.652016 8054 consensus_queue.cc:260] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.652719 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 170) took 15190 ms. Trace:
I20260505 20:13:52.652823 9270 rpcz_store.cc:276] 0505 20:13:37.462589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.462752 (+ 163us) service_pool.cc:224] Handling call
0505 20:13:52.522951 (+15060199us) ts_tablet_manager.cc:1151] Deleting tablet 28ce3efe875a43d9b30d40623bf8a385
0505 20:13:52.522966 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.583111 (+ 60145us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.625158 (+ 42047us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.652695 (+ 27537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18621,"tablet-delete.queue_time_us":15060069}
I20260505 20:13:52.653434 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 28ce3efe875a43d9b30d40623bf8a385 (table default.Table_96a76218de254fee8498ed283135bbbf [id=349bbf04fd494d7fb5fea9acc0a11d64]) successfully deleted
I20260505 20:13:52.653443 8053 raft_consensus.cc:359] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.653617 8053 raft_consensus.cc:385] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.653669 8053 raft_consensus.cc:740] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.654354 8053 consensus_queue.cc:260] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.655313 8053 ts_tablet_manager.cc:1434] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260505 20:13:52.655570 8053 tablet_bootstrap.cc:492] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.656026 10520 tablet.cc:1724] T 997f2f9cf76a4311ab233cb7d8bc8e3c P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:52.657202 8053 tablet_bootstrap.cc:654] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.659688 8054 ts_tablet_manager.cc:1434] T 566a6942cc904468a0cab3deae8a860b P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260505 20:13:52.660236 8054 tablet_bootstrap.cc:492] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:52.660725 9270 tablet_replica.cc:333] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.660938 10536 consensus_queue.cc:1059] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 }, Status: INVALID_TERM, Last received: 2.845, Next index: 846, Last known committed idx: 845, Time since last communication: 0.000s
I20260505 20:13:52.661105 9270 raft_consensus.cc:2243] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.661466 9270 raft_consensus.cc:2272] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.662055 10536 consensus_queue.cc:1243] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [LEADER]: Peer 29603775b6d74153b21e0bbcc535ff98 log is divergent from this leader: its last log entry 3.846 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 845
I20260505 20:13:52.662149 9270 ts_tablet_manager.cc:1916] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.660881 9704 raft_consensus.cc:493] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.662763 9704 raft_consensus.cc:515] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.663475 9704 leader_election.cc:290] T 3f01954a7a194e159a86152625e1ff6b P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.663751 7785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" is_pre_election: true
I20260505 20:13:52.663973 7785 raft_consensus.cc:2393] T 3f01954a7a194e159a86152625e1ff6b P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate c59c731e012f4f9fbfd7151790b9a5bb in this term.
W20260505 20:13:52.664899 7596 consensus_peers.cc:597] T 5b6326375bac48f0944eeeaa9b39682c P cab133462c2f46309dc8f0792122bad9 -> Peer c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): Couldn't send request to peer c59c731e012f4f9fbfd7151790b9a5bb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b6326375bac48f0944eeeaa9b39682c. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.666355 8054 tablet_bootstrap.cc:654] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.666913 7930 raft_consensus.cc:3060] T 68718abc133e452495567232e51fb55b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Advancing to term 2
I20260505 20:13:52.669468 8053 tablet_bootstrap.cc:492] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.669602 8053 ts_tablet_manager.cc:1403] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.003s
I20260505 20:13:52.670305 8053 raft_consensus.cc:359] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.670485 8053 raft_consensus.cc:385] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.670547 8053 raft_consensus.cc:740] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.670746 8053 consensus_queue.cc:260] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.673326 8053 ts_tablet_manager.cc:1434] T 82b78fbe740a4478a5638bea70268125 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260505 20:13:52.673593 8053 tablet_bootstrap.cc:492] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.675398 8053 tablet_bootstrap.cc:654] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.678294 8058 tablet_bootstrap.cc:654] T 9e217456754440cf90a1c5a642eb2627 P cab133462c2f46309dc8f0792122bad9: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.680794 9270 ts_tablet_manager.cc:1929] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.681205 9270 log.cc:1199] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/004a8e72cab44d31af3369b8df1e434e
I20260505 20:13:52.681713 9270 ts_tablet_manager.cc:1950] T 004a8e72cab44d31af3369b8df1e434e P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.681972 10518 tablet.cc:1724] T 997f2f9cf76a4311ab233cb7d8bc8e3c P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260505 20:13:52.682188 8053 tablet_bootstrap.cc:492] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.682126 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 171) took 15219 ms. Trace:
I20260505 20:13:52.682312 8053 ts_tablet_manager.cc:1403] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260505 20:13:52.682479 9270 rpcz_store.cc:276] 0505 20:13:37.462694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.462902 (+ 208us) service_pool.cc:224] Handling call
0505 20:13:52.660651 (+15197749us) ts_tablet_manager.cc:1151] Deleting tablet 004a8e72cab44d31af3369b8df1e434e
0505 20:13:52.660667 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.670201 (+ 9534us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.680711 (+ 10510us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.682109 (+ 1398us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":15197619}
I20260505 20:13:52.683028 8053 raft_consensus.cc:359] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.683220 8053 raft_consensus.cc:385] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.683207 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 004a8e72cab44d31af3369b8df1e434e (table default.Table_d74b7092fc2d4c3aa335636b0905e53f [id=bc7111d081dd4f4ba06f987ca0b9d6a3]) successfully deleted
I20260505 20:13:52.683271 8053 raft_consensus.cc:740] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.683435 8053 consensus_queue.cc:260] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.683696 9270 tablet_replica.cc:333] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.683915 8053 ts_tablet_manager.cc:1434] T 7382e748682547b1a41781ff05c6733d P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260505 20:13:52.683925 9270 raft_consensus.cc:2243] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 1 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.684209 8053 tablet_bootstrap.cc:492] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.684410 9270 raft_consensus.cc:2272] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.685050 9270 ts_tablet_manager.cc:1916] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.685881 8053 tablet_bootstrap.cc:654] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.687397 7598 leader_election.cc:304] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cab133462c2f46309dc8f0792122bad9; no voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb
I20260505 20:13:52.687680 10513 raft_consensus.cc:3060] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.690446 10513 raft_consensus.cc:2749] T c398f3abe1a5439195a23dd655843720 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260505 20:13:52.691288 10525 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 845, Committed index: 845, Last appended: 2.845, Last appended by leader: 845, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73028cd481e446daa9432a35522a7967" member_type: VOTER last_known_addr { host: "127.7.33.254" port: 38755 } } peers { permanent_uuid: "f4615fa5639440fc820498f897adf17d" member_type: VOTER last_known_addr { host: "127.7.33.253" port: 39345 } } peers { permanent_uuid: "29603775b6d74153b21e0bbcc535ff98" member_type: VOTER last_known_addr { host: "127.7.33.252" port: 42521 } }
I20260505 20:13:52.692130 10525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f4615fa5639440fc820498f897adf17d [term 2 FOLLOWER]: Advancing to term 3
I20260505 20:13:52.697271 7737 leader_election.cc:304] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:52.697721 9948 raft_consensus.cc:2804] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:52.697855 9948 raft_consensus.cc:493] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:52.697937 9948 raft_consensus.cc:3060] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.698763 7737 leader_election.cc:304] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:52.699141 10306 raft_consensus.cc:2804] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:52.699239 10306 raft_consensus.cc:697] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:52.699497 10306 consensus_queue.cc:237] T d0943621b2d14346ad79d1b7a74e4d47 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.700628 9948 raft_consensus.cc:515] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.701337 9948 leader_election.cc:290] T e116486fb4b34e88b564fbb46e8b0faf P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.705199 9270 ts_tablet_manager.cc:1929] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.706043 9270 log.cc:1199] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/8e650b297603425184ad97ddf99ec36d
I20260505 20:13:52.706643 9270 ts_tablet_manager.cc:1950] T 8e650b297603425184ad97ddf99ec36d P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.706694 9948 raft_consensus.cc:493] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.707329 9948 raft_consensus.cc:515] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.707991 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 173) took 15245 ms. Trace:
I20260505 20:13:52.708086 9270 rpcz_store.cc:276] 0505 20:13:37.462924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.463057 (+ 133us) service_pool.cc:224] Handling call
0505 20:13:52.683641 (+15220584us) ts_tablet_manager.cc:1151] Deleting tablet 8e650b297603425184ad97ddf99ec36d
0505 20:13:52.683654 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.699051 (+ 15397us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.705123 (+ 6072us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.707975 (+ 2852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":15220433}
I20260505 20:13:52.708381 9270 tablet_replica.cc:333] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.708561 9270 raft_consensus.cc:2243] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: Raft consensus shutting down.
I20260505 20:13:52.708570 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 8e650b297603425184ad97ddf99ec36d (table default.Table_b36ca8cad35d47ba80d17ed4bbed7818 [id=5441e4a0011a401a911ba63d03f16b49]) successfully deleted
I20260505 20:13:52.708871 9270 pending_rounds.cc:70] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Trying to abort 1 pending ops.
I20260505 20:13:52.708925 9270 pending_rounds.cc:77] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7282737272465100800 op_type: NO_OP noop_request { }
I20260505 20:13:52.709009 9270 raft_consensus.cc:2889] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260505 20:13:52.709095 9270 raft_consensus.cc:2272] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.709259 9948 leader_election.cc:290] T 335acbbc84624d61b779a422f29919fa P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.709597 9270 ts_tablet_manager.cc:1916] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.710340 8053 tablet_bootstrap.cc:492] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.710467 8053 ts_tablet_manager.cc:1403] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.009s
I20260505 20:13:52.711124 8053 raft_consensus.cc:359] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.711287 8053 raft_consensus.cc:385] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.711345 8053 raft_consensus.cc:740] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.711520 8053 consensus_queue.cc:260] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.711974 8053 ts_tablet_manager.cc:1434] T 0cb3d246d6b443b8933648fe4f4aa5c2 P c59c731e012f4f9fbfd7151790b9a5bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260505 20:13:52.715108 8053 tablet_bootstrap.cc:492] T e2b6d9b8da2d4550bd5bb37cd0da929b P c59c731e012f4f9fbfd7151790b9a5bb: Bootstrap starting.
I20260505 20:13:52.718417 10538 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260505 20:13:52.719316 8053 tablet_bootstrap.cc:654] T e2b6d9b8da2d4550bd5bb37cd0da929b P c59c731e012f4f9fbfd7151790b9a5bb: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.721772 9270 ts_tablet_manager.cc:1929] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260505 20:13:52.721891 9270 log.cc:1199] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/f2b2e40635b141c59d3789aca81efba7
I20260505 20:13:52.722224 9270 ts_tablet_manager.cc:1950] T f2b2e40635b141c59d3789aca81efba7 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.722605 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 175) took 15259 ms. Trace:
I20260505 20:13:52.722697 9270 rpcz_store.cc:276] 0505 20:13:37.463139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.463202 (+ 63us) service_pool.cc:224] Handling call
0505 20:13:52.708340 (+15245138us) ts_tablet_manager.cc:1151] Deleting tablet f2b2e40635b141c59d3789aca81efba7
0505 20:13:52.708348 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.716336 (+ 7988us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.721692 (+ 5356us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.722585 (+ 893us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":15245006}
I20260505 20:13:52.723012 9270 tablet_replica.cc:333] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.723191 9270 raft_consensus.cc:2243] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.723266 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet f2b2e40635b141c59d3789aca81efba7 (table default.Table_5a45becc03e84424944683d29051a244 [id=4e4535fa42f14f32adc5dc544aadd599]) successfully deleted
I20260505 20:13:52.723352 9270 raft_consensus.cc:2272] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.723838 9270 ts_tablet_manager.cc:1916] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260505 20:13:52.725276 7736 consensus_peers.cc:597] T 5b60c74cfa0d4c498ed50daefe3905ab P c59c731e012f4f9fbfd7151790b9a5bb -> Peer cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): Couldn't send request to peer cab133462c2f46309dc8f0792122bad9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260505 20:13:52.728128 9271 ts_tablet_manager.cc:1929] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.728227 9271 log.cc:1199] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-1/wal/wals/4816f1ccb82e4641b2dcfe9ce9b55fae
I20260505 20:13:52.728627 9271 ts_tablet_manager.cc:1950] T 4816f1ccb82e4641b2dcfe9ce9b55fae P c59c731e012f4f9fbfd7151790b9a5bb: Deleting consensus metadata
I20260505 20:13:52.729332 9271 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40056 (request call id 231) took 12365 ms. Trace:
I20260505 20:13:52.729422 9271 rpcz_store.cc:276] 0505 20:13:40.363998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:40.364170 (+ 172us) service_pool.cc:224] Handling call
0505 20:13:52.115191 (+11751021us) ts_tablet_manager.cc:1151] Deleting tablet 4816f1ccb82e4641b2dcfe9ce9b55fae
0505 20:13:52.115207 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.546793 (+431586us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.728066 (+181273us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.729316 (+ 1250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":11750603}
I20260505 20:13:52.729934 7397 catalog_manager.cc:5002] TS c59c731e012f4f9fbfd7151790b9a5bb (127.7.33.194:41991): tablet 4816f1ccb82e4641b2dcfe9ce9b55fae (table default.Table_6407eb94904a4c3db461964a5e97fe89 [id=131ffbf3ae28484d9a4f408397dbe11a]) successfully deleted
I20260505 20:13:52.732905 9270 ts_tablet_manager.cc:1929] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.734058 7737 leader_election.cc:304] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:52.734603 9948 raft_consensus.cc:2804] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:52.734906 9948 raft_consensus.cc:697] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:52.735260 9948 consensus_queue.cc:237] T b6dc9ec93ddb406ab956389518a9a7b3 P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.736001 9270 log.cc:1199] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/20c24f9f26c84ba7b2ce85f9da4bccf8
I20260505 20:13:52.736536 9270 ts_tablet_manager.cc:1950] T 20c24f9f26c84ba7b2ce85f9da4bccf8 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.737255 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 174) took 15274 ms. Trace:
I20260505 20:13:52.737764 9270 rpcz_store.cc:276] 0505 20:13:37.463044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.463350 (+ 306us) service_pool.cc:224] Handling call
0505 20:13:52.722967 (+15259617us) ts_tablet_manager.cc:1151] Deleting tablet 20c24f9f26c84ba7b2ce85f9da4bccf8
0505 20:13:52.722976 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.730167 (+ 7191us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.732845 (+ 2678us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.737238 (+ 4393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":15259525}
I20260505 20:13:52.738380 9270 tablet_replica.cc:333] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: stopping tablet replica
I20260505 20:13:52.738618 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 20c24f9f26c84ba7b2ce85f9da4bccf8 (table default.Table_133f54e3650c43b59175c563864bd932 [id=5248510b86d2424eb2167fd9a12ec41e]) successfully deleted
I20260505 20:13:52.738824 9270 raft_consensus.cc:2243] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.738981 9270 raft_consensus.cc:2272] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.674387 9121 ts_tablet_manager.cc:1929] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:52.739938 9121 log.cc:1199] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/26b143e4943343d5b151f2804cccecfb
I20260505 20:13:52.740026 9270 ts_tablet_manager.cc:1916] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.740267 9121 ts_tablet_manager.cc:1950] T 26b143e4943343d5b151f2804cccecfb P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:52.741010 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 227) took 10529 ms. Trace:
I20260505 20:13:52.741096 9121 rpcz_store.cc:276] 0505 20:13:42.211192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.211282 (+ 90us) service_pool.cc:224] Handling call
0505 20:13:52.635307 (+10424025us) ts_tablet_manager.cc:1151] Deleting tablet 26b143e4943343d5b151f2804cccecfb
0505 20:13:52.635316 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.642899 (+ 7583us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.674320 (+ 31421us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.740989 (+ 66669us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10395122}
I20260505 20:13:52.741389 9121 tablet_replica.cc:333] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:52.741554 9121 raft_consensus.cc:2243] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.741676 9121 raft_consensus.cc:2272] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.678445 8054 tablet_bootstrap.cc:492] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546: No bootstrap required, opened a new log
I20260505 20:13:52.727128 10524 tablet.cc:1724] T d49e4bb0c885499cbe30f86e15f12989 P 974ed93a43c54ccbb58e60bfdae7c546: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260505 20:13:52.741973 8054 ts_tablet_manager.cc:1403] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.000s
I20260505 20:13:52.727128 7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f01954a7a194e159a86152625e1ff6b" candidate_uuid: "cab133462c2f46309dc8f0792122bad9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "974ed93a43c54ccbb58e60bfdae7c546" is_pre_election: true
I20260505 20:13:52.742360 7927 raft_consensus.cc:2393] T 3f01954a7a194e159a86152625e1ff6b P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cab133462c2f46309dc8f0792122bad9 in current term 1: Already voted for candidate 974ed93a43c54ccbb58e60bfdae7c546 in this term.
I20260505 20:13:52.742619 8054 raft_consensus.cc:359] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.742727 10520 tablet.cc:1724] T 010c399e14624550bf02ea248d653538 P cab133462c2f46309dc8f0792122bad9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:52.742928 8054 raft_consensus.cc:385] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.743062 8054 raft_consensus.cc:740] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974ed93a43c54ccbb58e60bfdae7c546, State: Initialized, Role: FOLLOWER
I20260505 20:13:52.743301 8054 consensus_queue.cc:260] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } }
I20260505 20:13:52.743956 8054 ts_tablet_manager.cc:1434] T c7085351ba8e4c78b684894460cec8e3 P 974ed93a43c54ccbb58e60bfdae7c546: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260505 20:13:52.744354 8054 tablet_bootstrap.cc:492] T 373c03859f5b4fbead92ea1d6d20a5df P 974ed93a43c54ccbb58e60bfdae7c546: Bootstrap starting.
I20260505 20:13:52.746856 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_a62884f24a7b450e86c9ec17c75bd041 [id=01f0244c225b47459ca461d8b3c0bde3]
I20260505 20:13:52.747381 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_e0363126ed254326bea2dd6eeeda5ace [id=02c5de2bc2974c8bbd7ee4a173affdf6]
I20260505 20:13:52.748456 10518 tablet.cc:1724] T 010c399e14624550bf02ea248d653538 P c59c731e012f4f9fbfd7151790b9a5bb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260505 20:13:52.749603 7737 leader_election.cc:304] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:52.749888 9894 raft_consensus.cc:2804] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260505 20:13:52.749989 9894 raft_consensus.cc:697] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [term 1 LEADER]: Becoming Leader. State: Replica: c59c731e012f4f9fbfd7151790b9a5bb, State: Running, Role: LEADER
I20260505 20:13:52.750202 9894 consensus_queue.cc:237] T 81319ed5eed64dafb9b2a121661da9ea P c59c731e012f4f9fbfd7151790b9a5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.750291 9270 ts_tablet_manager.cc:1929] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260505 20:13:52.750393 9270 log.cc:1199] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-0/wal/wals/096ca710e3564d4b8db50f29dd56a5d4
I20260505 20:13:52.750708 9121 ts_tablet_manager.cc:1916] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.750744 9270 ts_tablet_manager.cc:1950] T 096ca710e3564d4b8db50f29dd56a5d4 P cab133462c2f46309dc8f0792122bad9: Deleting consensus metadata
I20260505 20:13:52.751065 9270 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47850 (request call id 177) took 15287 ms. Trace:
I20260505 20:13:52.751135 9270 rpcz_store.cc:276] 0505 20:13:37.463358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:37.463458 (+ 100us) service_pool.cc:224] Handling call
0505 20:13:52.738331 (+15274873us) ts_tablet_manager.cc:1151] Deleting tablet 096ca710e3564d4b8db50f29dd56a5d4
0505 20:13:52.738342 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.743132 (+ 4790us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.750241 (+ 7109us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.751046 (+ 805us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":15274764}
I20260505 20:13:52.751607 7398 catalog_manager.cc:5002] TS cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347): tablet 096ca710e3564d4b8db50f29dd56a5d4 (table default.Table_04c24f9d92b1443588b27cfe31399508 [id=4c8b13827e834d51b935d4110f5628a1]) successfully deleted
I20260505 20:13:52.755627 8054 tablet_bootstrap.cc:654] T 373c03859f5b4fbead92ea1d6d20a5df P 974ed93a43c54ccbb58e60bfdae7c546: Neither blocks nor log segments found. Creating new log.
I20260505 20:13:52.761050 9121 ts_tablet_manager.cc:1929] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260505 20:13:52.761327 9121 log.cc:1199] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting WAL directory at /tmp/dist-test-taskf21k8s/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1778011997527186-7303-0/minicluster-data/ts-2/wal/wals/f6eaa274f7ef4cd6b9752f14b143ab6c
I20260505 20:13:52.761600 8053 tablet_bootstrap.cc:492] T e2b6d9b8da2d4550bd5bb37cd0da929b P c59c731e012f4f9fbfd7151790b9a5bb: No bootstrap required, opened a new log
I20260505 20:13:52.761804 8053 ts_tablet_manager.cc:1403] T e2b6d9b8da2d4550bd5bb37cd0da929b P c59c731e012f4f9fbfd7151790b9a5bb: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.018s
I20260505 20:13:52.761818 9121 ts_tablet_manager.cc:1950] T f6eaa274f7ef4cd6b9752f14b143ab6c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting consensus metadata
I20260505 20:13:52.762669 9121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42188 (request call id 229) took 10512 ms. Trace:
I20260505 20:13:52.748037 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_a412611fdfad4801a55a136337ab2b3f [id=035fa286b2214f56b11c07eb3146f44c]
I20260505 20:13:52.762882 9121 rpcz_store.cc:276] 0505 20:13:42.251036 (+ 0us) service_pool.cc:167] Inserting onto call queue
0505 20:13:42.251213 (+ 177us) service_pool.cc:224] Handling call
0505 20:13:52.741344 (+10490131us) ts_tablet_manager.cc:1151] Deleting tablet f6eaa274f7ef4cd6b9752f14b143ab6c
0505 20:13:52.741353 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0505 20:13:52.757102 (+ 15749us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.760942 (+ 3840us) tablet_metadata.cc:665] Metadata flushed
0505 20:13:52.762631 (+ 1689us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10465131}
I20260505 20:13:52.763340 9121 tablet_replica.cc:333] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: stopping tablet replica
I20260505 20:13:52.763680 9121 raft_consensus.cc:2243] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260505 20:13:52.763728 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_d678b8a74d2946ca99c70e3a0f5b5b08 [id=045845bc74254e53ba6f9ede9e6d4a0b]
I20260505 20:13:52.764133 9121 raft_consensus.cc:2272] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260505 20:13:52.764757 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_71d954d3c76548d5a3c1218e3d906bd8 [id=0700185e62e447e5b8d0a6ec4b6ede14]
I20260505 20:13:52.764788 9121 ts_tablet_manager.cc:1916] T bda4fd8b0f214da7a1e8b944e1820c0c P 974ed93a43c54ccbb58e60bfdae7c546: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260505 20:13:52.762686 8053 raft_consensus.cc:359] T e2b6d9b8da2d4550bd5bb37cd0da929b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.765895 8053 raft_consensus.cc:385] T e2b6d9b8da2d4550bd5bb37cd0da929b P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260505 20:13:52.765937 7737 leader_election.cc:304] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 974ed93a43c54ccbb58e60bfdae7c546, c59c731e012f4f9fbfd7151790b9a5bb; no voters: cab133462c2f46309dc8f0792122bad9
I20260505 20:13:52.766207 10477 raft_consensus.cc:2804] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260505 20:13:52.766286 10477 raft_consensus.cc:493] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260505 20:13:52.766355 10477 raft_consensus.cc:3060] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Advancing to term 1
I20260505 20:13:52.766775 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_300994ffa33b43dba2f1dda51861e3f1 [id=0b04ae6c921741049ea506fe8323865c]
I20260505 20:13:52.767252 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_a41cab9b68a142c9b7665c88d0d0ca7d [id=0c2a5400bd6e4ace87172b06b922cec3]
I20260505 20:13:52.767714 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_8aa3142c5bb74a9e95ac8f8efd637552 [id=0c47bf111a1549cc92c0fe9ea49f0173]
I20260505 20:13:52.769289 10477 raft_consensus.cc:515] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195" port: 39859 } }
I20260505 20:13:52.769436 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_0c647e85ed684787a671fbc4dfec5f16 [id=0f31c94eb447417a8daea1db313f4f38]
I20260505 20:13:52.770335 10538 catalog_manager.cc:679] Loaded metadata for table default.Table_070bf3473ab74c31b33db173e8f39d20 [id=12eca25cabd8420aa872cd90cdc4dc03]
I20260505 20:13:52.770483 10477 leader_election.cc:290] T 8cc695d3e3f941bbbe0d208c9f3572ee P c59c731e012f4f9fbfd7151790b9a5bb [CANDIDATE]: Term 1 election: Requested vote from peers cab133462c2f46309dc8f0792122bad9 (127.7.33.193:40347), 974ed93a43c54ccbb58e60bfdae7c546 (127.7.33.195:39859)
I20260505 20:13:52.771044 10477 raft_consensus.cc:493] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260505 20:13:52.771178 10477 raft_consensus.cc:515] T 5060bba634d440a09840e36e37a80d46 P c59c731e012f4f9fbfd7151790b9a5bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59c731e012f4f9fbfd7151790b9a5bb" member_type: VOTER last_known_addr { host: "127.7.33.194" port: 41991 } } peers { permanent_uuid: "cab133462c2f46309dc8f0792122bad9" member_type: VOTER last_known_addr { host: "127.7.33.193" port: 40347 } } peers { permanent_uuid: "974ed93a43c54ccbb58e60bfdae7c546" member_type: VOTER last_known_addr { host: "127.7.33.195"